Test Saagie in a few clicks with our interactive demo!

maj Saagie 2023.04

An AI-focused update: 2023.04

Autumn is finally here, and with it comes a palette of warm colors, comfort, solace and new arrivals at Saagie! ūüćā

It’s been 3 months since our last release, and Saagie has come a long way! Dive into the latest platform news with our October 2023.04 update ūüćĀūüĆü

1. Product updates (2023.04)

TLDR : To Long Didn't Read

Generating a Job Description With ChatGPT

You can use ChatGTP to generate your job description. Click Generate with ChatGPT above the description field to send your request to ChatGPT.

To enable the option, you must upgrade Saagie to the latest version. When configuring saagiectl, you will have to answer new prompts about the use of OpenAI. This will be asked when configuring your cluster settings.

This feature is only available for Spark with a Python context, Bash, R, Sqoop, and Python job technologies.

04-job-generate-descripton-chatgpt

Using Jupyter Notebook With a Generative AI

You can now use the Jupyter Notebook app with generative AI, such as ChatGPT, SageMaker, or Bedrock. A new app called JupyterLab+GenAI 4.0 Python 3.10 has been added to the Saagie official technology repository for use with a generative AI.

Using VS Code With an AI Pair Programmer

You can now use the VS Code app with AI Pair Programmers, such as GitHub Copilot and Genie. Use the VS Code Python 4.15.0 app context to have this feature.

Saagie Hugging Face Model Server Add-On

The Saagie Hugging Face Model Server add-on is an app designed to facilitate the deployment and prediction of Hugging Face deep learning models for text classification.

Saagie Code Search Add-On

The Saagie Code Search add-on is an app designed to help you search and retrieve Python code snippets from a default codebase or code repositories hosted on GitHub.

Viewing Your Cluster Resources With Saagie Resources Monitoring

Saagie Resources Monitoring (SRM) is a set of graphs providing an overview of your cluster’s resource consumption. SRM gives you a global view of RAM and CPU consumption for nodes, jobs and apps of your cluster through several graphs. It is based on Grafana. With its custom dashboard, you can quickly visualize and analyze RAM and CPU consumption in visual form.

Moving a Job to Another Project

Moving jobs from one project to another was already possible, but only between projects on the same platform. You can now move jobs from one project to another on a different platform.

From the job library or its The "Overview" page icon is a square divided into several other squares. Overview page, click the kebab menu The kebab menu icon is three vertical dots.  project move Move to… and enter the required information. The moved job keeps its versions, instances, logs, packages, alerts, and resource settings.

This avoids you to start from scratch and improves your productivity.

04-job-move-to-popup-window

Monitoring Job Execution Time

From your job’s The "Overview" page icon is a square divided into several other squares. Overview and The "Instances" page icon is three overlapping squares. Instances pages, you can now see the execution time of the running and terminated job, along with the different types of status it has gone through.

This allows you to determine the performance of your job. If it is not effective enough, you can optimize it accordingly.

Job execution time tracking

From the The "Instances" page icon is three overlapping squares. Instances and The "Versions" page icon is a folder with an arrow pointing up. Versions pages of your pipeline, you can now delete instances and versions. This allows you to streamline your list, improve your user experience, and maintain control over storage. You can either delete a single instance or version, a selection of versions or instances with or without filters.

04-pipeline-delete-version

Deleting Job Instances and Logs Based On Date Criteria

Deleting Job Instances and Logs Based On Date Criteria

The feature to delete job instances has been improved. You can now delete job instances with their logs using a date picker. From your job’s The "Instances" page icon is three overlapping squares. Instances page, select the All instances older than calendar plus filter to delete all instances prior to the selected date.

This will streamline the list and improves your user experience.

Deleting Job Versions Based On Tag Criteria

The job version deletion feature has been improved. You can now delete versions of a job based on tag criteria. From the The "Versions" page icon is a folder with an arrow pointing up. Versions page of your job, select the desired filter to delete versions accordingly.

This will streamline the list and improves your user experience.

Integrating Your Projects Into a CI/CD Pipeline

You can now integrate your Saagie projects into a CI/CD pipeline using our Saagie Python API. By including the source code of your jobs and pipelines in a leading Git tool like GitHub, you can enable CI/CD across all Saagie platforms, from development to production. These development best practices, such as pull changes, review, compare, or commit, can help you better control changes and thus ensure the integrity and consistency of your production environment.

Kubernetes 1.25.x Support

This new version of Saagie is compatible with Kubernetes 1.25.x !

2. User Experience Improvements

Restructuring Monitoring Modules

The heartbeat Monitoring and monitoring Operations modules have been restructured.

The heartbeat Monitoring module have been deleted. As a reminder, this module was composed of the Platform Overview page. This page provided you with an overview of node consumption and reservations for the selected platform.

The monitoring Operations module have been renamed heartbeat Monitoring. It stays the same as before, except for the name.

3. Saagie Technology Repository Updates

The following technologies have been added to the Saagie official technology repository:

Embedded and External Job Technologies

  • R: context 4.3 has been added.

Apps

  • CloudBeaver: context 23.1.1 has been added.
  • Jupyter Notebook:the JupyterLab+GenAI 4.0 Python 3.10 context has been added.
  • RStudio: context 4.3 has been added.
  • Saagie HF ModelServer TextCLF: the Saagie HF ModelServer TextCLF context has been added.
  • VS Code: VS Code 4.15.0 and VS Code Python 4.15.0 contexts have been added.

Find all the latest information and platform updates in our doc!