The second major Backend.AI release of 2024, version 24.09, is now available. This update brings large-scale architectural improvements centered on Backend.AI Core and significantly expands integration capabilities for diverse AI accelerators and enterprise infrastructure environments.

New arrivals

• Support for NVIDIA NGC and NIM: Backend.AI now supports key features of NVIDIA NGC (NVIDIA GPU Cloud) and NIM (Nemo Inference Microservice). Users can directly load licensed container images, ensuring full compatibility with NVIDIA’s ecosystem for smoother deployment and management of high-performance AI models.
• Expanded Accelerator Support: Backend.AI now supports a wider range of next-generation AI accelerators, including Intel Gaudi 2, Rebellions ATOM+, and Furiosa RNGD. This expansion allows customers to choose the most suitable hardware for their workload needs, achieving optimal performance and flexibility.
• Backend.AI Model Store, Browser, and Serving Suite (GA): The Model Store, Model Browser, and Serving features—previously available in beta—are now officially released as a comprehensive MLOps suite. This one-stop solution allows users to easily discover, deploy, and manage AI models directly within Backend.AI.
• Enhanced Job Scheduling and Authentication: The new Priority Scheduler ensures critical jobs are processed more quickly and reliably. Additionally, OpenID Connect (OIDC) integration streamlines account management across multiple infrastructure services.
• Networking and Performance Improvements: Backend.AI 24.09 introduces a Cilium-based networking stack, improving network performance by roughly 30% over previous versions. The update also expands NVIDIA GPUDirect Storage support and introduces a custom Docker network plugin to ensure stable performance even in large-scale data processing environments.
• Enterprise Integration and Scalability: Integrations with GitLab, GitHub Enterprise, and AWS ECR are now more robust, simplifying hybrid on-premises and cloud deployments. Enterprises can now manage complex environments with greater ease and flexibility.
• Quality and Stability Enhancements: Over 100 bugs have been resolved across session management, container lifecycle, and storage operations, resulting in a more reliable and stable platform for all users.

Preparing for the Next Release

• WebUI Neo Preview: In close collaboration with Vice Versa Design Studio, our frontend team is developing WebUI Neo, arriving later in 2024. The new interface is designed around two core principles: reducing cognitive load and maintaining consistent visual metaphors.

For example, instead of overwhelming users with dozens of options when configuring large-scale experiments, WebUI Neo introduces a guided, step-by-step flow that reveals only the necessary information at each stage for a smoother, more intuitive experience.

Backend.AI will continue to make your AI research and development more convenient and secure.

Make your AI accessible with Backend.AI!

The full release notes for Backend.AI 24.09 can be found on the Release History page.

Person in charge of this document: Jinho Heo, Jeongkyu Shin, Hyeonjin Kim