Tag : Backend.AI
Posts tagged with 'Backend.AI'
How Nota AI Efficiently Optimized and Compressed Solar Open 2 with Backend.AI FastTrack 3
By LablupWithin the Sovereign AI Foundation Model Project, Nota optimized large-scale LLMs to run on fewer GPUs through model compression, while using Backend.AI and FastTrack to streamline experimentation and resource management.31 July 2026
Lablup - FuriosaAI RNGD Whitepaper Released
By LablupLablup and FuriosaAI have published "RNGD meets Backend.AI," a whitepaper documenting the performance and operational efficiency of the RNGD and Backend.AI combination under real LLM workloads.29 July 2026
Let researchers focus on research with Backend.AI
By LablupML research scientist Eunseong Choi explains how using Backend.AI on Sungkyunkwan University’s on‑premise supercomputing center reduced the overhead of managing GPU infrastructure and gave his lab a consistent multi‑GPU environment to focus on research.25 June 2026
Backend.AI on DGX Spark: Open source installation guide
By Kyujin Cho and 3 othersWe provide a step-by-step tutorial on how to install the open-source version of Backend.AI on NVIDIA DGX Spark and easily launch a model.22 June 2026
The era of diverse AI accelerators: Backend.AI's heterogeneous GPU operation strategy
By Jinho HeoThe AI accelerator market is diversifying across NVIDIA, AMD, Intel, and domestic NPUs, enabling heterogeneous GPU operations. Backend.AI solves software stack and performance challenges by separating resources into groups and applying workload-specific policies to maximize each accelerator's strengths.19 June 2026
Agent coding at long context: What KV cache offloading on VAST Data & Backend.AI buys you
By Jinho Heo and 2 othersA joint benchmark by Lablup and VAST Data shows that KV cache offloading improves TTFT by up to 3.3x and reduces overall latency by more than half in agent-based coding workloads.16 June 2026
Lablup adds Intel Arc Pro B70 support to Backend.AI
By LablupBackend.AI now officially supports the Intel Arc Pro B70 workstation GPU, expanding its hardware coverage beyond Intel Gaudi 2 and 3 AI accelerators to include the Arc graphics lineup. This enables unified management of Intel AI hardware across environments, from data center Gaudi to workstation-class Arc Pro, within a single platform. Backend.AI supports diverse GPUs and accelerators with an intuitive interface and session-based resource management, simplifying AI model development, training, and deployment. With 32GB memory and high throughput, Arc Pro B70 is optimized for agentic AI workloads, improving concurrency and KV cache efficiency.12 June 2026
Intel Arc meets Backend.AI: What the Arc Pro B70's 32GB memory buys for agentic AI
By Jinho Heo and 2 othersBackend.AI now officially supports Intel Arc Pro B70, expanding its Intel lineup beyond Gaudi 2/3 AI accelerators to Arc graphics. From datacenter Gaudi to workstation Arc Pro, teams can manage Intel AI hardware in one platform.12 June 2026
eBPF security audit for GPU clusters with Backend.AI
By Kyujin Cho, Jinho HeoThis blog introduces eBPF, a method for implementing security audits while maintaining the performance of GPU training clusters. It covers the principles of eBPF, which directly processes events within the kernel, audit application cases, and security precautions.27 May 2026
Behind Lablup x Upstage's Phase 1 Win for the Sovereign AI Foundation Model Project
By LablupThe Upstage consortium, with Lablup as infrastructure partner, passed Phase 1 of Korea's Sovereign AI Foundation Model program. Team members share the behind-the-scenes story.6 February 2026
Meet Lablup at CES 26
By LablupLablup returns to CES 2026 for a fourth year. Here's what to find at the booth, including Backend.AI:GO, which runs LLMs on a personal computer without the cloud.6 January 2026
Lablup at SC25: Recap & Highlights
By LablupSC25 showed supercomputing and AI converging. A recap of Lablup's week with global HPC and AI leaders, and how Backend.AI handles both workloads at once.11 December 2025
