Tag : Backend.AI
Posts tagged with 'Backend.AI'

Let researchers focus on research with Backend.AI
By LablupML research scientist Eunseong Choi explains how using Backend.AI on Sungkyunkwan University’s on‑premise supercomputing center reduced the overhead of managing GPU infrastructure and gave his lab a consistent multi‑GPU environment to focus on research.25 June 2026

Backend.AI on DGX Spark: Open source installation guide
By Kyujin Cho and 3 othersWe provide a step-by-step tutorial on how to install the open-source version of Backend.AI on NVIDIA DGX Spark and easily launch a model.22 June 2026

The era of diverse AI accelerators: Backend.AI's heterogeneous GPU operation strategy
By Jinho HeoThe AI accelerator market is diversifying across NVIDIA, AMD, Intel, and domestic NPUs, enabling heterogeneous GPU operations. Backend.AI solves software stack and performance challenges by separating resources into groups and applying workload-specific policies to maximize each accelerator's strengths.19 June 2026

Agent coding at long context: What KV cache offloading on VAST Data & Backend.AI buys you
By Jinho Heo and 2 othersA joint benchmark by Lablup and VAST Data shows that KV cache offloading improves TTFT by up to 3.3x and reduces overall latency by more than half in agent-based coding workloads.16 June 2026

Lablup adds Intel Arc Pro B70 support to Backend.AI
By LablupBackend.AI now officially supports the Intel Arc Pro B70 workstation GPU, expanding its hardware coverage beyond Intel Gaudi 2 and 3 AI accelerators to include the Arc graphics lineup. This enables unified management of Intel AI hardware across environments, from data center Gaudi to workstation-class Arc Pro, within a single platform. Backend.AI supports diverse GPUs and accelerators with an intuitive interface and session-based resource management, simplifying AI model development, training, and deployment. With 32GB memory and high throughput, Arc Pro B70 is optimized for agentic AI workloads, improving concurrency and KV cache efficiency.12 June 2026

Intel Arc meets Backend.AI: What the Arc Pro B70's 32GB memory buys for agentic AI
By Jinho Heo and 2 othersBackend.AI now officially supports Intel Arc Pro B70, expanding its Intel lineup beyond Gaudi 2/3 AI accelerators to Arc graphics. From datacenter Gaudi to workstation Arc Pro, teams can manage Intel AI hardware in one platform.12 June 2026

eBPF security audit for GPU clusters with Backend.AI
By Kyujin Cho, Jinho HeoThis blog introduces eBPF, a method for implementing security audits while maintaining the performance of GPU training clusters. It covers the principles of eBPF, which directly processes events within the kernel, audit application cases, and security precautions.27 May 2026

Behind Lablup x Upstage's Phase 1 Win for the Sovereign AI Foundation Model Project
By LablupThe Upstage consortium, with Lablup as infrastructure partner, passed Phase 1 of Korea's Sovereign AI Foundation Model program. Team members share the behind-the-scenes story.6 February 2026

Meet Lablup at CES 26
By LablupLablup returns to CES 2026 for a fourth year. Here's what to find at the booth, including Backend.AI:GO, which runs LLMs on a personal computer without the cloud.6 January 2026

Lablup at SC25: Recap & Highlights
By LablupSC25 showed supercomputing and AI converging. A recap of Lablup's week with global HPC and AI leaders, and how Backend.AI handles both workloads at once.11 December 2025

Sokovan Orchestrator: Reliable session scheduling for Backend.AI
By HyeokJin KimHow Lablup's CoreDev team reworked the Sokovan Orchestrator so Backend.AI schedules sessions more efficiently as AI workloads change.8 December 2025

AAA: Agentic, Autonomous, Adaptive Intelligence - lab | up >/ conf/5 Keynote
By Jeongkyu ShinHighlights from the lab | up > /conf/5 keynote on Lablup's 10th anniversary: a vision to become an intelligence supplier that measures and affordably delivers intelligence, beyond Make AI Accessible and Make AI Scalable.2 December 2025