Tag : backend.ai
Slipstream: How to Win the AI Race - Jeongkyu Shin (Keynote 1)
By Jeongkyu ShinWith the proliferation of generative AI, prohibitive development and adoption costs are becoming a major barrier to AI democratization. How can we lower the cost threshold and increase efficiency and ease of use when using or developing deep learning-based solutions? We introduce Slipstreaming, an approach from Rableup and Backend.AI to achieve massive performance and efficiency while standing on the shoulders of giants and masking all complexity.
About the presenter
- CEO, Lablup
- ML/DL Google Developers Expert
- Ph.D in Statistical Physics (complex systems / neuroscience) at POSTECH
29 November 2023
Screaming AI from somewhere between hardware and software - Joongi Kim (Keynote 2)
By Joongi KimA look back at the design philosophy and evolution of Backend.AI from an idea to provide a reproducible computational environment for researchers to an AI development and services platform for large enterprises. We explore why we made different choices than other similar products in the industry, and how those choices have delivered value to Lablup's business and customers.
About the Presenter
- Ph.D., Computer Science, KAIST (High Performance Network Systems)
- Open source ecosystem contributor including Python (CPython, aiomonitor, aiohttp, aiodocker, pyzmq, DPDK, iPuTTY, etc.)
29 November 2023
[Track1_1] Backend.AI Enterprise Customer Support ABC - Jonghyun Park (Lablup)
By Jonghyun ParkBackend.AI's enterprise support services mean an ongoing partnership with you, not just a product installation. From scheduling the installation, we work closely with your sales and devops teams to provide customized installation and service optimization. After the installation is complete, we provide ongoing support that is responsive to customer feedback and needs, starting with user guide sessions. This presentation will provide an introduction to how we interact with Backend.AI enterprise customers.
About the presenter
- Director of Research, Lablup
- Ph.D., Department of Forensic Physics (Single Molecule Biophysics)
29 November 2023
[Track1-2] Changing UI/UX Design: Problem Recognition and New Directions - Sujin Kim (Lablup)
By Sujin KimWe will analyze the main problems with the existing WebUI and where the user experience needs to be improved. We'll discuss why the problems need to be solved, what needs to change and how to improve them, and how the UI/UX has changed, with a particular focus on the session launcher UI/UX. Finally, we'll make some predictions about how WebUIs will change in the future.
About the presenter
- Software Engineer, Lablup
29 November 2023
[Track1-3] GenAI on Backend.AI- Kyujin Cho (Lablup)
By Kyujin ChoBackend.AI's powerful giant AI model development technology is meeting GenAI to create the ultimate AI service capability. This session will introduce how the model serving capabilities introduced in Backend.AI 23.09 have been extended to the operational side of GenAI, in terms of technology, convenience, and fate resource savings. This will be a session that will inspire you with the many innovations that can be created by combining efficient operation of GPU resources with automation of GenAI services and fine-tuning.
About the presenter
-Software Engineer, Lablup
29 November 2023
[Track1-4_1] How developers collaborate with octocat without a planner - Jihyun Kang (Lablup)
By Jihyun KangLablup doesn't have a planner position, but we're still releasing a lot of products and new features, including Backend.AI. We'll talk about the many trials and errors that led us to use GitHub, a platform that developers are familiar with. In particular, we'll talk about how we ended up using GitHub Projects, how most of our development infrastructure is open source, when we tried to adopt Jira and why we stopped, and the underlying issues of scaling the company. We'll also talk about how we use the most important GitHub Projects, their shortcomings, and how we're using GitHub Actions and Labels to solve them.
About the presenter
- Software Engineer, Lablup
29 November 2023
[Track1-4_2]How developers collaborate with octocat without planners - Sion Kang (Lablup)
By Sion KangLablup doesn't have a planner position, but we're still releasing a lot of products and new features, including Backend.AI. We'll talk about the many trials and errors that led us to use GitHub, a platform that developers are familiar with. We'll cover how we came to use GitHub Projects, how most of our development infrastructure is open source, when we tried to adopt Jira and why we stopped, and the scaling issues of our company. We'll also talk about how we use the most important GitHub Projects, their shortcomings, and how we use GitHub Actions and Labels to solve them.
About the presenter
- Software Engineer, Lablup
- GitHub Campus Expert29 November 2023
[Track2-6] Support for high-speed NFS storage integration - Sang Hun Lee (Lablup)
By Sang Hun LeeHigh-speed storage is often used to train AI with large amounts of data or to quickly deploy AI models. Backend.AI supports a lot of high-speed storage, and I'd like to share how I worked on integrating vast data storage.
About the presenter
- Software Engineer, Lablup
29 November 2023
[Track2-7] Backend.AI and AI Semiconductors - Sanghyeon Seo (Lablup)
By Sanghyeon SeoWe'll look at the accelerator plugin structure of Backend.AI, the accelerator plugins developed to date (Mock, CUDA, CUDA Enterprise, ROCm, TPU, IPU, ATOM, Warboy), additional accelerator plugins currently in development (SAPEON, HyperAccel), and discuss what needs to be done on the AI semiconductor side.
About the presenters
- Software Engineer, Lablup
29 November 2023
Sokovan Container Orchestrator for Accelerated AI:ML Workloads and Massive scale GPU Computing
By Jeongkyu Shin, Joongi KimSokovan is a Python-based container orchestrator that addresses the challenges of running resource-intensive batch workloads in a containerized environment. It offers acceleration-aware, multi-tenant, batch-oriented job scheduling and fully integrates multiple hardware acceleration technologies into various system layers. It consists of two layers of schedulers. The cluster-level scheduler allows users to customize job placement strategies and control the density and priority of workloads. The node-level scheduler optimizes per-container performance by automatically detecting and mapping underlying hardware accelerators to individual containers, improving the performance of AI workloads compared to Slurm and other existing tools. Sokovan has been deployed on a large scale in various industries for a range of GPU workloads, including AI training and services. It helps container-based MLOps platforms unleash the potential of the latest hardware technologies.
Speakers:
Jeongkyu Shin
Joongi Kim30 June 2023
Beyond AI
By Jeongkyu ShinBeyond AI - Jeongkyu Shin
Context
- We will share with many people the perspectives of developers, researchers, and platform company representatives about the changes in the deep learning field over the past two years and the changes that will occur over the next two years.
Speaker
- CEO, Lablup
- ML/DL Google Developers Expert
- POSTECH Doctor of Physics (Complex Systems Physics/Computational Brain Science)
1 December 2022
Backend.AI Tutorial_03
By LablupBackend.AI for Beginners: Getting Started with Backend.AI_03
○ Tour the Backend.AI cloud
- Import & Run page
Import notebook panel
Create notebook launch button panel
Import GitHub repository contents panel
- Data & Folders page
Explore folder controls
- Create a folder
- Viewing folder information
- Utilizing folders
- Sharing a folder
- Renaming a folder
- Deleting a folder
Auto-Mount Folders tab
- Creating an AutoMount Folder
- Creating a session without mounting folders and viewing automount folders
- Statistics page
Daily usage statistics
Weekly usage statistics✉️ : contact@lablup.com
8 May 2021
Backend.AI Tutorial_04
By LablupBackend.AI_04 for beginners to get started
Check the Backend.AI version
Changing user information
Touching user settings
- General
Desktop notifications
Concise sidebar default usage options
Language settings
SSH key pair management (see link below)
Option to check automatic updates
Enable/disable automatic logout
Set shell script preferences
- Logs
＊ View logs
Refresh logs
Delete logs
FAQ & Troubleshooting
- Running Jupyter notebook in a session ends with a kernel error.
- I forgot my password.
- I can't log in even though I entered the password correctly.
- Other things to note✉️ : contact@lablup.com
3 May 2021
Backend.AI Tutorial_02
By LablupBackend.AI for Beginners: Getting Started with Backend.AI_02
○ Tour the Backend.AI cloud
-Summary page
Start panel
Resource Live View
System resources
Announcements
Invitations folder
-Session (Session) page
Session Status
Running sessions
- App Launcher
- Web Terminal
Ended sessions
- In-session
- Usage time✉️ : contact@lablup.com
18 March 2021
Backend.AI Tutorial_01
By LablupBackend.AI Tutorial_01
-What is Backend.AI?
-Signing up for the Backend.AI cloud
-Logging in to the Backend.AI cloudIf you have any questions or problems signing up, please send it to the email address below, including your email name and email account when signing up, and we will reply after checking.
✉️ : contact@lablup.com11 March 2021
