Welcome

AIOS is the AI Agent Operating System, which embeds large language model (LLM) into the operating system and facilitates the development and deployment of LLM-based AI Agents. AIOS is designed to address problems (e.g., scheduling, context switch, memory management, storage management, tool management, Agent SDK management, etc.) during the development and deployment of LLM-based agents, towards a better AIOS-Agent ecosystem for agent developers and agent users. AIOS includes the AIOS Kernel and the AIOS SDK (Cerebrum). AIOS supports both Web UI and Terminal UI.

AIOS provides the AIOS kernel as an abstraction on top of the OS kernel. The kernel provides the core functions driven by AIOS system calls, to serve LLM-based agents. On top of the kernel layer, the AIOS SDK facilitates the development and deployment of agents.

AIOS Deployment Architecture

Two different modes of AIOS

The AIOS system supports two primary deployment configurations for the interaction between the AIOS Kernel and Agent applications.

Local Mode

• The AIOS Kernel and agent applications reside on the same device (Device 1)

• The AIOS SDK facilitates direct communication between the application and kernel

Remote Mode

• The AIOS Kernel and Agent Application are located in separate devices

• The agent applications are on Device 1

• The AIOS kernel is on Device 2

• AIOS SDK is located on both the device 1 and device 2.

In both configurations, the AIOS SDK serves as the standardized interface layer, abstracting the communication details between the Agent Application and the AIOS Kernel, regardless of their physical location. This flexibility in deployment options allows AIOS to adapt to various use cases and system requirements while maintaining a consistent development experience through the SDK.