English

MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Models

Computation and Language 2025-05-29 v1

Abstract

Large Language Models (LLMs) have emerged as foundational infrastructure in the pursuit of Artificial General Intelligence (AGI). Despite their remarkable capabilities in language perception and generation, current LLMs fundamentally lack a unified and structured architecture for handling memory. They primarily rely on parametric memory (knowledge encoded in model weights) and ephemeral activation memory (context-limited runtime states). While emerging methods like Retrieval-Augmented Generation (RAG) incorporate plaintext memory, they lack lifecycle management and multi-modal integration, limiting their capacity for long-term knowledge evolution. To address this, we introduce MemOS, a memory operating system designed for LLMs that, for the first time, elevates memory to a first-class operational resource. It builds unified mechanisms for representation, organization, and governance across three core memory types: parametric, activation, and plaintext. At its core is the MemCube, a standardized memory abstraction that enables tracking, fusion, and migration of heterogeneous memory, while offering structured, traceable access across tasks and contexts. MemOS establishes a memory-centric execution framework with strong controllability, adaptability, and evolvability. It fills a critical gap in current LLM infrastructure and lays the groundwork for continual adaptation, personalized intelligence, and cross-platform coordination in next-generation intelligent systems.

Keywords

Cite

@article{arxiv.2505.22101,
  title  = {MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Models},
  author = {Zhiyu Li and Shichao Song and Hanyu Wang and Simin Niu and Ding Chen and Jiawei Yang and Chenyang Xi and Huayi Lai and Jihao Zhao and Yezhaohui Wang and Junpeng Ren and Zehao Lin and Jiahao Huo and Tianyi Chen and Kai Chen and Kehang Li and Zhiqiang Yin and Qingchen Yu and Bo Tang and Hongkang Yang and Zhi-Qin John Xu and Feiyu Xiong},
  journal= {arXiv preprint arXiv:2505.22101},
  year   = {2025}
}
R2 v1 2026-07-01T02:45:39.449Z