English
Related papers

Related papers: Hierarchical Memory Orchestration for Personalized…

200 papers

As Large Language Models (LLMs) are increasingly deployed as autonomous agents, they face a critical scalability bottleneck known as the "Generalization-Specialization Dilemma." Monolithic agents equipped with extensive toolkits suffer from…

Multiagent Systems · Computer Science 2026-01-16 Sathish Sampath , Anuradha Baskaran

Large language model (LLM)-based agents have shown strong potential in multi-task scenarios, owing to their ability to transfer knowledge across diverse tasks. However, existing approaches often treat prior experiences and knowledge as…

Artificial Intelligence · Computer Science 2025-09-17 Shicheng Ye , Chao Yu , Kaiqiang Ke , Chengdong Xu , Yinqi Wei

Large Language Models (LLMs) have demonstrated remarkable prowess in generating contextually coherent responses, yet their fixed context windows pose fundamental challenges for maintaining consistency over prolonged multi-session dialogues.…

Computation and Language · Computer Science 2025-04-29 Prateek Chhikara , Dev Khant , Saket Aryan , Taranjeet Singh , Deshraj Yadav

The emerging hybrid DRAM-NVM architecture is challenging the existing memory management mechanism in operating system. In this paper, we introduce memos, which can schedule memory resources over the entire memory hierarchy including cache,…

Operating Systems · Computer Science 2017-03-23 Lei Liu , Mengyao Xie , Hao Yang

To sustain coherent long-term interactions, Large Language Model (LLM) agents must navigate the tension between acquiring new information and retaining prior knowledge. Current unified stream-based memory systems facilitate context updates…

Artificial Intelligence · Computer Science 2026-04-15 Zhaofen Wu , Hanrong Zhang , Fulin Lin , Wujiang Xu , Xinran Xu , Yankai Chen , Henry Peng Zou , Shaowen Chen , Weizhi Zhang , Xue Liu , Philip S. Yu , Hongwei Wang

Continual reinforcement learning poses a major challenge due to the tendency of agents to experience catastrophic forgetting when learning sequential tasks. In this paper, we introduce a modularity-based approach, called Hierarchical…

Machine Learning · Computer Science 2024-11-06 Thomas P Cannon , Özgür Simsek

Building agents that can explore their environments intelligently is a challenging open problem. In this paper, we make a step towards understanding how a hierarchical design of the agent's policy can affect its exploration capabilities.…

Machine Learning · Computer Science 2018-11-19 Maruan Al-Shedivat , Lisa Lee , Ruslan Salakhutdinov , Eric Xing

Large language model (LLM) agents have recently demonstrated strong capabilities in interactive decision-making, yet they remain fundamentally limited in long-horizon tasks that require structured planning and reliable execution. Existing…

Artificial Intelligence · Computer Science 2026-05-06 Hongbo Jin , Rongpeng Zhu , Jiayu Ding , Guibo Luo , Ge Li

Large Language Models have recently emerged as a promising paradigm for automated heuristic design for NP-hard combinatorial optimization problems. Despite this progress, existing LLM-based methods typically rely on monolithic workflows…

Artificial Intelligence · Computer Science 2026-05-11 Yuping Yan , Jirui Han , Fei Ming , Yuanshuai Li , Yaochu Jin

We consider a Continual Reinforcement Learning setup, where a learning agent must continuously adapt to new tasks while retaining previously acquired skill sets, with a focus on the challenge of avoiding forgetting past gathered knowledge…

Machine Learning · Computer Science 2026-02-06 Anthony Kobanda , Rémy Portelas , Odalric-Ambrym Maillard , Ludovic Denoyer

The transition from stateless language model inference to persistent, multi session autonomous agents has revealed memory to be a primary architectural bottleneck in the deployment of production grade agentic systems. Existing methodologies…

Artificial Intelligence · Computer Science 2026-04-27 Seyed Moein Abtahi , Rasa Rahnema , Hetkumar Patel , Neel Patel , Majid Fekri , Tara Khani

Large Language Models (LLMs) based agents excel at diverse tasks, yet they suffer from brittle procedural memory that is manually engineered or entangled in static parameters. In this work, we investigate strategies to endow agents with a…

Computation and Language · Computer Science 2026-04-16 Runnan Fang , Yuan Liang , Xiaobin Wang , Jialong Wu , Shuofei Qiao , Pengjun Xie , Fei Huang , Huajun Chen , Ningyu Zhang

Agentic memory is emerging as a key enabler for large language models (LLM) to maintain continuity, personalization, and long-term context in extended user interactions, critical capabilities for deploying LLMs as truly interactive and…

Artificial Intelligence · Computer Science 2025-12-16 Samarth Sarin , Lovepreet Singh , Bhaskarjit Sarmah , Dhagash Mehta

Memory systems address the challenge of context loss in Large Language Model during prolonged interactions. However, compared to human cognition, the efficacy of these systems in processing emotion-related information remains inconclusive.…

Computation and Language · Computer Science 2026-03-02 Peng Liu , Zhen Tao , Jihao Zhao , Ding Chen , Yansong Zhang , Cuiping Li , Zhiyu Li , Hong Chen

Memory is fundamental to social interaction, enabling humans to recall meaningful past experiences and adapt their behavior accordingly based on the context. However, most current social robots and embodied agents rely on non-selective,…

Artificial Intelligence · Computer Science 2026-04-15 Hangyeol Kang , Slava Voloshynovskiy , Nadia Magnenat Thalmann

Transformer-based large language models (LLM) have been widely used in language processing applications. However, due to the memory constraints of the devices, most of them restrict the context window. Even though recurrent models in…

Computation and Language · Computer Science 2025-02-07 Zifan He , Yingqi Cao , Zongyue Qin , Neha Prakriya , Yizhou Sun , Jason Cong

Memory is a fundamental component for enabling long-context LLM agents, supporting persistent state across interactions through a continuous serve-and-update lifecycle. Despite substantial prior work, existing systems suffer from…

Databases · Computer Science 2026-05-26 Han Chen , Zining Zhang , Wenqi Pei , Bingsheng He , Ming Wu , Jason Zeng , Michael Heinrich , Wei Wu , Hongbao Zhang

Memory serves as the pivotal nexus bridging past and future, providing both humans and AI systems with invaluable concepts and experience to navigate complex tasks. Recent research on autonomous agents has increasingly focused on designing…

Computation and Language · Computer Science 2025-12-30 Jiafeng Liang , Hao Li , Chang Li , Jiaqi Zhou , Shixin Jiang , Zekun Wang , Changkai Ji , Zhihao Zhu , Runxuan Liu , Tao Ren , Jinlan Fu , See-Kiong Ng , Xia Liang , Ming Liu , Bing Qin

Multi-agent systems (MAS) are increasingly tasked with solving complex, knowledge-intensive problems where effective agent orchestration is critical. Conventional orchestration methods rely on static agent descriptions, which often become…

Multiagent Systems · Computer Science 2025-09-25 Danilo Trombino , Vincenzo Pecorella , Alessandro de Giulii , Davide Tresoldi

Large language models (LLMs) power many interactive systems such as chatbots, customer-service agents, and personal assistants. In knowledge-intensive scenarios requiring user-specific personalization, conventional retrieval-augmented…

Artificial Intelligence · Computer Science 2026-01-13 Hailong Li , Feifei Li , Wenhui Que , Xingyu Fan