English
Related papers

Related papers: Hierarchical Memory Orchestration for Personalized…

200 papers

Memory systems are fundamental to AI agents, yet existing work often lacks adaptability to diverse tasks and overlooks the constructive and task-oriented role of AI agent memory. Drawing from Piaget's theory of cognitive development, we…

Artificial Intelligence · Computer Science 2025-10-21 Shian Jia , Ziyang Huang , Xinbo Wang , Haofei Zhang , Mingli Song

AI agents increasingly operate over extended time horizons, yet their ability to retain, organize, and recall multimodal experiences remains a critical bottleneck. Building effective lifelong memory requires navigating a vast design space…

Artificial Intelligence · Computer Science 2026-04-03 Jiaqi Liu , Zipeng Ling , Shi Qiu , Yanqing Liu , Siwei Han , Peng Xia , Haoqin Tu , Zeyu Zheng , Cihang Xie , Charles Fleming , Mingyu Ding , Huaxiu Yao

Planning has been a cornerstone of artificial intelligence for solving complex problems, and recent progress in LLM-based multi-agent frameworks have begun to extend this capability. However, the role of human-like memory within these…

Multiagent Systems · Computer Science 2025-12-09 Wenzhe Fan , Ning Yan , Masood Mortazavi

Memory-augmented LLM agents maintain external memory banks to support long-horizon interaction, yet most existing systems treat construction, retrieval, and utilization as isolated subroutines. This creates two coupled challenges: strategic…

Artificial Intelligence · Computer Science 2026-03-20 Minhua Lin , Zhiwei Zhang , Hanqing Lu , Hui Liu , Xianfeng Tang , Qi He , Xiang Zhang , Suhang Wang

Large Language Models face significant challenges in maintaining coherent interactions over extended dialogues due to their limited contextual memory. This limitation often leads to fragmented exchanges and reduced relevance in responses,…

Machine Learning · Computer Science 2025-06-24 Haseeb Ullah Khan Shinwari , Muhammad Usama

External memory is a key component of modern large language model (LLM) systems, enabling long-term interaction and personalization. Despite its importance, memory management is still largely driven by hand-designed heuristics, offering…

Computation and Language · Computer Science 2025-12-29 Changzhi Sun , Xiangyu Chen , Jixiang Luo , Dell Zhang , Xuelong Li

Large Language Models (LLMs) falter in multi-step interactions -- often hallucinating, repeating actions, or misinterpreting user corrections -- due to reliance on linear, unstructured context. This fragility stems from the lack of…

Artificial Intelligence · Computer Science 2025-05-27 Ye Ye

To support long-term interaction in complex environments, LLM agents require memory systems that manage historical experiences. Existing approaches either retain full interaction histories via passive context extension, leading to…

Artificial Intelligence · Computer Science 2026-01-30 Jiaqi Liu , Yaofeng Su , Peng Xia , Siwei Han , Zeyu Zheng , Cihang Xie , Mingyu Ding , Huaxiu Yao

Large Language Models (LLMs) as autonomous agents are increasingly tasked with solving complex, long-horizon problems. Aligning these agents via preference-based offline methods like Direct Preference Optimization (DPO) is a promising…

Machine Learning · Computer Science 2026-03-03 Heyang Gao , Zexu Sun , Erxue Min , Hengyi Cai , Shuaiqiang Wang , Dawei Yin , Xu Chen

The rapid adoption of large language models (LLMs) is pushing AI accelerators toward increasingly powerful and specialized designs. Instead of further complicating software development with deeply hierarchical scratchpad memories (SPMs) and…

Hardware Architecture · Computer Science 2025-12-09 Zhongchun Zhou , Chengtao Lai , Yuhang Gu , Wei Zhang

To enable embodied agents to operate effectively over extended timeframes, it is crucial to develop models that form and access memories to stay contextualized in their environment. In the current paradigm of training transformer-based…

Artificial Intelligence · Computer Science 2025-12-01 Gunshi Gupta , Karmesh Yadav , Zsolt Kira , Yarin Gal , Rahaf Aljundi

Many prediction tasks of real-world applications need to model multi-order feature interactions in user's event sequence for better detection performance. However, existing popular solutions usually suffer two key issues: 1) only focusing…

Machine Learning · Computer Science 2022-01-03 Dongbo Xi , Fuzhen Zhuang , Bowen Song , Yongchun Zhu , Shuai Chen , Dan Hong , Tao Chen , Xi Gu , Qing He

The rise of multi-agent systems powered by large language models (LLMs) and specialized reasoning agents exposes fundamental limitations in today's data management architectures. Traditional databases and data fabrics were designed for…

Multiagent Systems · Computer Science 2025-12-11 Ioana Giurgiu , Michael E. Nidd

Large language models (LLMs) are increasingly deployed as intelligent agents that reason, plan, and interact with their environments. To effectively scale to long-horizon scenarios, a key capability for such agents is a memory mechanism…

Artificial Intelligence · Computer Science 2026-01-09 Yuyang Hu , Jiongnan Liu , Jiejun Tan , Yutao Zhu , Zhicheng Dou

Large Language Models (LLMs) are increasingly deployed as automated tutors to address educator shortages; however, they often fail at pedagogical reasoning, frequently validating incorrect student solutions (sycophancy) or providing overly…

Multiagent Systems · Computer Science 2025-12-30 Saisab Sadhu , Ashim Dhor

The advancement of artificial intelligence toward agentic science is currently bottlenecked by the challenge of ultra-long-horizon autonomy, the ability to sustain strategic coherence and iterative correction over experimental cycles…

Artificial Intelligence · Computer Science 2026-03-26 Xinyu Zhu , Yuzhu Cai , Zexi Liu , Bingyang Zheng , Cheng Wang , Rui Ye , Yuzhi Zhang , Linfeng Zhang , Weinan E , Siheng Chen , Yanfeng Wang

Understanding visual scenes requires not only recognizing objects but also reasoning about their spatial relationships. Unlike general vision-language tasks, spatial reasoning requires integrating multiple inductive biases, such as 2D…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Chan Yeong Hwang , Miso Choi , Sunghyun On , Jinkyu Kim , Jungbeom Lee

Procedural memory enables large language model (LLM) agents to internalize "how-to" knowledge, theoretically reducing redundant trial-and-error. However, existing frameworks predominantly suffer from a "passive accumulation" paradigm,…

Artificial Intelligence · Computer Science 2026-04-16 Zouying Cao , Jiaji Deng , Li Yu , Weikang Zhou , Zhaoyang Liu , Bolin Ding , Hai Zhao

Retrieval-Augmented Generation (RAG) has revolutionized natural language processing by dynamically integrating external knowledge into Large Language Models (LLMs), addressing their limitation of static training datasets. Recent…

Computation and Language · Computer Science 2024-09-05 Krish Goel , Mahek Chandak

This paper introduces MANGO (Multilayer Abstraction for Nested Generation of Options), a novel hierarchical reinforcement learning framework designed to address the challenges of long-term sparse reward environments. MANGO decomposes…

Machine Learning · Computer Science 2025-08-26 Alessio Arcudi , Davide Sartor , Alberto Sinigaglia , Vincent François-Lavet , Gian Antonio Susto