English
Related papers

Related papers: Evaluating Memory in LLM Agents via Incremental Mu…

200 papers

Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of NLP tasks, but they remain fundamentally stateless, constrained by limited context windows that hinder long-horizon reasoning. Recent efforts to…

Memory is a central capability for LLM agents operating across long-horizon tasks. Existing memory benchmarks predominantly evaluate retention of personalized information in multi-turn chat scenarios, overlooking the dynamic memory…

Computation and Language · Computer Science 2026-05-21 Wujiang Xu , Yu Wang , Kai Mei , Kaiqu Liang , Zhenting Wang , Mingyu Jin , Han Zhang , Shi-Xiong Zhang , Wenyue Hua , Sambit Sahu , Dimitris N. Metaxas

Due to the powerful capabilities demonstrated by large language model (LLM), there has been a recent surge in efforts to integrate them with AI agents to enhance their performance. In this paper, we have explored the core differences and…

Computation and Language · Computer Science 2023-09-27 Pengyu Zhao , Zijian Jin , Ning Cheng

Large Language Models (LLMs) represent a landmark achievement in Artificial Intelligence (AI), demonstrating unprecedented proficiency in procedural tasks such as text generation, code completion, and conversational coherence. These…

Artificial Intelligence · Computer Science 2025-05-07 Schaun Wheeler , Olivier Jeunen

Scaling up data, parameters, and test-time computation has been the mainstream methods to improve LLM systems (LLMsys), but their upper bounds are almost reached due to the gradual depletion of high-quality data and marginal gains obtained…

Machine Learning · Computer Science 2026-05-12 Qingyao Ai , Yichen Tang , Changyue Wang , Jianming Long , Weihang Su , Yiqun Liu

Agentic memory systems enable large language model (LLM) agents to maintain state across long interactions, supporting long-horizon reasoning and personalization beyond fixed context windows. Despite rapid architectural development, the…

Computation and Language · Computer Science 2026-05-21 Dongming Jiang , Yi Li , Songtao Wei , Jinxin Yang , Ayushi Kishore , Alysa Zhao , Dingyi Kang , Xu Hu , Feng Chen , Qiannan Li , Bingzhe Li

Large language model (LLM) agents face fundamental limitations in long-horizon reasoning due to finite context windows, making effective memory management critical. Existing methods typically handle long-term memory (LTM) and short-term…

Computation and Language · Computer Science 2026-05-01 Yi Yu , Liuyi Yao , Yuexiang Xie , Qingquan Tan , Jiaqi Feng , Yaliang Li , Libing Wu

Large language model (LLM)-powered multi-agent systems (MAS) demonstrate remarkable collective intelligence, wherein multi-agent memory serves as a pivotal mechanism for continual adaptation. However, existing multi-agent memory designs…

Computation and Language · Computer Science 2026-03-10 Muxin Fu , Xiangyuan Xue , Yafu Li , Zefeng He , Siyuan Huang , Xiaoye Qu , Yu Cheng , Yang Yang

Effective decision-making in the real world depends on memory that is both stable and adaptive: environments change over time, and agents must retain relevant information over long horizons while also updating or overwriting outdated…

Machine Learning · Computer Science 2026-01-22 Oleg Shchendrigin , Egor Cherepanov , Alexey K. Kovalev , Aleksandr I. Panov

Large Language Models (LLMs) based agents excel at diverse tasks, yet they suffer from brittle procedural memory that is manually engineered or entangled in static parameters. In this work, we investigate strategies to endow agents with a…

Computation and Language · Computer Science 2026-04-16 Runnan Fang , Yuan Liang , Xiaobin Wang , Jialong Wu , Shuofei Qiao , Pengjun Xie , Fei Huang , Huajun Chen , Ningyu Zhang

Large Language Models (LLMs) have shown remarkable capabilities as autonomous agents, yet existing benchmarks either focus on single-agent tasks or are confined to narrow domains, failing to capture the dynamics of multi-agent coordination…

Multiagent Systems · Computer Science 2025-03-05 Kunlun Zhu , Hongyi Du , Zhaochen Hong , Xiaocheng Yang , Shuyi Guo , Zhe Wang , Zhenhailong Wang , Cheng Qian , Xiangru Tang , Heng Ji , Jiaxuan You

Long-term memory is crucial for agents in specialized web environments, where success depends on recalling interface affordances, state dynamics, workflows, and recurring failure modes. However, existing memory benchmarks for agents mostly…

Computation and Language · Computer Science 2026-05-13 Di Wu , Zixiang Ji , Asmi Kawatkar , Bryan Kwan , Jia-Chen Gu , Nanyun Peng , Kai-Wei Chang

Existing evaluations of agents with memory typically assess memorization and action in isolation. One class of benchmarks evaluates memorization by testing recall of past conversations or text but fails to capture how memory is used to…

Computation and Language · Computer Science 2026-02-19 Zexue He , Yu Wang , Churan Zhi , Yuanzhe Hu , Tzu-Ping Chen , Lang Yin , Ze Chen , Tong Arthur Wu , Siru Ouyang , Zihan Wang , Jiaxin Pei , Julian McAuley , Yejin Choi , Alex Pentland

Despite recent advances in understanding and leveraging long-range conversational memory, existing benchmarks still lack systematic evaluation of large language models(LLMs) across diverse memory dimensions, particularly in multi-session…

Computation and Language · Computer Science 2026-01-08 Ye Shen , Dun Pei , Yiqiu Guo , Junying Wang , Yijin Guo , Zicheng Zhang , Qi Jia , Jun Zhou , Guangtao Zhai

Large language model (LLM) multi-agent systems can scale along two distinct dimensions: by increasing the number of agents and by improving through accumulated experience over time. Although prior work has studied these dimensions…

Multiagent Systems · Computer Science 2026-04-07 Shanglin Wu , Yuyang Luo , Yueqing Liang , Kaiwen Shi , Yanfang Ye , Ali Payani , Kai Shu

From pre-trained language model (PLM) to large language model (LLM), the field of natural language processing (NLP) has witnessed steep performance gains and wide practical uses. The evaluation of a research field guides its direction of…

Computation and Language · Computer Science 2023-08-16 Ziyu Zhuang , Qiguang Chen , Longxuan Ma , Mingda Li , Yi Han , Yushan Qian , Haopeng Bai , Zixian Feng , Weinan Zhang , Ting Liu

Lifelong learning, also known as continual or incremental learning, is a crucial component for advancing Artificial General Intelligence (AGI) by enabling systems to continuously adapt in dynamic environments. While large language models…

Artificial Intelligence · Computer Science 2026-01-13 Junhao Zheng , Chengming Shi , Xidi Cai , Qiuke Li , Duzhen Zhang , Chenxing Li , Dong Yu , Qianli Ma

With the growing demand for intelligent in-vehicle experiences, vehicle-based agents are evolving from simple assistants to long-term companions. This evolution requires agents to continuously model multi-user preferences and make reliable…

Artificial Intelligence · Computer Science 2026-03-26 Yuhao Chen , Yi Xu , Xinyun Ding , Xiang Fang , Shuochen Liu , Luxi Lin , Qingyu Zhang , Ya Li , Quan Liu , Tong Xu

Inspired by the insights in cognitive science with respect to human memory and reasoning mechanism, a novel evolvable LLM-based (Large Language Model) agent framework is proposed as REMEMBERER. By equipping the LLM with a long-term…

Computation and Language · Computer Science 2023-10-31 Danyang Zhang , Lu Chen , Situo Zhang , Hongshen Xu , Zihan Zhao , Kai Yu

Large language model (LLM) agents are constrained by limited context windows, necessitating external memory systems for long-term information understanding. Current memory-augmented agents typically depend on pre-defined instructions and…

Computation and Language · Computer Science 2025-10-01 Yu Wang , Ryuichi Takanobu , Zhiqi Liang , Yuzhen Mao , Yuanzhe Hu , Julian McAuley , Xiaojian Wu