English
Related papers

Related papers: Rethinking How to Remember: Beyond Atomic Facts in…

200 papers

Large language models (LLMs) excel at many NLP tasks but struggle to sustain long-term interactions due to limited attention over extended dialogue histories. Retrieval-augmented generation (RAG) mitigates this issue but lacks reliable…

Computation and Language · Computer Science 2026-01-23 Chunliang Chen , Ming Guan , Xiao Lin , Jiaxu Li , Luxi Lin , Qiyi Wang , Xiangyu Chen , Jixiang Luo , Changzhi Sun , Dell Zhang , Xuelong Li

Long-term conversational agents require effective memory management to handle dialogue histories that exceed the context window of large language models (LLMs). Existing methods based on fact extraction or summarization reduce redundancy…

Computation and Language · Computer Science 2025-09-26 Yaxiong Wu , Yongyue Zhang , Sheng Liang , Yong Liu

To support long-term interaction in complex environments, LLM agents require memory systems that manage historical experiences. Existing approaches either retain full interaction histories via passive context extension, leading to…

Artificial Intelligence · Computer Science 2026-01-30 Jiaqi Liu , Yaofeng Su , Peng Xia , Siwei Han , Zeyu Zheng , Cihang Xie , Mingyu Ding , Huaxiu Yao

Memory management is vital for LLM agents to handle long-term interaction and personalization. Most research focuses on how to organize and use memory summary, but often overlooks the initial memory extraction stage. In this paper, we argue…

Computation and Language · Computer Science 2026-01-09 Chengyuan Yang , Zequn Sun , Wei Wei , Wei Hu

LLM-based conversational agents still struggle to maintain coherent, personalized interaction over many sessions: fixed context windows limit how much history can be kept in view, and most external memory approaches trade off between coarse…

Computation and Language · Computer Science 2025-12-12 Sizhe Zhou , Jiawei Han

Memory-augmented Large Language Models (LLMs) have demonstrated remarkable performance in long-term human-machine interactions, which basically relies on iterative recalling and reasoning of history to generate high-quality responses.…

Computation and Language · Computer Science 2023-11-16 Lei Liu , Xiaoyan Yang , Yue Shen , Binbin Hu , Zhiqiang Zhang , Jinjie Gu , Guannan Zhang

Personalized and continuous interactions are critical for LLM-based conversational agents, yet finite context windows and static parametric memory hinder the modeling of long-term, cross-session user states. Existing approaches, including…

Artificial Intelligence · Computer Science 2026-02-03 Ao Tian , Yunfeng Lu , Xinxin Fan , Changhao Wang , Lanzhi Zhou , Yeyao Zhang , Yanfang Liu

Effective memory management is essential for large language model (LLM) agents handling long-term interactions. Current memory frameworks typically treat agents as passive "recorders" and retrieve information without understanding its…

Computation and Language · Computer Science 2026-03-03 Xiaohui Zhang , Zequn Sun , Chengyuan Yang , Yaqin Jin , Yazhong Zhang , Wei Hu

Large language model (LLM) agents require long-term memory to leverage information from past interactions. However, existing memory systems often face a fidelity--efficiency trade-off: raw dialogue histories are expensive, while flat facts…

Computation and Language · Computer Science 2026-05-26 Wentao Qiu , Haotian Hu , Fanyi Wang , Jinwei Kong , Yu Zhang

Memory enables Large Language Model (LLM) agents to perceive, store, and use information from past dialogues, which is essential for personalization. However, existing methods fail to properly model the temporal dimension of memory in two…

Artificial Intelligence · Computer Science 2026-01-13 Miao Su , Yucan Guo , Zhongni Hou , Long Bai , Zixuan Li , Yufei Zhang , Guojun Yin , Wei Lin , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Long-term conversational agents need memory systems that capture relationships between events, not merely isolated facts, to support temporal reasoning and multi-hop question answering. Current approaches face a fundamental trade-off: flat…

Computation and Language · Computer Science 2026-04-24 Buqiang Xu , Yijun Chen , Jizhan Fang , Ruobin Zhong , Yunzhi Yao , Yuqi Zhu , Lun Du , Shumin Deng

Although LLM agents can leverage tools for complex tasks, they still need memory to maintain cross-turn consistency and accumulate reusable information in long-horizon interactions. However, retrieval-based external memory systems incur low…

Artificial Intelligence · Computer Science 2026-04-23 Jiaquan Zhang , Chaoning Zhang , Shuxu Chen , Zhenzhen Huang , Pengcheng Zheng , Zhicheng Wang , Ping Guo , Fan Mo , Sung-Ho Bae , Jie Zou , Jiwei Wei , Yang Yang

Memory systems often organize user-agent interactions as retrievable external memory and are crucial for long-running agents by overcoming the limited context windows of LLMs. However, existing memory systems invoke LLMs to process every…

Computation and Language · Computer Science 2026-05-18 Zijie Dai , Shiyuan Deng , Sheng Guan , Yizhou Tian , Xin Yao , Xiao Yan , James Cheng

Large language model (LLM) agents demonstrate strong performance in short-text contexts but often underperform in extended dialogues due to inefficient memory management. Existing approaches face a fundamental trade-off between efficiency…

Artificial Intelligence · Computer Science 2026-05-04 Xiaochen Zhao , Kaikai Wang , Xiaowen Zhang , Chen Yao , Aili Wang

Existing works on long-term open-domain dialogues focus on evaluating model responses within contexts spanning no more than five chat sessions. Despite advancements in long-context large language models (LLMs) and retrieval augmented…

Computation and Language · Computer Science 2024-02-28 Adyasha Maharana , Dong-Ho Lee , Sergey Tulyakov , Mohit Bansal , Francesco Barbieri , Yuwei Fang

Large language models (LLMs) have transformed AI research thanks to their powerful internal capabilities and knowledge. However, existing LLMs still fail to effectively incorporate the massive external knowledge when interacting with the…

Computation and Language · Computer Science 2026-04-15 Tao Feng , Pengrui Han , Guanyu Lin , Ge Liu , Jiaxuan You

Large language models (LLMs) excel at single-turn reasoning but often lose accuracy and coherence over extended, multi-turn interactions. Recent evaluations such as TurnBench highlight recurring failure modes-reasoning bias, task drift,…

Computation and Language · Computer Science 2025-12-17 Yiran Zhang , Jincheng Hu , Mark Dras , Usman Naseem

Evaluating the abilities of large language models (LLMs) for tasks that require long-term memory and thus long-context reasoning, for example in conversational settings, is hampered by the existing benchmarks, which often lack narrative…

Computation and Language · Computer Science 2026-02-24 Mohammad Tavakoli , Alireza Salemi , Carrie Ye , Mohamed Abdalla , Hamed Zamani , J Ross Mitchell

Large Language Models (LLMs) have made significant progress in open-ended dialogue, yet their inability to retain and retrieve relevant information from long-term interactions limits their effectiveness in applications requiring sustained…

Large Language Models (LLMs) are increasingly capable but often require significant guidance or extensive interaction history to perform effectively in complex, interactive environments. Existing methods may struggle with adapting to new…

Machine Learning · Computer Science 2025-06-12 Samuel Holt , Max Ruiz Luyten , Thomas Pouplin , Mihaela van der Schaar
‹ Prev 1 2 3 10 Next ›