English
Related papers

Related papers: MemoryBank: Enhancing Large Language Models with L…

200 papers

This paper addresses the limitations of large language models in understanding long-term context. It proposes a model architecture equipped with a long-term memory mechanism to improve the retention and retrieval of semantic information…

Computation and Language · Computer Science 2025-05-30 Yue Xing , Tao Yang , Yijiashun Qi , Minggu Wei , Yu Cheng , Honghui Xin

Recent works have highlighted the significance of memory mechanisms in LLM-based agents, which enable them to store observed information and adapt to dynamic environments. However, evaluating their memory capabilities still remains…

Computation and Language · Computer Science 2025-06-30 Haoran Tan , Zeyu Zhang , Chen Ma , Xu Chen , Quanyu Dai , Zhenhua Dong

Large Language Models (LLMs) based agents excel at diverse tasks, yet they suffer from brittle procedural memory that is manually engineered or entangled in static parameters. In this work, we investigate strategies to endow agents with a…

Computation and Language · Computer Science 2026-04-16 Runnan Fang , Yuan Liang , Xiaobin Wang , Jialong Wu , Shuofei Qiao , Pengjun Xie , Fei Huang , Huajun Chen , Ningyu Zhang

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

Artificial Intelligence · Computer Science 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

Advancements in the capabilities of Large Language Models (LLMs) have created a promising foundation for developing autonomous agents. With the right tools, these agents could learn to solve tasks in new environments by accumulating and…

Artificial Intelligence · Computer Science 2025-05-16 Petr Anokhin , Nikita Semenov , Artyom Sorokin , Dmitry Evseev , Andrey Kravchenko , Mikhail Burtsev , Evgeny Burnaev

Both humans and Large Language Models (LLMs) store a vast repository of semantic memories. In humans, efficient and strategic access to this memory store is a critical foundation for a variety of cognitive functions. Such access has long…

Artificial Intelligence · Computer Science 2026-03-03 Eric Lacosse , Mariana Duarte , Peter M. Todd , Daniel C. McNamee

Long-term conversational memory is a core capability for LLM-based dialogue systems, yet existing benchmarks and evaluation protocols primarily focus on surface-level factual recall. In realistic interactions, appropriate responses often…

Computation and Language · Computer Science 2026-02-12 Yifei Li , Weidong Guo , Lingling Zhang , Rongman Xu , Muye Huang , Hui Liu , Lijiao Xu , Yu Xu , Jun Liu

Breakthroughs in deep learning and memory networks have made major advances in natural language understanding. Language is sequential and information carried through the sequence can be captured through memory networks. Learning the…

Computation and Language · Computer Science 2023-05-22 Anupiya Nugaliyadde

Large Language Models (LLMs) are increasingly used as autonomous agents in complex, long-horizon applications, where effective memory is critical for sustained performance. Yet existing memory benchmarks are largely dialogue-centric, while…

Although LLM agents can leverage tools for complex tasks, they still need memory to maintain cross-turn consistency and accumulate reusable information in long-horizon interactions. However, retrieval-based external memory systems incur low…

Artificial Intelligence · Computer Science 2026-04-23 Jiaquan Zhang , Chaoning Zhang , Shuxu Chen , Zhenzhen Huang , Pengcheng Zheng , Zhicheng Wang , Ping Guo , Fan Mo , Sung-Ho Bae , Jie Zou , Jiwei Wei , Yang Yang

Memory enables Large Language Model (LLM) agents to perceive, store, and use information from past dialogues, which is essential for personalization. However, existing methods fail to properly model the temporal dimension of memory in two…

Artificial Intelligence · Computer Science 2026-01-13 Miao Su , Yucan Guo , Zhongni Hou , Long Bai , Zixuan Li , Yufei Zhang , Guojun Yin , Wei Lin , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Despite significant advancements in large language models (LLMs), the rapid and frequent integration of small-scale experiences, such as interactions with surrounding objects, remains a substantial challenge. Two critical factors in…

Computation and Language · Computer Science 2025-02-24 Yu Wang , Xinshuang Liu , Xiusi Chen , Sean O'Brien , Junda Wu , Julian McAuley

Memory plays a pivotal role in enabling large language model~(LLM)-based agents to engage in complex and long-term interactions, such as question answering (QA) and dialogue systems. While various memory modules have been proposed for these…

Computation and Language · Computer Science 2024-12-23 Ruihong Zeng , Jinyuan Fang , Siwei Liu , Zaiqiao Meng

Continual learning (CL) for large language models (LLMs) aims to enable sequential knowledge acquisition without catastrophic forgetting. Memory replay methods are widely used for their practicality and effectiveness, but most rely on…

Machine Learning · Computer Science 2026-04-21 Yujie Feng , Hao Wang , Jian Li , Xu Chu , Zhaolu Kang , Yiran Liu , Yasha Wang , Philip S. Yu , Xiao-Ming Wu

Large Language Models have revolutionized interactive applications; however, their finite context windows pose a critical data management challenge for maintaining stateful, long-term interactions. Existing memory approaches often rely on…

Artificial Intelligence · Computer Science 2026-05-29 Jiajie Fu , Junwen Chen , Mengzhao Wang , Aoxiang He , Maojia Sheng , Xiangyu Ke , Yifan Zhu , Yunjun Gao

Large language models (LLMs) power many interactive systems such as chatbots, customer-service agents, and personal assistants. In knowledge-intensive scenarios requiring user-specific personalization, conventional retrieval-augmented…

Artificial Intelligence · Computer Science 2026-01-13 Hailong Li , Feifei Li , Wenhui Que , Xingyu Fan

Large language model (LLM) applications, such as ChatGPT, are a powerful tool for online information-seeking (IS) and problem-solving tasks. However, users still face challenges initializing and refining prompts, and their cognitive…

Human-Computer Interaction · Computer Science 2024-02-12 Ben Wang , Jiqun Liu , Jamshed Karimnazarov , Nicolas Thompson

Existing memory systems enable Large Language Models (LLMs) to support long-horizon human-LLM interactions by persisting historical interactions beyond limited context windows. However, while recent approaches have succeeded in constructing…

Computation and Language · Computer Science 2026-04-21 Haidong Xin , Xinze Li , Zhenghao Liu , Yukun Yan , Shuo Wang , Cheng Yang , Yu Gu , Ge Yu , Maosong Sun

Leveraging Large Language Models (LLMs) to harness user-item interaction histories for item generation has emerged as a promising paradigm in generative recommendation. However, the limited context window of LLMs often restricts them to…

Information Retrieval · Computer Science 2025-04-30 Chengbing Wang , Yang Zhang , Fengbin Zhu , Jizhi Zhang , Tianhao Shi , Fuli Feng

Human-agent dialogues often exhibit topic continuity-a stable thematic frame that evolves through temporally adjacent exchanges-yet most large language model (LLM) agent memory systems fail to preserve it. Existing designs follow a…

Computation and Language · Computer Science 2026-01-21 Dehao Tao , Guoliang Ma , Yongfeng Huang , Minghu Jiang