English
Related papers

Related papers: Belief Memory: Agent Memory Under Partial Observab…

200 papers

Long-term conversational large language model (LLM) agents require memory systems that can recover relevant evidence from historical interactions without overwhelming the answer stage with irrelevant context. However, existing memory…

Computation and Language · Computer Science 2026-04-23 Shuqi Cao , Jingyi He , Fei Tan

As large language models (LLMs) evolve into autonomous agents, persistent memory at the API layer is essential for enabling context-aware behavior across LLMs and multi-session interactions. Existing approaches force vendor lock-in and rely…

Machine Learning · Computer Science 2026-03-23 Luiz C. Borro , Luiz A. B. Macarini , Gordon Tindall , Michael Montero , Adam B. Struck

LLM agents increasingly operate in open-ended environments spanning hundreds of sequential episodes, yet they remain largely stateless: each task is solved from scratch without converting past experience into better future behavior. The…

Computation and Language · Computer Science 2026-04-24 Wujiang Xu , Jiaojiao Han , Minghao Guo , Kai Mei , Xi Zhu , Han Zhang , Dimitris N. Metaxas

Despite their remarkable capabilities, Large Language Models (LLMs) struggle to effectively leverage historical interaction information in dynamic and complex environments. Memory systems enable LLMs to move beyond stateless interactions by…

Computation and Language · Computer Science 2026-03-03 Jizhan Fang , Xinle Deng , Haoming Xu , Ziyan Jiang , Yuqi Tang , Ziwen Xu , Shumin Deng , Yunzhi Yao , Mengru Wang , Shuofei Qiao , Huajun Chen , Ningyu Zhang

This paper extends the framework of partially observable Markov decision processes (POMDPs) to multi-agent settings by incorporating the notion of agent models into the state space. Agents maintain beliefs over physical states of the…

Artificial Intelligence · Computer Science 2011-09-13 P. Doshi , P. J. Gmytrasiewicz

Large Language Model (LLM) agents use memory to learn from past interactions, enabling autonomous planning and decision-making in complex environments. However, this reliance on memory introduces a critical security risk: an adversary can…

Cryptography and Security · Computer Science 2025-10-06 Qianshan Wei , Tengchao Yang , Yaochen Wang , Xinfeng Li , Lijun Li , Zhenfei Yin , Yi Zhan , Thorsten Holz , Zhiqiang Lin , XiaoFeng Wang

For LLM agents, memory management critically impacts efficiency, quality, and security. While much research focuses on retention, selective forgetting--inspired by human cognitive processes (hippocampal indexing/consolidation theory and…

Artificial Intelligence · Computer Science 2026-04-24 Yingjie Gu , Wenjian Xiong , Liqiang Wang , Pengcheng Ren , Chao Li , Xiaojing Zhang , Yijuan Guo , Qi Sun , Jingyao Ma , Shidang Shi

Large language model (LLM) agents have evolved to intelligently process information, make decisions, and interact with users or tools. A key capability is the integration of long-term memory capabilities, enabling these agents to draw upon…

Computation and Language · Computer Science 2025-08-04 Rana Salama , Jason Cai , Michelle Yuan , Anna Currey , Monica Sunkara , Yi Zhang , Yassine Benajiba

LLM-based MAS are gaining popularity due to their potential for collaborative problem-solving enhanced by advances in natural language comprehension, reasoning, and planning. Research in Theory of Mind (ToM) and Belief-Desire-Intention…

Multiagent Systems · Computer Science 2026-03-03 Adam Kostka , Jarosław A. Chudziak

Constructing memory from users' long-term conversations overcomes LLMs' contextual limitations and enables personalized interactions. Recent studies focus on hierarchical memory to model users' multi-granular behavioral patterns via…

Multiagent Systems · Computer Science 2026-01-13 Wenyu Mao , Haosong Tan , Shuchang Liu , Haoyang Liu , Yifan Xu , Huaxiang Ji , Xiang Wang

We establish empirical bounds on behavioral inference through controlled experiments at scale: LLM-based agents assigned one of 36 behavioral profiles (9 belief systems x 4 motivations) generate over 1.5 million behavioral sequences across…

Multiagent Systems · Computer Science 2026-03-10 Jason Starace , Terence Soule

We analyze a model of learning and belief formation in networks in which agents follow Bayes rule yet they do not recall their history of past observations and cannot reason about how other agents' beliefs are formed. They do so by making…

Social and Information Networks · Computer Science 2015-10-01 Mohammad Amin Rahimian , Ali Jadbabaie

Existing memory-augmented LLM agents often treat memory as a static repository with pre-defined representations and fixed retrieval pipelines, which is brittle in dynamic agentic environments where feedback, task variation, and…

Large Language Model (LLM) agents increasingly serve as personal assistants and workplace collaborators, where their utility depends on memory systems that extract, retrieve, and apply information across long-running conversations. However,…

Computation and Language · Computer Science 2026-05-19 Jingbo Yang , Kwei-Herng Lai , Xiaowen Wang , Shiyu Chang , Yaar Harari , Evgeniy Gabrilovich

Reasoning over ultra-long documents requires synthesizing sparse evidence scattered across distant segments under strict memory constraints. While streaming agents enable scalable processing, their passive memory update strategy often fails…

Computation and Language · Computer Science 2026-02-04 Xinyu Wang , Mingze Li , Peng Lu , Xiao-Wen Chang , Lifeng Shang , Jinping Li , Fei Mi , Prasanna Parthasarathi , Yufei Cui

Decision Transformer-based decision-making agents have shown the ability to generalize across multiple tasks. However, their performance relies on massive data and computation. We argue that this inefficiency stems from the forgetting…

Machine Learning · Computer Science 2024-05-30 Jikun Kang , Romain Laroche , Xingdi Yuan , Adam Trischler , Xue Liu , Jie Fu

Although long-term memory systems have made substantial progress in recent years, they still exhibit clear limitations in adaptability, scalability, and self-evolution under continuous interaction settings. Inspired by cognitive theories,…

Artificial Intelligence · Computer Science 2026-01-13 Ningning Zhang , Xingxing Yang , Zhizhong Tan , Weiping Deng , Wenyong Wang

In the real world, agents often have to operate in situations with incomplete information, limited sensing capabilities, and inherently stochastic environments, making individual observations incomplete and unreliable. Moreover, in many…

Machine Learning · Computer Science 2018-09-26 Akshat Agarwal , Abhinau Kumar , Kyle Dunovan , Erik Peterson , Timothy Verstynen , Katia Sycara

To support long-term interaction in complex environments, LLM agents require memory systems that manage historical experiences. Existing approaches either retain full interaction histories via passive context extension, leading to…

Artificial Intelligence · Computer Science 2026-01-30 Jiaqi Liu , Yaofeng Su , Peng Xia , Siwei Han , Zeyu Zheng , Cihang Xie , Mingyu Ding , Huaxiu Yao

Large language model (LLM) based agents have recently attracted much attention from the research and industry communities. Compared with original LLMs, LLM-based agents are featured in their self-evolving capability, which is the basis for…

Artificial Intelligence · Computer Science 2024-04-23 Zeyu Zhang , Xiaohe Bo , Chen Ma , Rui Li , Xu Chen , Quanyu Dai , Jieming Zhu , Zhenhua Dong , Ji-Rong Wen