English
Related papers

Related papers: Remember the Decision, Not the Description: A Rate…

200 papers

Memory-augmented large language models extend reasoning beyond a fixed context window by maintaining long-term memory across interactions. However, existing memory systems often collapse stable user facts, episodic events, and behavioral…

Computation and Language · Computer Science 2026-05-28 Hyeonjeong Ha , Jeonghwan Kim , Cheng Qian , Jiayu Liu , William M. Campbell , Yue Wu , Yuji Zhang , Kathleen McKeown , Dilek Hakkani-Tur , Heng Ji

Large language models (LLMs) have emerged as effective action policies for sequential decision-making (SDM) tasks due to their extensive prior knowledge. However, this broad yet general knowledge is often insufficient for specific…

Machine Learning · Computer Science 2025-10-01 Xue Yan , Zijing Ou , Mengyue Yang , Yan Song , Haifeng Zhang , Yingzhen Li , Jun Wang

Memory emerges as the core module in the large language model (LLM)-based agents for long-horizon complex tasks (e.g., multi-turn dialogue, game playing, scientific discovery), where memory can enable knowledge accumulation, iterative…

Computation and Language · Computer Science 2026-05-04 Yanchen Wu , Tenghui Lin , Yingli Zhou , Fangyuan Zhang , Qintian Guo , Xun Zhou , Sibo Wang , Xilin Liu , Yuchi Ma , Yixiang Fang

Long-term memory is fundamental for personalized agents capable of accumulating knowledge, reasoning over user experiences, and adapting across time. However, existing memory benchmarks primarily target declarative memory, specifically…

Long-term personalized memory for LLM agents is challenging on resource-limited edge devices due to high storage costs and multimodal complexity. To address this, we propose ScrapMem, a framework that integrates multimodal data into…

Artificial Intelligence · Computer Science 2026-05-26 Jiale Chang , Yuxiang Ren

We study the effect of imperfect memory on decision making in the context of a stochastic sequential action-reward problem. An agent chooses a sequence of actions which generate discrete rewards at different rates. She is allowed to make…

Probability · Mathematics 2019-09-20 Kuang Xu , Se-Young Yun

Persistent conversational AI systems face a choice between passing full conversation histories to a long-context large language model (LLM) and maintaining a dedicated memory system that extracts and retrieves structured facts. We compare a…

Computation and Language · Computer Science 2026-03-06 Natchanon Pollertlam , Witchayut Kornsuwannawit

Large language model (LLM) agents often rely on long sequences of low-level textual actions, resulting in large effective decision horizons and high inference cost. While prior work has focused on improving inference efficiency through…

Artificial Intelligence · Computer Science 2026-05-20 Wenhao Huang , Qingwen Zeng , Qiyue Chen , Zijie Guo , Yu Sun , Cheng Yang , Siru Ouyang , Jiri Gesi , Fang Wu , Jiayi Zhang , Huaming Chen , Bang Liu , Xiangru Tang , Chenglin Wu

Memory-augmented Large Language Models (LLMs) have demonstrated remarkable performance in long-term human-machine interactions, which basically relies on iterative recalling and reasoning of history to generate high-quality responses.…

Computation and Language · Computer Science 2023-11-16 Lei Liu , Xiaoyan Yang , Yue Shen , Binbin Hu , Zhiqiang Zhang , Jinjie Gu , Guannan Zhang

Embodied task planning requires agents to execute long-horizon, goal-directed actions in complex 3D environments, where success depends on both immediate perception and accumulated experience across tasks. However, most existing LLM-based…

Robotics · Computer Science 2026-04-21 Xiaoyu Ma , Lianyu Hu , Wenbing Tang , Zixuan Hu , Zeqin Liao , Zhizhen Wu , Yang Liu

We study the problem of modeling a population of agents pursuing unknown goals subject to unknown computational constraints. In standard models of bounded rationality, sub-optimal decision-making is simulated by adding homoscedastic noise…

Artificial Intelligence · Computer Science 2023-12-08 Athul Paul Jacob , Abhishek Gupta , Jacob Andreas

Memory agents, which depart from predefined memory-processing pipelines by endogenously managing the processing, storage, and retrieval of memories, have garnered increasing attention for their autonomy and adaptability. However, existing…

Machine Learning · Computer Science 2026-03-10 Yanwei Yue , Boci Peng , Xuanbo Fan , Jiaxin Guo , Qiankun Li , Yan Zhang

Long-term memory (LTM) is essential for large language models (LLMs) to achieve autonomous intelligence in complex, evolving environments. Despite increasing efforts in memory-augmented and retrieval-based architectures, there remains a…

Computation and Language · Computer Science 2025-06-17 Luanbo Wan , Weizhi Ma

Memory management is vital for LLM agents to handle long-term interaction and personalization. Most research focuses on how to organize and use memory summary, but often overlooks the initial memory extraction stage. In this paper, we argue…

Computation and Language · Computer Science 2026-01-09 Chengyuan Yang , Zequn Sun , Wei Wei , Wei Hu

A foundational problem in reinforcement learning and interactive decision making is to understand what modeling assumptions lead to sample-efficient learning guarantees, and what algorithm design principles achieve optimal sample…

Machine Learning · Computer Science 2023-01-20 Dylan J. Foster , Noah Golowich , Yanjun Han

Understanding how individuals perceive and recall information in their natural environments is critical to understanding potential failures in perception (e.g., sensory loss) and memory (e.g., dementia). Event segmentation, the process of…

Computation and Language · Computer Science 2025-10-20 Ryan A. Panela , Alex J. Barnett , Morgan D. Barense , Björn Herrmann

Long-horizon dialogue systems suffer from semanticdrift and unstable memory retention across extended sessions. This paper presents a Multi-Layer Memory Framework that decomposes dialogue history into working, episodic, and semantic layers…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Sunil Tiwari , Payal Fofadiya

This paper addresses the limitations of large language models in understanding long-term context. It proposes a model architecture equipped with a long-term memory mechanism to improve the retention and retrieval of semantic information…

Computation and Language · Computer Science 2025-05-30 Yue Xing , Tao Yang , Yijiashun Qi , Minggu Wei , Yu Cheng , Honghui Xin

The stateless architecture of Large Language Models inherently lacks the mechanism to preserve dynamic context, compelling agents to redundantly reprocess history to maintain long-horizon autonomy. While latent memory offers a solution,…

Computation and Language · Computer Science 2026-04-14 Yubo Hou , Zhisheng Chen , Tao Wan , Zengchang Qin

Recent memory agents improve LLMs by extracting experiences and conversation history into an external storage. This enables low-overhead context assembly and online memory update without expensive LLM training. However, existing solutions…

Artificial Intelligence · Computer Science 2026-02-27 Xinle Wu , Rui Zhang , Mustafa Anis Hussain , Yao Lu