English
Related papers

Related papers: HIMM: Human-Inspired Long-Term Memory Modeling for…

200 papers

Memory is fundamental to large language model (LLM)-based agents, but existing surveys emphasize application-level use (e.g., personalized dialogue), while overlooking the atomic operations governing memory dynamics. This work categorizes…

Computation and Language · Computer Science 2025-12-25 Yiming Du , Wenyu Huang , Danna Zheng , Zhaowei Wang , Sebastien Montella , Mirella Lapata , Kam-Fai Wong , Jeff Z. Pan

Sequential planning in large state space and action space quickly becomes intractable due to combinatorial explosion of the search space. Heuristic methods, like monte-carlo tree search, though effective for large state space, but struggle…

Artificial Intelligence · Computer Science 2023-12-13 Swarna Kamal Paul

Current language model systems remain fundamentally stateless across sessions, limiting their ability to personalize interactions over time. While retrieval-augmented generation and fine-tuning improve knowledge access and domain…

Artificial Intelligence · Computer Science 2026-05-15 Vineet Kotecha , Vansh Gupta

Language models (LMs) require robust episodic grounding-the capacity to learn from and apply past experiences-to excel at physical planning tasks. Current episodic grounding approaches struggle with scalability and integration, limiting…

Computation and Language · Computer Science 2025-06-03 Chunhui Zhang , Sirui , Wang , Zhongyu Ouyang , Xiangchi Yuan , Soroush Vosoughi

Q-learning excels in learning from feedback within sequential decision-making tasks but often requires extensive sampling to achieve significant improvements. While reward shaping can enhance learning efficiency, non-potential-based methods…

Machine Learning · Computer Science 2024-05-27 Xiefeng Wu

To enable reliable long-term interaction, LLM agents require a memory system that can faithfully store, efficiently retrieve, and deeply reason over accumulated dialogue history. Most existing methods adopt an extracted fact based paradigm:…

Computation and Language · Computer Science 2026-05-20 Jingwei Sun , Jianing Zhu , Jiangchao Yao , Tongliang Liu , Bo Han

Large Language Models (LLMs) based agents excel at diverse tasks, yet they suffer from brittle procedural memory that is manually engineered or entangled in static parameters. In this work, we investigate strategies to endow agents with a…

Computation and Language · Computer Science 2026-04-16 Runnan Fang , Yuan Liang , Xiaobin Wang , Jialong Wu , Shuofei Qiao , Pengjun Xie , Fei Huang , Huajun Chen , Ningyu Zhang

Existing large language models (LLMs) can only afford fix-sized inputs due to the input length limit, preventing them from utilizing rich long-context information from past inputs. To address this, we propose a framework, Language Models…

Computation and Language · Computer Science 2023-06-13 Weizhi Wang , Li Dong , Hao Cheng , Xiaodong Liu , Xifeng Yan , Jianfeng Gao , Furu Wei

Long-term memory is a critical challenge for Large Language Model agents, as fixed context windows cannot preserve coherence across extended interactions. Existing memory systems represent conversation history as unstructured embedding…

Computation and Language · Computer Science 2026-04-21 Jinchang Zhu , Jindong Li , Cheng Zhang , Jiahong Liu , Menglin Yang

Long-horizon interactions between users and LLM-based assistants necessitate effective memory management, yet current approaches face challenges in training and evaluation of memory. Existing memory benchmarks rely on static, off-policy…

Computation and Language · Computer Science 2026-03-03 Cheng Jiayang , Dongyu Ru , Lin Qiu , Yiyang Li , Xuezhi Cao , Yangqiu Song , Xunliang Cai

Memory emerges as the core module in the large language model (LLM)-based agents for long-horizon complex tasks (e.g., multi-turn dialogue, game playing, scientific discovery), where memory can enable knowledge accumulation, iterative…

Computation and Language · Computer Science 2026-05-04 Yanchen Wu , Tenghui Lin , Yingli Zhou , Fangyuan Zhang , Qintian Guo , Xun Zhou , Sibo Wang , Xilin Liu , Yuchi Ma , Yixiang Fang

In-context learning is governed by both temporal and semantic relationships, shaping how Large Language Models (LLMs) retrieve contextual information. Analogous to human episodic memory, where the retrieval of specific events is enabled by…

Computation and Language · Computer Science 2025-10-28 Anooshka Bajaj , Deven Mahesh Mistry , Sahaj Singh Maini , Yash Aggarwal , Zoran Tiganj

External memory is a key component of modern large language model (LLM) systems, enabling long-term interaction and personalization. Despite its importance, memory management is still largely driven by hand-designed heuristics, offering…

Computation and Language · Computer Science 2025-12-29 Changzhi Sun , Xiangyu Chen , Jixiang Luo , Dell Zhang , Xuelong Li

Large language models lack persistent, structured memory for long-term interaction and context-sensitive retrieval. Expanding context windows does not solve this: recent evidence shows that context length alone degrades reasoning by up to…

Computation and Language · Computer Science 2026-04-01 Diego C. Lerma-Torres

While current large language models (LLMs) perform well on many knowledge-related tasks, they are limited by relying on their parameters as an implicit storage mechanism. As a result, they struggle with memorizing rare events and with…

Computation and Language · Computer Science 2025-04-18 Ali Modarressi , Abdullatif Köksal , Ayyoob Imani , Mohsen Fayyaz , Hinrich Schütze

Computational models of pragmatic language use have traditionally relied on hand-specified sets of utterances and meanings, limiting their applicability to real-world language use. We propose a neuro-symbolic framework that enhances…

Computation and Language · Computer Science 2025-06-03 Polina Tsvilodub , Robert D. Hawkins , Michael Franke

Agentic frameworks powered by Large Language Models (LLMs) can be useful tools in scientific workflows by enabling human-AI co-creation. A key challenge is recommending the next steps during workflow creation without relying solely on LLMs,…

Embodied exploration is a target-driven process that requires embodied agents to possess fine-grained perception and knowledge-enhanced decision making. While recent attempts leverage MLLMs for exploration due to their strong perceptual and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Gengyuan Zhang , Mingcong Ding , Jingpei Wu , Ruotong Liao , Volker Tresp

Memory plays a foundational role in augmenting the reasoning, adaptability, and contextual fidelity of modern Large Language Models and Multi-Modal LLMs. As these models transition from static predictors to interactive systems capable of…

Artificial Intelligence · Computer Science 2026-01-15 Zixia Jia , Jiaqi Li , Yipeng Kang , Yuxuan Wang , Tong Wu , Quansen Wang , Xiaobo Wang , Shuyi Zhang , Junzhe Shen , Qing Li , Siyuan Qi , Yitao Liang , Di He , Zilong Zheng , Song-Chun Zhu

Long-horizon agentic reasoning requires large language models to act over long interaction histories containing thoughts, tool calls, observations, and partial conclusions. The challenge is not merely that these histories grow long, but…

Artificial Intelligence · Computer Science 2026-05-26 Yuyang Hu , Hongjin Qian , Shuting Wang , Jiongnan Liu , Ziliang Zhao , Jiejun Tan , Zheng Liu , Zhicheng Dou