English
Related papers

Related papers: Evaluating Memory Structure in LLM Agents

200 papers

As the general capabilities of artificial intelligence (AI) agents continue to evolve, their ability to learn to master multiple complex tasks through experience remains a key challenge. Current LLM agents, particularly those based on…

Machine Learning · Computer Science 2025-05-29 Minttu Alakuijala , Ya Gao , Georgy Ananov , Samuel Kaski , Pekka Marttinen , Alexander Ilin , Harri Valpola

Lifelong interactive agents are expected to assist users over months or years, which requires continually writing long term memories while retrieving the right evidence for each new query under fixed context and latency budgets. Existing…

Information Retrieval · Computer Science 2026-03-23 Can Lv , Heng Chang , Yuchen Guo , Shengyu Tao , Shiji Zhou

Agentic frameworks powered by Large Language Models (LLMs) can be useful tools in scientific workflows by enabling human-AI co-creation. A key challenge is recommending the next steps during workflow creation without relying solely on LLMs,…

Due to the powerful capabilities demonstrated by large language model (LLM), there has been a recent surge in efforts to integrate them with AI agents to enhance their performance. In this paper, we have explored the core differences and…

Computation and Language · Computer Science 2023-09-27 Pengyu Zhao , Zijian Jin , Ning Cheng

In the current field of agent memory, extensive explorations have been conducted in the area of memory retrieval, yet few studies have focused on exploring the memory content. Most research simply stores summarized versions of historical…

Artificial Intelligence · Computer Science 2026-05-11 Gaoke Zhang , Bo Wang , Yunlong Ma , Dongming Zhao , Zifei Yu

Existing memory-augmented LLM agents often treat memory as a static repository with pre-defined representations and fixed retrieval pipelines, which is brittle in dynamic agentic environments where feedback, task variation, and…

Effectively processing long contexts remains a fundamental yet unsolved challenge for large language models (LLMs). Existing single-LLM-based methods primarily reduce the context window or optimize the attention mechanism, but they often…

Computation and Language · Computer Science 2026-04-22 Yichen Jiang , Jiakang Yuan , Chongjun Tu , Peng Ye , Tao Chen

In order for large language models to achieve true conversational continuity and benefit from experiential learning, they need memory. While research has focused on the development of complex memory systems, it remains unclear which types…

Computation and Language · Computer Science 2025-12-09 Alessandra Terranova , Björn Ross , Alexandra Birch

We introduce EMemBench, a programmatic benchmark for evaluating long-term memory of agents through interactive games. Rather than using a fixed set of questions, EMemBench generates questions from each agent's own trajectory, covering both…

Computation and Language · Computer Science 2026-01-26 Xinze Li , Ziyue Zhu , Siyuan Liu , Yubo Ma , Yuhang Zang , Yixin Cao , Aixin Sun

As LLM-based agents are increasingly used in long-term interactions, cumulative memory is critical for enabling personalization and maintaining stylistic consistency. However, most existing systems adopt an ``all-or-nothing'' approach to…

Artificial Intelligence · Computer Science 2026-01-09 Muzhao Tian , Zisu Huang , Xiaohua Wang , Jingwen Xu , Zhengkang Guo , Qi Qian , Yuanzhe Shen , Kaitao Song , Jiakang Yuan , Changze Lv , Xiaoqing Zheng

Large Language Models (LLMs) assist in specialized tasks but struggle to align with evolving domain knowledge without costly fine-tuning. Domain knowledge consists of: Knowledge: Immutable facts (e.g., 'A stone is solid') and generally…

Artificial Intelligence · Computer Science 2025-05-09 Anish Ganguli , Prabal Deb , Debleena Banerjee

The language generation and reasoning capabilities of large language models (LLMs) have enabled conversational systems with impressive performance in a variety of tasks, from code generation, to composing essays, to passing STEM and legal…

Artificial Intelligence · Computer Science 2025-02-28 Konstantina Christakopoulou , Iris Qu , John Canny , Andrew Goodridge , Cj Adams , Minmin Chen , Maja Matarić

Long-horizon applications increasingly require large language models (LLMs) to answer queries when relevant evidence is sparse and dispersed across very long contexts. Existing memory systems largely follow two paradigms: explicit…

Computation and Language · Computer Science 2026-01-08 Xin Zhang , Kailai Yang , Hao Li , Chenyue Li , Qiyu Wei , Sophia Ananiadou

Building on their demonstrated ability to perform a variety of tasks, we investigate the application of large language models (LLMs) to enhance in-depth analytical reasoning within the context of intelligence analysis. Intelligence analysts…

Computation and Language · Computer Science 2024-11-26 Raquib Bin Yousuf , Nicholas Defelice , Mandar Sharma , Shengzhe Xu , Naren Ramakrishnan

Long-running AI agents need persistent memory. Memory supports learning across sessions, reduces repeated context injection, and enables auditing of past decisions. Current agent memory systems and database paradigms treat memory as…

Artificial Intelligence · Computer Science 2026-05-27 Abdelghny Orogat , Essam Mansour

Large language models (LLMs) like GPTs, trained on vast datasets, have demonstrated impressive capabilities in language understanding, reasoning, and planning, achieving human-level performance in various tasks. Most studies focus on…

Artificial Intelligence · Computer Science 2025-05-13 Xun Jiang , Feng Li , Han Zhao , Jiahao Qiu , Jiaying Wang , Jun Shao , Shihao Xu , Shu Zhang , Weiling Chen , Xavier Tang , Yize Chen , Mengyue Wu , Weizhi Ma , Mengdi Wang , Tianqiao Chen

Persistent memory is turning language-model-based agents from stateless participants in isolated interactions into state-bearing components of LLM-based multi-agent systems. As memory becomes durable, reloadable, and behavior-shaping across…

Multiagent Systems · Computer Science 2026-05-07 Diego F. Cuadros , Abdoul-Aziz Maiga , Helen Meskhidze , Andre Curtis-Trudel

AI Clones aim to simulate an individual's thoughts and behaviors to enable long-term, personalized interaction, placing stringent demands on memory systems to model experiences, emotions, and opinions over time. Existing memory benchmarks…

Artificial Intelligence · Computer Science 2026-01-13 Sen Hu , Zhiyu Zhang , Yuxiang Wei , Xueran Han , Zhenheng Tang , Huacan Wang , Ronghao Chen

The advances made by Large Language Models (LLMs) have led to the pursuit of LLM agents that can solve intricate, multi-step reasoning tasks. As with any research pursuit, benchmarking and evaluation are key corner stones to efficient and…

Artificial Intelligence · Computer Science 2024-04-10 Luca Gioacchini , Giuseppe Siracusano , Davide Sanvito , Kiril Gashteovski , David Friede , Roberto Bifulco , Carolin Lawrence

Recently, large language model based (LLM-based) agents have been widely applied across various fields. As a critical part, their memory capabilities have captured significant interest from both industrial and academic communities. Despite…

Artificial Intelligence · Computer Science 2025-05-06 Zeyu Zhang , Quanyu Dai , Xu Chen , Rui Li , Zhongyang Li , Zhenhua Dong