English
Related papers

Related papers: APEX-MEM: Agentic Semi-Structured Memory with Temp…

200 papers

Structured memory representations such as knowledge graphs are central to autonomous agents and other long-lived systems. However, most existing approaches model time as discrete metadata, either sorting by recency (burying…

Computation and Language · Computer Science 2026-04-14 Weixian Waylon Li , Jiaxin Zhang , Xianan Jim Yang , Tiejun Ma , Yiwen Guo

Long-term memory is a critical capability for multimodal large language model (MLLM) agents, particularly in conversational settings where information accumulates and evolves over time. However, existing benchmarks either evaluate…

Computation and Language · Computer Science 2026-01-08 Yuanchen Bei , Tianxin Wei , Xuying Ning , Yanjun Zhao , Zhining Liu , Xiao Lin , Yada Zhu , Hendrik Hamann , Jingrui He , Hanghang Tong

Large language models often suffer from fact loss, timeline confusion, persona drift, and reduced stability during long-range interaction, especially under high-noise knowledge bases, context clearing, and cross-model transfer. To address…

Artificial Intelligence · Computer Science 2026-05-15 Zhao Yang , Wang Huan , Li Yingshuo , Tu Haomiao , Lin Hujite

Long-term conversational agents face a fundamental scalability challenge as interactions extend over time: repeatedly processing entire conversation histories becomes computationally prohibitive. Current approaches attempt to solve this…

Computation and Language · Computer Science 2026-01-13 Yue Zhou , Xiaobo Guo , Belhassen Bayar , Srinivasan H. Sengamedu

As Large Language Models (LLMs) evolve from static dialogue interfaces to autonomous general agents, effective memory is paramount to ensuring long-term consistency. However, existing benchmarks primarily focus on casual conversation or…

Computation and Language · Computer Science 2026-01-13 Haonan Bian , Zhiyuan Yao , Sen Hu , Zishan Xu , Shaolei Zhang , Yifu Guo , Ziliang Yang , Xueran Han , Huacan Wang , Ronghao Chen

There has recently been growing interest in conversational agents with long-term memory which has led to the rapid development of language models that use retrieval-augmented generation (RAG). Until recently, most work on RAG has focused on…

Computation and Language · Computer Science 2024-06-06 Nick Alonso , Tomás Figliolia , Anthony Ndirango , Beren Millidge

Although Transformers with fully connected self-attentions are powerful to model long-term dependencies, they are struggling to scale to long texts with thousands of words in language modeling. One of the solutions is to equip the model…

Computation and Language · Computer Science 2022-04-27 Haozhe Ji , Rongsheng Zhang , Zhenyu Yang , Zhipeng Hu , Minlie Huang

As large language models (LLMs) evolve into autonomous agents, persistent memory at the API layer is essential for enabling context-aware behavior across LLMs and multi-session interactions. Existing approaches force vendor lock-in and rely…

Machine Learning · Computer Science 2026-03-23 Luiz C. Borro , Luiz A. B. Macarini , Gordon Tindall , Michael Montero , Adam B. Struck

Long-term memory is critical for dialogue systems that support continuous, sustainable, and personalized interactions. However, existing methods rely on continuous summarization or OpenIE-based graph construction paired with fixed…

Computation and Language · Computer Science 2026-04-09 Yijie Zhong , Yunfan Gao , Haofen Wang

In this work, we introduce the Keep Emotional and Essential Memory (KEEM) dataset, a novel generation-based dataset designed to enhance memory updates in long-term conversational systems. Unlike existing approaches that rely on simple…

Computation and Language · Computer Science 2026-01-12 Jeonghyun Kang , Hongjin Kim , Harksoo Kim

Despite recent advances in understanding and leveraging long-range conversational memory, existing benchmarks still lack systematic evaluation of large language models(LLMs) across diverse memory dimensions, particularly in multi-session…

Computation and Language · Computer Science 2026-01-08 Ye Shen , Dun Pei , Yiqiu Guo , Junying Wang , Yijin Guo , Zicheng Zhang , Qi Jia , Jun Zhou , Guangtao Zhai

Memory enables Large Language Model (LLM) agents to perceive, store, and use information from past dialogues, which is essential for personalization. However, existing methods fail to properly model the temporal dimension of memory in two…

Artificial Intelligence · Computer Science 2026-01-13 Miao Su , Yucan Guo , Zhongni Hou , Long Bai , Zixuan Li , Yufei Zhang , Guojun Yin , Wei Lin , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Large language model (LLM) agents require long-term memory to leverage information from past interactions. However, existing memory systems often face a fidelity--efficiency trade-off: raw dialogue histories are expensive, while flat facts…

Computation and Language · Computer Science 2026-05-26 Wentao Qiu , Haotian Hu , Fanyi Wang , Jinwei Kong , Yu Zhang

Procedural memory enables large language model (LLM) agents to internalize "how-to" knowledge, theoretically reducing redundant trial-and-error. However, existing frameworks predominantly suffer from a "passive accumulation" paradigm,…

Artificial Intelligence · Computer Science 2026-04-16 Zouying Cao , Jiaji Deng , Li Yu , Weikang Zhou , Zhaoyang Liu , Bolin Ding , Hai Zhao

While large language models have achieved remarkable performance in complex tasks, they still need a memory system to utilize historical experience in long-term interactions. Existing memory methods (e.g., A-Mem, Mem0) place excessive…

Computation and Language · Computer Science 2026-04-21 Zhanyu Shen , Sijie Cheng , Zhicheng Guo , Weiqin Wang , Yile Wang , Hui Huang

AI agents that interact with users across multiple sessions require persistent long-term memory to maintain coherent, personalized behavior. Current approaches either rely on flat retrieval-augmented generation (RAG), which loses structural…

Artificial Intelligence · Computer Science 2026-05-14 Swarna Kamal Paul , Shubhendu Sharma , Nitin Sareen

Large language models (LLMs) excel at single-turn reasoning but often lose accuracy and coherence over extended, multi-turn interactions. Recent evaluations such as TurnBench highlight recurring failure modes-reasoning bias, task drift,…

Computation and Language · Computer Science 2025-12-17 Yiran Zhang , Jincheng Hu , Mark Dras , Usman Naseem

Autonomous LLM agents require structured long-term memory, yet current "append-and-evolve" systems like A-MEM face O(N^2) write-latency and excessive token costs. We introduce D-MEM (Dopamine-Gated Agentic Memory), a biologically inspired…

Neurons and Cognition · Quantitative Biology 2026-03-17 Yuru Song , Qi Xin

Long-horizon conversational agents rely on memory systems with increasingly sophisticated retrieval mechanisms. However, retrieved fragments are typically fed to the language model as unstructured text, lacking the relational, temporal, and…

Computation and Language · Computer Science 2026-05-05 Yushi Sun , Bowen Cao , Dong Fang , Lingfeng Su , Wai Lam

Agentic memory systems have become critical for enabling LLM agents to maintain long-term context and retrieve relevant information efficiently. However, existing memory frameworks suffer from a fundamental limitation: they perform…

Computation and Language · Computer Science 2026-01-14 Anxin Tian , Yiming Li , Xing Li , Hui-Ling Zhen , Lei Chen , Xianzhi Yu , Zhenhua Dong , Mingxuan Yuan