English
Related papers

Related papers: HEMA : A Hippocampus-Inspired Extended Memory Arch…

200 papers

In this work, we introduce the Keep Emotional and Essential Memory (KEEM) dataset, a novel generation-based dataset designed to enhance memory updates in long-term conversational systems. Unlike existing approaches that rely on simple…

Computation and Language · Computer Science 2026-01-12 Jeonghyun Kang , Hongjin Kim , Harksoo Kim

Large Language Models (LLMs) face significant challenges in long-context processing, including quadratic computational costs, information forgetting, and the context fragmentation inherent in retrieval-augmented generation (RAG). We propose…

Computation and Language · Computer Science 2026-02-10 Zhuoen Chen , Dongfang Li , Meishan Zhang , Baotian Hu , Min Zhang

Long-horizon dialogue systems suffer from semanticdrift and unstable memory retention across extended sessions. This paper presents a Multi-Layer Memory Framework that decomposes dialogue history into working, episodic, and semantic layers…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Sunil Tiwari , Payal Fofadiya

Memory-augmented large language models extend reasoning beyond a fixed context window by maintaining long-term memory across interactions. However, existing memory systems often collapse stable user facts, episodic events, and behavioral…

Computation and Language · Computer Science 2026-05-28 Hyeonjeong Ha , Jeonghwan Kim , Cheng Qian , Jiayu Liu , William M. Campbell , Yue Wu , Yuji Zhang , Kathleen McKeown , Dilek Hakkani-Tur , Heng Ji

Large Language Models (LLMs) are increasingly deployed as long-term interactive agents, yet their limited context windows make it difficult to sustain coherent behavior over extended interactions. Existing memory systems often store…

Artificial Intelligence · Computer Science 2026-01-12 Chuanrui Hu , Xingze Gao , Zuyi Zhou , Dannong Xu , Yi Bai , Xintong Li , Hui Zhang , Tong Li , Chong Zhang , Lidong Bing , Yafeng Deng

Comprehending extended audiovisual experiences remains challenging for computational systems, particularly temporal integration and cross-modal associations fundamental to human episodic memory. We introduce HippoMM, a computational…

Multimedia · Computer Science 2026-04-03 Yueqian Lin , Jingyang Zhang , Qinsi Wang , Hancheng Ye , Yuzhe Fu , Yudong Liu , Hai "Helen" Li , Yiran Chen

Existing works on long-term open-domain dialogues focus on evaluating model responses within contexts spanning no more than five chat sessions. Despite advancements in long-context large language models (LLMs) and retrieval augmented…

Computation and Language · Computer Science 2024-02-28 Adyasha Maharana , Dong-Ho Lee , Sergey Tulyakov , Mohit Bansal , Francesco Barbieri , Yuwei Fang

Current LLM agents lack principled mechanisms for managing persistent memory across long interaction horizons. We present a biologically-grounded memory architecture comprising six cognitive mechanisms: (1) sleep-phase consolidation, (2)…

Artificial Intelligence · Computer Science 2026-05-12 Doga Kerestecioglu , Alexei Robsky , Clemens Vasters , Anshul Sharma , Yitzhak Kesselman

As large language models (LLMs) evolve into autonomous agents, persistent memory at the API layer is essential for enabling context-aware behavior across LLMs and multi-session interactions. Existing approaches force vendor lock-in and rely…

Machine Learning · Computer Science 2026-03-23 Luiz C. Borro , Luiz A. B. Macarini , Gordon Tindall , Michael Montero , Adam B. Struck

In order to thrive in hostile and ever-changing natural environments, mammalian brains evolved to store large amounts of knowledge about the world and continually integrate new information while avoiding catastrophic forgetting. Despite the…

Computation and Language · Computer Science 2025-01-15 Bernal Jiménez Gutiérrez , Yiheng Shu , Yu Gu , Michihiro Yasunaga , Yu Su

Memory is critical for dialogue agents to maintain coherence and enable continuous adaptation in long-term interactions. While existing memory mechanisms offer basic storage and retrieval capabilities, they are hindered by two primary…

Computation and Language · Computer Science 2026-01-14 Huhai Zou , Tianhao Sun , Chuanjiang He , Yu Tian , Zhenyang Li , Li Jin , Nayu Liu , Jiang Zhong , Kaiwen Wei

We present SCM (Sleep-Consolidated Memory), a research preview of a memory architecture for large language models that draws on neuroscientific principles to address a fundamental limitation in current systems: the absence of persistent,…

Machine Learning · Computer Science 2026-04-24 Saish Sachin Shinde

Agentic AI require persistent memory to store user-specific histories beyond the limited context window of LLMs. Existing memory systems use dense vector databases or knowledge-graph traversal (or hybrid), incurring high retrieval latency…

Artificial Intelligence · Computer Science 2026-02-17 Yi Li , Lianjie Cao , Faraz Ahmed , Puneet Sharma , Bingzhe Li

Providing AI agents with reliable long-term memory that does not hallucinate remains an open problem. Current approaches to memory for LLM agents -- sliding windows, summarization, embedding-based RAG, and flat fact extraction -- each…

Computation and Language · Computer Science 2026-04-14 Artem Gadzhiev , Andrew Kislov

Human-agent dialogues often exhibit topic continuity-a stable thematic frame that evolves through temporally adjacent exchanges-yet most large language model (LLM) agent memory systems fail to preserve it. Existing designs follow a…

Computation and Language · Computer Science 2026-01-21 Dehao Tao , Guoliang Ma , Yongfeng Huang , Minghu Jiang

Memory plays a foundational role in augmenting the reasoning, adaptability, and contextual fidelity of modern Large Language Models and Multi-Modal LLMs. As these models transition from static predictors to interactive systems capable of…

Artificial Intelligence · Computer Science 2026-01-15 Zixia Jia , Jiaqi Li , Yipeng Kang , Yuxuan Wang , Tong Wu , Quansen Wang , Xiaobo Wang , Shuyi Zhang , Junzhe Shen , Qing Li , Siyuan Qi , Yitao Liang , Di He , Zilong Zheng , Song-Chun Zhu

Persistent conversational AI systems face a choice between passing full conversation histories to a long-context large language model (LLM) and maintaining a dedicated memory system that extracts and retrieves structured facts. We compare a…

Computation and Language · Computer Science 2026-03-06 Natchanon Pollertlam , Witchayut Kornsuwannawit

Large Language Model (LLM) agents are increasingly used in real-world products, where personalized and context-aware user interactions are essential. A central enabler of such capabilities is the agent's long-term semantic memory system,…

Information Retrieval · Computer Science 2026-05-27 Zhentao Xu , Shangjin Zhang , Emir Poyraz , Yvonne Li , Ye Jin , Xie Lu , Xiaoyang Gu , Karthik Ramgopal , Praveen Kumar Bodigutla , Xiaofeng Wang

Large Language Model (LLM) has exhibited strong reasoning ability in text-based contexts across various domains, yet the limitation of context window poses challenges for the model on long-range inference tasks and necessitates a memory…

Information Retrieval · Computer Science 2026-03-11 Mengwei Yuan , Jianan Liu , Jing Yang , Xianyou Li , Weiran Yan , Yichao Wu , Penghao Liang

Multi-step retrieval-augmented generation (RAG) has become a widely adopted strategy for enhancing large language models (LLMs) on tasks that demand global comprehension and intensive reasoning. Although many RAG systems incorporate a…

Computation and Language · Computer Science 2026-05-28 Chulun Zhou , Chunkang Zhang , Guoxin Yu , Fandong Meng , Jie Zhou , Wai Lam , Mo Yu