English
Related papers

Related papers: Hippocampus: An Efficient and Scalable Memory Modu…

200 papers

Long-term multi-agent systems inevitably generate vast amounts of trajectories and historical interactions, which makes efficient memory management essential for both performance and scalability. Existing methods typically depend on vector…

Artificial Intelligence · Computer Science 2025-09-29 Haoran Xu , Jiacong Hu , Ke Zhang , Lei Yu , Yuxin Tang , Xinyuan Song , Yiqun Duan , Lynn Ai , Bill Shi

Large Language Models (LLMs) falter in multi-step interactions -- often hallucinating, repeating actions, or misinterpreting user corrections -- due to reliance on linear, unstructured context. This fragility stems from the lack of…

Artificial Intelligence · Computer Science 2025-05-27 Ye Ye

Large language model (LLM) agents increasingly operate in settings where a single context window is far too small to capture what has happened, what was learned, and what should not be repeated. Memory -- the ability to persist, organize,…

Artificial Intelligence · Computer Science 2026-03-10 Pengfei Du

Memory enables Large Language Model (LLM) agents to perceive, store, and use information from past dialogues, which is essential for personalization. However, existing methods fail to properly model the temporal dimension of memory in two…

Artificial Intelligence · Computer Science 2026-01-13 Miao Su , Yucan Guo , Zhongni Hou , Long Bai , Zixuan Li , Yufei Zhang , Guojun Yin , Wei Lin , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

In order for large language models to achieve true conversational continuity and benefit from experiential learning, they need memory. While research has focused on the development of complex memory systems, it remains unclear which types…

Computation and Language · Computer Science 2025-12-09 Alessandra Terranova , Björn Ross , Alexandra Birch

Large language models still struggle with reliable long-term conversational memory: simply enlarging context windows or applying naive retrieval often introduces noise and destabilizes responses. We present APEX-MEM, a conversational memory…

Computation and Language · Computer Science 2026-04-17 Pratyay Banerjee , Masud Moshtaghi , Shivashankar Subramanian , Amita Misra , Ankit Chadha

Memory serves as the pivotal nexus bridging past and future, providing both humans and AI systems with invaluable concepts and experience to navigate complex tasks. Recent research on autonomous agents has increasingly focused on designing…

Computation and Language · Computer Science 2025-12-30 Jiafeng Liang , Hao Li , Chang Li , Jiaqi Zhou , Shixin Jiang , Zekun Wang , Changkai Ji , Zhihao Zhu , Runxuan Liu , Tao Ren , Jinlan Fu , See-Kiong Ng , Xia Liang , Ming Liu , Bing Qin

We investigate a new method to augment recurrent neural networks with extra memory without increasing the number of network parameters. The system has an associative memory based on complex-valued vectors and is closely related to…

Neural and Evolutionary Computing · Computer Science 2016-05-20 Ivo Danihelka , Greg Wayne , Benigno Uria , Nal Kalchbrenner , Alex Graves

In order to thrive in hostile and ever-changing natural environments, mammalian brains evolved to store large amounts of knowledge about the world and continually integrate new information while avoiding catastrophic forgetting. Despite the…

Computation and Language · Computer Science 2025-01-15 Bernal Jiménez Gutiérrez , Yiheng Shu , Yu Gu , Michihiro Yasunaga , Yu Su

Large Language Models (LLMs) encounter significant performance bottlenecks in long-sequence tasks due to the computational complexity and memory overhead inherent in the self-attention mechanism. To address these challenges, we introduce…

Artificial Intelligence · Computer Science 2026-02-17 Ziming Wang , Xiang Wang , Kailong Peng , Lang Qin , Juan Gabriel Kostelec , Christos Sourmpis , Axel Laborieux , Qinghai Guo

Large Language Models (LLMs) possess remarkable generalization capabilities but struggle with multi-task adaptation, particularly in balancing knowledge retention with task-specific specialization. Conventional fine-tuning methods suffer…

Artificial Intelligence · Computer Science 2025-10-21 Dayan Pan , Zhaoyang Fu , Jingyuan Wang , Xiao Han , Yue Zhu , Xiangyu Zhao

Current generation of memory-augmented neural networks has limited scalability as they cannot efficiently process data that are too large to fit in the external memory storage. One example of this is lifelong learning scenario where the…

Machine Learning · Computer Science 2018-12-12 Hyunwoo Jung , Moonsu Han , Minki Kang , Sungju Hwang

Large Language Model (LLM) agents require persistent memory to maintain personalization, factual continuity, and long-horizon reasoning, yet standard context-window and retrieval-augmented generation (RAG) pipelines degrade over…

Artificial Intelligence · Computer Science 2026-04-07 Shu Wang , Edwin Yu , Oscar Love , Tom Zhang , Tom Wong , Steve Scargall , Charles Fan

Large Language Models (LLMs) have made extraordinary progress in the field of Artificial Intelligence and have demonstrated remarkable capabilities across a large variety of tasks and domains. However, as we venture closer to creating…

Artificial Intelligence · Computer Science 2023-10-04 Brandon Kynoch , Hugo Latapie , Dwane van der Sluis

Reasoning over ultra-long documents requires synthesizing sparse evidence scattered across distant segments under strict memory constraints. While streaming agents enable scalable processing, their passive memory update strategy often fails…

Computation and Language · Computer Science 2026-02-04 Xinyu Wang , Mingze Li , Peng Lu , Xiao-Wen Chang , Lifeng Shang , Jinping Li , Fei Mi , Prasanna Parthasarathi , Yufei Cui

The future of artificial intelligence (AI) acceleration demands a paradigm shift beyond the limitations of purely electronic or photonic architectures. Photonic analog computing delivers unmatched speed and parallelism but struggles with…

In this work, we identify and address the core challenges of agentic memory management in LLM serving, where large-scale storage, frequent updates, and multiple coexisting agents jointly introduce complex and high-cost approximate nearest…

Multiagent Systems · Computer Science 2026-02-26 Zhengding Hu , Zaifeng Pan , Prabhleen Kaur , Vibha Murthy , Zhongkai Yu , Yue Guan , Zhen Wang , Steven Swanson , Yufei Ding

Recent advances in video large language models have demonstrated strong capabilities in understanding short clips. However, scaling them to hours- or days-long videos remains highly challenging due to limited context capacity and the loss…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Woongyeong Yeo , Kangsan Kim , Jaehong Yoon , Sung Ju Hwang

Although memory capabilities of AI agents are gaining increasing attention, existing solutions remain fundamentally limited. Most rely on flat, narrowly scoped memory components, constraining their ability to personalize, abstract, and…

Computation and Language · Computer Science 2025-07-11 Yu Wang , Xi Chen

Extracting actionable insights from complex value stream map simulations can be challenging, time-consuming, and error-prone. Recent advances in large language models offer new avenues to support users with this task. While existing…

Computation and Language · Computer Science 2026-04-15 Micha Selak , Dirk Krechel , Adrian Ulges , Sven Spieckermann , Niklas Stoehr , Andreas Loehr