English
Related papers

Related papers: Human-Inspired Memory Architecture for LLM Agents

200 papers

In order for large language models to achieve true conversational continuity and benefit from experiential learning, they need memory. While research has focused on the development of complex memory systems, it remains unclear which types…

Computation and Language · Computer Science 2025-12-09 Alessandra Terranova , Björn Ross , Alexandra Birch

The rapid evolution of Large Language Model (LLM) agents has necessitated robust memory systems to support cohesive long-term interaction and complex reasoning. Benefiting from the strong capabilities of LLMs, recent research focus has…

Artificial Intelligence · Computer Science 2026-04-16 Weiquan Huang , Zixuan Wang , Hehai Lin , Sudong Wang , Bo Xu , Qian Li , Beier Zhu , Linyi Yang , Chengwei Qin

Long-term personalized memory for LLM agents is challenging on resource-limited edge devices due to high storage costs and multimodal complexity. To address this, we propose ScrapMem, a framework that integrates multimodal data into…

Artificial Intelligence · Computer Science 2026-05-26 Jiale Chang , Yuxiang Ren

Multimodal large language models (MLLMs) have recently demonstrated strong capabilities in understanding and generating responses from diverse visual inputs, including high-resolution images and long video sequences. As these models scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Junwan Kim , Hyunkyung Bae

Autonomous LLM agents require structured long-term memory, yet current "append-and-evolve" systems like A-MEM face O(N^2) write-latency and excessive token costs. We introduce D-MEM (Dopamine-Gated Agentic Memory), a biologically inspired…

Neurons and Cognition · Quantitative Biology 2026-03-17 Yuru Song , Qi Xin

LLMs are trained once, then deployed into a world that never stops changing. External memory compensates for this, but most systems manage it explicitly rather than letting it adapt on its own. Biological memory works differently: coupled…

Machine Learning · Computer Science 2026-05-08 Andreas Pattichis , Constantine Dovrolis

Large language model (LLM) agents increasingly rely on external memory systems to remain consistent across long-horizon interactions, but little empirical work has been done to understand the specific failure modes and design choices that…

Artificial Intelligence · Computer Science 2026-05-27 Ishir Garg , Neel Kolhe , Dawn Song , Xuandong Zhao

Ad hoc dataset search requires matching underspecified natural-language queries against sparse, heterogeneous metadata records, a task where typical lexical or dense retrieval alone falls short. We reposition dataset search as a…

Information Retrieval · Computer Science 2026-04-21 Riccardo Terrenzi , Phongsakon Mark Konrad , Tim Lukas Adam , Serkan Ayvaz

Language models (LMs) and their extension, vision-language models (VLMs), have achieved remarkable performance across various tasks. However, they still struggle with complex reasoning tasks that require multimodal or multilingual…

Machine Learning · Computer Science 2025-07-09 Wenyi Wu , Zixuan Song , Kun Zhou , Yifei Shao , Zhiting Hu , Biwei Huang

Language model (LM)-based agents have demonstrated promising capabilities in automating complex tasks from natural language instructions, yet they continue to struggle with long-horizon planning and reasoning. To address this, we propose an…

Artificial Intelligence · Computer Science 2026-05-05 Wenyi Wu , Sibo Zhu , Kun Zhou , Biwei Huang

Large Language Model (LLM) agents have demonstrated remarkable capabilities in reasoning and tool use, yet they often suffer from rigid, reactive control flows that limit their adaptability and efficiency. Most existing frameworks rely on…

Artificial Intelligence · Computer Science 2026-04-17 Hong Su

It has been shown that a neural network model recently proposed to describe basic memory performance is based on a ternary/binary coding/decoding algorithm which leads to a new neural network assembly memory model (NNAMM) providing…

Artificial Intelligence · Computer Science 2007-05-23 Petro M. Gopych

As large language models (LLMs) evolve into autonomous agents, persistent memory at the API layer is essential for enabling context-aware behavior across LLMs and multi-session interactions. Existing approaches force vendor lock-in and rely…

Machine Learning · Computer Science 2026-03-23 Luiz C. Borro , Luiz A. B. Macarini , Gordon Tindall , Michael Montero , Adam B. Struck

Despite their remarkable capabilities, Large Language Models (LLMs) struggle to effectively leverage historical interaction information in dynamic and complex environments. Memory systems enable LLMs to move beyond stateless interactions by…

Computation and Language · Computer Science 2026-03-03 Jizhan Fang , Xinle Deng , Haoming Xu , Ziyan Jiang , Yuqi Tang , Ziwen Xu , Shumin Deng , Yunzhi Yao , Mengru Wang , Shuofei Qiao , Huajun Chen , Ningyu Zhang

In this paper, we introduce a novel learning paradigm for Adaptive Large Language Model (LLM) agents that eliminates the need for fine-tuning the underlying LLMs. Existing approaches are often either rigid, relying on static, handcrafted…

Machine Learning · Computer Science 2025-08-26 Huichi Zhou , Yihang Chen , Siyuan Guo , Xue Yan , Kin Hei Lee , Zihan Wang , Ka Yiu Lee , Guchun Zhang , Kun Shao , Linyi Yang , Jun Wang

Multi-agent LLM systems on edge devices face a memory management problem: device RAM is too small to hold every agent's KV cache simultaneously. On Apple M4 Pro with 10.2 GB of cache budget, only 3 agents fit at 8K context in FP16. A…

Machine Learning · Computer Science 2026-03-06 Yakov Pyotr Shkolnikov

Monitoring Machine Learning (ML) models in production environments is crucial, yet traditional approaches often yield verbose, low-interpretability outputs that hinder effective decision-making. We propose a cognitive architecture for ML…

Machine Learning · Computer Science 2025-06-12 Gusseppe Bravo-Rocca , Peini Liu , Jordi Guitart , Rodrigo M Carrillo-Larco , Ajay Dholakia , David Ellison

Constructing memory from users' long-term conversations overcomes LLMs' contextual limitations and enables personalized interactions. Recent studies focus on hierarchical memory to model users' multi-granular behavioral patterns via…

Multiagent Systems · Computer Science 2026-01-13 Wenyu Mao , Haosong Tan , Shuchang Liu , Haoyang Liu , Yifan Xu , Huaxiang Ji , Xiang Wang

Long-term memory is essential for conversational agents to maintain coherence, track persistent tasks, and provide personalized interactions across extended dialogues. However, existing approaches as Retrieval-Augmented Generation (RAG) and…

Computation and Language · Computer Science 2026-04-13 Juwei Yue , Chuanrui Hu , Jiawei Sheng , Zuyi Zhou , Wenyuan Zhang , Tingwen Liu , Li Guo , Yafeng Deng

Long-term conversational large language model (LLM) agents require memory systems that can recover relevant evidence from historical interactions without overwhelming the answer stage with irrelevant context. However, existing memory…

Computation and Language · Computer Science 2026-04-23 Shuqi Cao , Jingyi He , Fei Tan