English
Related papers

Related papers: Adaptive Memory Admission Control for LLM Agents

200 papers

Large language models (LLMs) have recently demonstrated impressive capabilities in reasoning tasks. Currently, mainstream LLM reasoning frameworks predominantly focus on scaling up inference-time sampling to enhance performance. In…

Computation and Language · Computer Science 2026-03-24 Hongduan Tian , Xiao Feng , Ziyuan Zhao , Xiangyu Zhu , Rolan Yan , Bo Han

Modern LLM-based agents and chat assistants rely on long-term memory frameworks to store reusable knowledge, recall user preferences, and augment reasoning. As researchers create more complex memory architectures, it becomes increasingly…

Machine Learning · Computer Science 2026-05-25 Alina Shutova , Alexandra Olenina , Ivan Vinogradov , Anton Sinitsin

Large Language Models (LLMs) are increasingly used as autonomous agents in complex, long-horizon applications, where effective memory is critical for sustained performance. Yet existing memory benchmarks are largely dialogue-centric, while…

Multi-agent systems built on Large Language Models (LLMs) show exceptional promise for complex collaborative problem-solving, yet they face fundamental challenges stemming from context window limitations that impair memory consistency, role…

Artificial Intelligence · Computer Science 2026-01-13 Sizhe Yuen , Francisco Gomez Medina , Ting Su , Yali Du , Adam J. Sobey

Large language model (LLM) agents increasingly rely on external memory to support long-horizon interaction, personalized assistance, and multi-step reasoning. However, existing memory systems still face three core challenges: they often…

Computation and Language · Computer Science 2026-04-30 Shannan Yan , Jingchen Ni , Leqi Zheng , Jiajun Zhang , Peixi Wu , Dacheng Yin , Jing Lyu , Chun Yuan , Fengyun Rao

Long-term memory is one of the key factors influencing the reasoning capabilities of Large Language Model Agents (LLM Agents). Incorporating a memory mechanism that effectively integrates past interactions can significantly enhance…

Computation and Language · Computer Science 2025-08-01 Haoran Sun , Shaoning Zeng

Autonomous AI agents operating in dynamic environments face a persistent challenge: acquiring new capabilities without erasing prior knowledge. We present Adaptive Memory Crystallization (AMC), a memory architecture for progressive…

Machine Learning · Computer Science 2026-04-16 Rajat Khanda , Mohammad Baqar Sambuddha Chakrabarti , Satyasaran Changdar

Large language model (LLM) agents increasingly rely on accumulated memory to solve long-horizon decision-making tasks. However, most existing approaches store memory in fixed representations and reuse it at a single or implicit level of…

Artificial Intelligence · Computer Science 2026-01-13 Sirui Liang , Pengfei Cao , Jian Zhao , Wenhao Teng , Xiangwen Liao , Jun Zhao , Kang Liu

One of the key factors influencing the reasoning capabilities of LLM-based agents is their ability to leverage long-term memory. Integrating long-term memory mechanisms allows agents to make informed decisions grounded in historical…

Computation and Language · Computer Science 2025-10-14 Haoran Sun , Zekun Zhang , Shaoning Zeng

LLM-based agent applications have shown increasingly remarkable capabilities in complex workflows but incur substantial costs and latency due to extensive planning and reasoning requirements. Existing LLM caching techniques (like context…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-28 Qizheng Zhang , Michael Wornow , Gerry Wan , Kunle Olukotun

Lifelong learning, also known as continual or incremental learning, is a crucial component for advancing Artificial General Intelligence (AGI) by enabling systems to continuously adapt in dynamic environments. While large language models…

Artificial Intelligence · Computer Science 2026-01-13 Junhao Zheng , Chengming Shi , Xidi Cai , Qiuke Li , Duzhen Zhang , Chenxing Li , Dong Yu , Qianli Ma

Retrieval-augmented generation (RAG) has become the default strategy for providing large language model (LLM) agents with contextual knowledge. Yet RAG treats memory as a stateless lookup table: information persists indefinitely, retrieval…

Artificial Intelligence · Computer Science 2026-01-16 Joe Logan

In this study, we propose a novel human-like memory architecture designed for enhancing the cognitive abilities of large language model based dialogue agents. Our proposed architecture enables agents to autonomously recall memories…

Human-Computer Interaction · Computer Science 2024-04-02 Yuki Hou , Haruki Tamoto , Homei Miyashita

Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of NLP tasks, but they remain fundamentally stateless, constrained by limited context windows that hinder long-horizon reasoning. Recent efforts to…

Large Language Models (LLMs) have achieved remarkable advancements in natural language processing tasks, yet they encounter challenges in complex decision-making scenarios that require long-term reasoning and alignment with high-level…

Computation and Language · Computer Science 2025-06-10 Heng Dong , Kefei Duan , Chongjie Zhang

Memory systems are critical for LLMs, mitigating context window limitations and supporting long-horizon user-LLM interactions. Such systems typically comprise multiple agents responsible for memory construction and retrieval. Existing…

Multiagent Systems · Computer Science 2026-04-28 Wenyu Mao , Haoyang Liu , Haosong Tan , Yaorui Shi , Jiancan Wu , An Zhang , Xiang Wang

External memory is a key component of modern large language model (LLM) systems, enabling long-term interaction and personalization. Despite its importance, memory management is still largely driven by hand-designed heuristics, offering…

Computation and Language · Computer Science 2025-12-29 Changzhi Sun , Xiangyu Chen , Jixiang Luo , Dell Zhang , Xuelong Li

Large Language Model (LLM) has exhibited strong reasoning ability in text-based contexts across various domains, yet the limitation of context window poses challenges for the model on long-range inference tasks and necessitates a memory…

Information Retrieval · Computer Science 2026-03-11 Mengwei Yuan , Jianan Liu , Jing Yang , Xianyou Li , Weiran Yan , Yichao Wu , Penghao Liang

For LLM agents, memory management critically impacts efficiency, quality, and security. While much research focuses on retention, selective forgetting--inspired by human cognitive processes (hippocampal indexing/consolidation theory and…

Artificial Intelligence · Computer Science 2026-04-24 Yingjie Gu , Wenjian Xiong , Liqiang Wang , Pengcheng Ren , Chao Li , Xiaojing Zhang , Yijuan Guo , Qi Sun , Jingyao Ma , Shidang Shi

As Large Language Models (LLMs) evolve from text-completion tools into fully fledged agents operating in dynamic environments, they must address the challenge of continually learning and retaining long-term knowledge. Many biological…

Artificial Intelligence · Computer Science 2025-02-12 Mathis Pink , Qinyuan Wu , Vy Ai Vo , Javier Turek , Jianing Mu , Alexander Huth , Mariya Toneva