English
Related papers

Related papers: MemQ: Integrating Q-Learning into Self-Evolving Me…

200 papers

Memory systems have been designed to leverage past experiences in Large Language Model (LLM) agents. However, many deployed memory systems primarily optimize compression and storage, with comparatively less emphasis on explicit, closed-loop…

Artificial Intelligence · Computer Science 2025-12-24 Xingbo Du , Loka Li , Duzhen Zhang , Le Song

Retrieval-Augmented Generation remains the dominant pattern for giving LLMs persistent memory, but a visible cluster of personal wiki-style memory architectures emerged in April 2026 -- design proposals from Karpathy, MemPalace, and LLM…

Artificial Intelligence · Computer Science 2026-04-15 Stefan Miteski

While large language model--powered agents can self-evolve by accumulating experience or by dynamically creating new assets (i.e., tools or expert agents), existing frameworks typically treat these two evolutionary processes in isolation.…

Computation and Language · Computer Science 2026-04-14 Zihao Cheng , Zeming Liu , Yingyu Shan , Xinyi Wang , Xiangrong Zhu , Yunpu Ma , Hongru Wang , Yuhang Guo , Wei Lin , Yunhong Wang

We investigate the feasibility of using Multimodal Large Language Models (MLLMs) for real-time online episodic memory question answering. While cloud offloading is common, it raises privacy and latency concerns for wearable assistants,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Giuseppe Lando , Rosario Forte , Antonino Furnari

Computational resource constraints on edge devices make it difficult to develop a fully embedded AI companion system with a satisfactory user experience. AI companion and memory systems detailed in existing literature cannot be directly…

Artificial Intelligence · Computer Science 2026-01-14 Rahul Gupta , Stephen D. H. Hsu

Current AI agents excel in familiar settings, but fail sharply when faced with novel tasks with unseen vocabularies -- a core limitation of procedural memory systems. We present the first benchmark that isolates procedural memory retrieval…

Computation and Language · Computer Science 2025-12-01 Ishant Kohar , Aswanth Krishnan

Current LLM agents lack principled mechanisms for managing persistent memory across long interaction horizons. We present a biologically-grounded memory architecture comprising six cognitive mechanisms: (1) sleep-phase consolidation, (2)…

Artificial Intelligence · Computer Science 2026-05-12 Doga Kerestecioglu , Alexei Robsky , Clemens Vasters , Anshul Sharma , Yitzhak Kesselman

Large language models (LLMs) increasingly serve as educational tools, yet evaluating their teaching capabilities remains challenging due to the resource-intensive, context-dependent, and methodologically complex nature of teacher-student…

Artificial Intelligence · Computer Science 2025-08-01 Yao Shi , Rongkeng Liang , Yong Xu

Episodic memory is a psychology term which refers to the ability to recall specific events from the past. We suggest one advantage of this particular type of memory is the ability to easily assign credit to a specific state when remembered…

Machine Learning · Computer Science 2018-06-05 Kenny J. Young , Richard S. Sutton , Shuo Yang

LLM-powered agents face a persistent challenge: learning from their execution experiences to improve future performance. While agents can successfully complete many tasks, they often repeat inefficient patterns, fail to recover from similar…

Artificial Intelligence · Computer Science 2026-03-12 Gaodan Fang , Vatche Isahagian , K. R. Jayaram , Ritesh Kumar , Vinod Muthusamy , Punleuk Oum , Gegi Thomas

Reasoning-induced vision-language models (VLMs) advance image quality assessment (IQA) with textual reasoning, yet their scalar scores often lack sensitivity and collapse to a few values, so-called discrete collapse. We introduce ME-IQA, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Kanglong Fan , Tianhe Wu , Wen Wen , Jianzhao Liu , Le Yang , Yabin Zhang , Yiting Liao , Junlin Li , Li Zhang

Large language models (LLMs) have emerged as effective action policies for sequential decision-making (SDM) tasks due to their extensive prior knowledge. However, this broad yet general knowledge is often insufficient for specific…

Machine Learning · Computer Science 2025-10-01 Xue Yan , Zijing Ou , Mengyue Yang , Yan Song , Haifeng Zhang , Yingzhen Li , Jun Wang

Current deep neural networks can achieve remarkable performance on a single task. However, when the deep neural network is continually trained on a sequence of tasks, it seems to gradually forget the previous learned knowledge. This…

Machine Learning · Computer Science 2020-12-16 Yunhui Guo , Mingrui Liu , Tianbao Yang , Tajana Rosing

Under a unified operational definition, we define LLM memory as a persistent state written during pretraining, finetuning, or inference that can later be addressed and that stably influences outputs. We propose a four-part taxonomy…

Artificial Intelligence · Computer Science 2025-09-24 Dianxing Zhang , Wendong Li , Kani Song , Jiaye Lu , Gang Li , Liuchun Yang , Sheng Li

Driven by the development of persistent, self-adapting autonomous agents, equipping these systems with high-fidelity memory access for long-horizon reasoning has emerged as a critical requirement. However, prevalent retrieval-based memory…

Artificial Intelligence · Computer Science 2026-03-20 Zhixing You , Jiachen Yuan , Jason Cai

Large language models (LLMs) have shown remarkable capabilities, but still struggle with processing extensive contexts, limiting their ability to maintain coherence and accuracy over long sequences. In contrast, the human brain excels at…

Personalizing language models by effectively incorporating user interaction history remains a central challenge in the development of adaptive AI systems. While large language models (LLMs), combined with Retrieval-Augmented Generation…

Computation and Language · Computer Science 2026-04-14 Mikhail Menschikov , Dmitry Evseev , Victoria Dochkina , Ruslan Kostoev , Ilia Perepechkin , Petr Anokhin , Nikita Semenov , Evgeny Burnaev

Inspired by the cognitive science theory of the explicit human memory systems, we have modeled an agent with short-term, episodic, and semantic memory systems, each of which is modeled with a knowledge graph. To evaluate this system and…

Artificial Intelligence · Computer Science 2026-05-19 Taewoon Kim , Michael Cochez , Vincent François-Lavet , Mark Neerincx , Piek Vossen

Large language models (LLMs) have revolutionized AI, but are constrained by limited context windows, hindering their utility in tasks like extended conversations and document analysis. To enable using context beyond limited context windows,…

Artificial Intelligence · Computer Science 2024-02-13 Charles Packer , Sarah Wooders , Kevin Lin , Vivian Fang , Shishir G. Patil , Ion Stoica , Joseph E. Gonzalez

The ability to form, retrieve, and reason about memories in response to stimuli serves as the cornerstone for general intelligence - shaping entities capable of learning, adaptation, and intuitive insight. Large Language Models (LLMs) have…

Computation and Language · Computer Science 2024-09-25 Brendan Hogan Rappazzo , Yingheng Wang , Aaron Ferber , Carla Gomes