English
Related papers

Related papers: MemX: A Local-First Long-Term Memory System for AI…

200 papers

Recent advances in large reasoning models LRMs have enabled agentic search systems to perform complex multi-step reasoning across multiple sources. However, most studies focus on general information retrieval and rarely explores vertical…

Retrieval-Augmented Generation (RAG) systems typically face constraints because of their inherent mechanism: a simple top-k semantic search [1]. The approach often leads to the incorporation of irrelevant or redundant information in the…

Computation and Language · Computer Science 2025-09-03 Andreas Ottem

Long-term memory is a critical capability for multimodal large language model (MLLM) agents, particularly in conversational settings where information accumulates and evolves over time. However, existing benchmarks either evaluate…

Computation and Language · Computer Science 2026-01-08 Yuanchen Bei , Tianxin Wei , Xuying Ning , Yanjun Zhao , Zhining Liu , Xiao Lin , Yada Zhu , Hendrik Hamann , Jingrui He , Hanghang Tong

Long-horizon agentic reasoning necessitates effectively compressing growing interaction histories into a limited context window. Most existing memory systems serialize history as text, where token-level cost is uniform and scales linearly…

Artificial Intelligence · Computer Science 2026-05-19 Yaorui Shi , Shugui Liu , Yu Yang , Wenyu Mao , Yuxin Chen , Qi GU , Hui Su , Xunliang Cai , Xiang Wang , An Zhang

Long-context Large Language Models, despite their expanded capacity, require careful working memory management to mitigate attention dilution during long-horizon tasks. Yet existing approaches rely on external mechanisms that lack awareness…

Artificial Intelligence · Computer Science 2026-05-08 Yuxiang Zhang , Jiangming Shu , Ye Ma , Xueyuan Lin , Shangxi Wu , Jitao Sang

Memory is essential for enabling large language models to support long-horizon reasoning, yet existing memory systems remain unreliable and difficult to debug. Tracing memory's dynamic evolution is crucial to understand how information is…

Large Language Model (LLM) agent systems have experienced rapid adoption across diverse domains, yet they suffer from critical user experience problems that limit their practical deployment. Through an empirical analysis of over 40,000…

Operating Systems · Computer Science 2026-03-16 Jianshu She

Long-horizon interactions between users and LLM-based assistants necessitate effective memory management, yet current approaches face challenges in training and evaluation of memory. Existing memory benchmarks rely on static, off-policy…

Computation and Language · Computer Science 2026-03-03 Cheng Jiayang , Dongyu Ru , Lin Qiu , Yiyang Li , Xuezhi Cao , Yangqiu Song , Xunliang Cai

We study how to endow GUI agents with scalable memory that help generalize across unfamiliar interfaces and long-horizon tasks. Prior GUI agents compress past trajectories into text tokens, which balloons context length and misses decisive…

Artificial Intelligence · Computer Science 2025-10-13 Wenyi Wu , Kun Zhou , Ruoxin Yuan , Vivian Yu , Stephen Wang , Zhiting Hu , Biwei Huang

LLM-based agents deliver state-of-the-art performance across tasks but incur high end-to-end latency on edge devices. We introduce Agent-X, a software-only, accuracy-preserving framework that accelerates both the prefill and decode stages…

Artificial Intelligence · Computer Science 2026-05-12 Jinha Chung , Byeongjun Shin , Jiin Kim , Minsoo Rhu

Memory-augmented large language models extend reasoning beyond a fixed context window by maintaining long-term memory across interactions. However, existing memory systems often collapse stable user facts, episodic events, and behavioral…

Computation and Language · Computer Science 2026-05-28 Hyeonjeong Ha , Jeonghwan Kim , Cheng Qian , Jiayu Liu , William M. Campbell , Yue Wu , Yuji Zhang , Kathleen McKeown , Dilek Hakkani-Tur , Heng Ji

A practical large language model (LLM) service may involve a long system prompt, which specifies the instructions, examples, and knowledge documents of the task and is reused across requests. However, the long system prompt causes…

Computation and Language · Computer Science 2024-05-31 Lei Zhu , Xinjiang Wang , Wayne Zhang , Rynson W. H. Lau

Large language model-based agents operating in long-horizon interactions require memory systems that support temporal consistency, multi-hop reasoning, and evidence-grounded reuse across sessions. Existing approaches largely rely on…

Computation and Language · Computer Science 2026-01-27 Juexiang Ye , Xue Li , Xinyu Yang , Chengkai Huang , Lanshun Nie , Lina Yao , Dechen Zhan

Large language model (LLM) agents demonstrate strong performance in short-text contexts but often underperform in extended dialogues due to inefficient memory management. Existing approaches face a fundamental trade-off between efficiency…

Artificial Intelligence · Computer Science 2026-05-04 Xiaochen Zhao , Kaikai Wang , Xiaowen Zhang , Chen Yao , Aili Wang

Conversational recommender systems (CRSs) aim to capture user preferences and provide personalized recommendations through multi-round natural language dialogues. However, most existing CRS models mainly focus on dialogue comprehension and…

Information Retrieval · Computer Science 2024-07-09 Yunjia Xi , Weiwen Liu , Jianghao Lin , Bo Chen , Ruiming Tang , Weinan Zhang , Yong Yu

We present a systematic evaluation of large language model families -- spanning both proprietary cloud APIs and locally-hosted open-source models -- on two purpose-built benchmarks for System Dynamics AI assistance: the \textbf{CLD…

Artificial Intelligence · Computer Science 2026-04-22 Terry Leitch

LLM-based conversational AI agents struggle to maintain coherent behavior over long horizons due to limited context. While RAG-based approaches are increasingly adopted to overcome this limitation by storing interactions in external memory…

Artificial Intelligence · Computer Science 2026-05-13 Jiazhou Liang , Armin Toroghi , Yifan Simon Liu , Faeze Moradi Kalarde , Liam Gallagher , Scott Sanner

We present MEMRES, an agentic system for Python dependency resolution that introduces a multi-level confidence cascade where the LLM serves as the last resort. Our system combines: (1) a Self-Evolving Memory that accumulates reusable…

Software Engineering · Computer Science 2026-04-21 Dao Sy Duy Minh , Tran Chi Nguyen , Trung Kiet Huynh , Pham Phu Hoa , Nguyen Lam Phu Quy , Vu Nguyen

Large language models (LLMs) achieve strong performance across a wide range of tasks, but remain frozen after pretraining until subsequent updates. Many real-world applications require timely, domain-specific information, motivating the…

Long-context memory systems often fail under fixed budgets, but end-to-end evaluation does not reveal whether evidence was discarded during compression or preserved but never retrieved. We introduce a four-condition diagnostic protocol that…

Computation and Language · Computer Science 2026-05-26 Jiangnan Yu , Kisson Songqi Lin , Jilong Wu