English
Related papers

Related papers: Preference-Aware Memory Update for Long-Term LLM A…

200 papers

Conversational agents struggle to handle long conversations due to context window limitations. Therefore, memory systems are developed to leverage essential historical information. Existing memory systems typically follow a pipeline of…

Computation and Language · Computer Science 2026-01-30 Yimin Deng , Yuqing Fu , Derong Xu , Yejing Wang , Wei Ni , Jingtong Gao , Xiaopeng Li , Chengxu Liu , Xiao Han , Guoshuai Zhao , Xiangyu Zhao , Li Zhu , Xueming Qian

Large Language Models (LLMs) are increasingly used as autonomous agents in complex, long-horizon applications, where effective memory is critical for sustained performance. Yet existing memory benchmarks are largely dialogue-centric, while…

Large Language Models (LLMs) face a crucial challenge from fixed context windows and inadequate memory management, leading to a severe shortage of long-term memory capabilities and limited personalization in the interactive experience with…

Artificial Intelligence · Computer Science 2025-06-10 Jiazheng Kang , Mingming Ji , Zhe Zhao , Ting Bai

Advances in large language models are making personalized AI agents a new research focus. While current agent systems primarily rely on personalized external memory databases to deliver customized experiences, they face challenges such as…

Computation and Language · Computer Science 2025-11-03 Junfeng Lu , Yueyan Li

Intelligent devices have become deeply integrated into everyday life, generating vast amounts of user interactions that form valuable personal knowledge. Efficient organization of this knowledge in user memory is essential for enabling…

Computation and Language · Computer Science 2026-02-13 Yijie Zhong , Mengying Guo , Zewei Wang , Zhongyang Li , Dandan Tu , Haofen Wang

Multimodal Large Language Models (MLLMs) serve as daily assistants for millions. However, their ability to generate responses aligned with individual preferences remains limited. Prior approaches enable only static, single-turn…

Computation and Language · Computer Science 2026-04-16 Chang Nie , Chaoyou Fu , Yifan Zhang , Haihua Yang , Caifeng Shan

Despite significant advancements in large language models (LLMs), the rapid and frequent integration of small-scale experiences, such as interactions with surrounding objects, remains a substantial challenge. Two critical factors in…

Computation and Language · Computer Science 2025-02-24 Yu Wang , Xinshuang Liu , Xiusi Chen , Sean O'Brien , Junda Wu , Julian McAuley

Autonomous LLM agents require structured long-term memory, yet current "append-and-evolve" systems like A-MEM face O(N^2) write-latency and excessive token costs. We introduce D-MEM (Dopamine-Gated Agentic Memory), a biologically inspired…

Neurons and Cognition · Quantitative Biology 2026-03-17 Yuru Song , Qi Xin

Large Language Models (LLMs) have made extraordinary progress in the field of Artificial Intelligence and have demonstrated remarkable capabilities across a large variety of tasks and domains. However, as we venture closer to creating…

Artificial Intelligence · Computer Science 2023-10-04 Brandon Kynoch , Hugo Latapie , Dwane van der Sluis

Large Language Model (LLM) agents are increasingly used in real-world products, where personalized and context-aware user interactions are essential. A central enabler of such capabilities is the agent's long-term semantic memory system,…

Information Retrieval · Computer Science 2026-05-27 Zhentao Xu , Shangjin Zhang , Emir Poyraz , Yvonne Li , Ye Jin , Xie Lu , Xiaoyang Gu , Karthik Ramgopal , Praveen Kumar Bodigutla , Xiaofeng Wang

Human preference alignment is essential to improve the interaction quality of large language models (LLMs). Existing alignment methods depend on manually annotated preference data to guide the LLM optimization directions. However,…

Computation and Language · Computer Science 2024-06-04 Pengyu Cheng , Yifan Yang , Jian Li , Yong Dai , Tianhao Hu , Peixin Cao , Nan Du , Xiaolong Li

Open-domain dialogue systems have seen remarkable advancements with the development of large language models (LLMs). Nonetheless, most existing dialogue systems predominantly focus on brief single-session interactions, neglecting the…

Computation and Language · Computer Science 2025-02-14 Hao Li , Chenghao Yang , An Zhang , Yang Deng , Xiang Wang , Tat-Seng Chua

Alignment plays a crucial role in Large Language Models (LLMs) in aligning with human preferences on a specific task/domain. Traditional alignment methods suffer from catastrophic forgetting, where models lose previously acquired knowledge…

Computation and Language · Computer Science 2026-04-09 Junsong Li , Jie Zhou , Bihao Zhan , Yutao Yang , Qianjun Pan , Shilian Chen , Tianyu Huai , Xin Li , Qin Chen , Liang He

Leveraging Large Language Models (LLMs) to harness user-item interaction histories for item generation has emerged as a promising paradigm in generative recommendation. However, the limited context window of LLMs often restricts them to…

Information Retrieval · Computer Science 2025-04-30 Chengbing Wang , Yang Zhang , Fengbin Zhu , Jizhi Zhang , Tianhao Shi , Fuli Feng

The deployment of Large Language Models (LLMs) in interactive systems necessitates a deep alignment with the nuanced and dynamic preferences of individual users. Current alignment techniques predominantly address universal human values or…

Computation and Language · Computer Science 2025-12-18 Xiaotian Zhang , Yuan Wang , Ruizhe Chen , Zeya Wang , Runchen Hou , Zuozhu Liu

Memory management is vital for LLM agents to handle long-term interaction and personalization. Most research focuses on how to organize and use memory summary, but often overlooks the initial memory extraction stage. In this paper, we argue…

Computation and Language · Computer Science 2026-01-09 Chengyuan Yang , Zequn Sun , Wei Wei , Wei Hu

Pre-trained language models (PLMs) show impressive performance in various downstream NLP tasks. However, pre-training large language models demands substantial memory and training compute. Furthermore, due to the substantial resources…

Computation and Language · Computer Science 2024-04-01 HyunJin Kim , Young Jin Kim , JinYeong Bak

The widespread adoption of Large Language Models (LLMs) has exponentially increased the demand for efficient serving systems. With growing requests and context lengths, key-value (KV)-related operations, including attention computation and…

Hardware Architecture · Computer Science 2026-02-13 Lian Liu , Shixin Zhao , Yutian Zhou , Yintao He , Mengdi Wang , Yinhe Han , Ying Wang

External memory systems are pivotal for enabling Large Language Model (LLM) agents to maintain persistent knowledge and perform long-horizon decision-making. Existing paradigms typically follow a two-stage process: computationally expensive…

Machine Learning · Computer Science 2026-04-27 Xiucheng Xu , Bingbing Xu , Xueyun Tian , Zihe Huang , Rongxin Chen , Yunfan Li , Huawei Shen

Foundation models are increasingly used to personalize learning, yet many systems still assume fixed curricula or coarse progress signals, limiting alignment with learners' day-to-day needs. At the other extreme, lightweight incidental…

Human-Computer Interaction · Computer Science 2025-11-27 Justin Cui , Kevin Pu , Tovi Grossman