中文
相关论文

相关论文: What Deserves Memory: Adaptive Memory Distillation…

200 篇论文

Large language model (LLM) based agents have recently attracted much attention from the research and industry communities. Compared with original LLMs, LLM-based agents are featured in their self-evolving capability, which is the basis for…

人工智能 · 计算机科学 2024-04-23 Zeyu Zhang , Xiaohe Bo , Chen Ma , Rui Li , Xu Chen , Quanyu Dai , Jieming Zhu , Zhenhua Dong , Ji-Rong Wen

LLM-powered agents face a persistent challenge: learning from their execution experiences to improve future performance. While agents can successfully complete many tasks, they often repeat inefficient patterns, fail to recover from similar…

人工智能 · 计算机科学 2026-03-12 Gaodan Fang , Vatche Isahagian , K. R. Jayaram , Ritesh Kumar , Vinod Muthusamy , Punleuk Oum , Gegi Thomas

Long-term multi-agent systems inevitably generate vast amounts of trajectories and historical interactions, which makes efficient memory management essential for both performance and scalability. Existing methods typically depend on vector…

人工智能 · 计算机科学 2025-09-29 Haoran Xu , Jiacong Hu , Ke Zhang , Lei Yu , Yuxin Tang , Xinyuan Song , Yiqun Duan , Lynn Ai , Bill Shi

The evolution of recommender systems has shifted from traditional collaborative filtering to LLM-based agentic systems, which rely on semantic user and item memories to make predictions. However, existing agents maintain these memories in…

信息检索 · 计算机科学 2026-04-29 Weixin Chen , Yuhan Zhao , Jingyuan Huang , Zihe Ye , Clark Mingxuan Ju , Tong Zhao , Neil Shah , Li Chen , Yongfeng Zhang

Human memory adapts through selective forgetting: experiences become less accessible over time but can be reactivated by reinforcement or contextual cues. In contrast, memory-augmented LLM agents rely on "always-on" retrieval and "flat"…

计算与语言 · 计算机科学 2026-04-21 Ashish Rana , Chia-Chien Hung , Qumeng Sun , Julian Martin Kunkel , Carolin Lawrence

Long-term memory is one of the key factors influencing the reasoning capabilities of Large Language Model Agents (LLM Agents). Incorporating a memory mechanism that effectively integrates past interactions can significantly enhance…

计算与语言 · 计算机科学 2025-08-01 Haoran Sun , Shaoning Zeng

We study a sequential mechanism design problem in which a principal seeks to elicit truthful reports from multiple rational agents while starting with no prior knowledge of agents' beliefs. We introduce Distributionally Robust Adaptive…

计算机科学与博弈论 · 计算机科学 2026-04-22 Qiushi Han , David Simchi-Levi , Renfei Tan , Zishuo Zhao

Large Language Model (LLM)-based agents have fundamentally reshaped artificial intelligence by integrating external tools and planning capabilities. While memory mechanisms have emerged as the architectural cornerstone of these systems,…

人工智能 · 计算机科学 2026-05-11 Jinghao Luo , Yuchen Tian , Chuxue Cao , Ziyang Luo , Hongzhan Lin , Kaixin Li , Chuyi Kong , Ruichao Yang , Jing Ma

While current large language models (LLMs) perform well on many knowledge-related tasks, they are limited by relying on their parameters as an implicit storage mechanism. As a result, they struggle with memorizing rare events and with…

计算与语言 · 计算机科学 2025-04-18 Ali Modarressi , Abdullatif Köksal , Ayyoob Imani , Mohsen Fayyaz , Hinrich Schütze

As the general capabilities of artificial intelligence (AI) agents continue to evolve, their ability to learn to master multiple complex tasks through experience remains a key challenge. Current LLM agents, particularly those based on…

机器学习 · 计算机科学 2025-05-29 Minttu Alakuijala , Ya Gao , Georgy Ananov , Samuel Kaski , Pekka Marttinen , Alexander Ilin , Harri Valpola

Large language model (LLM) agents require long-term user memory for consistent personalization, but limited context windows hinder tracking evolving preferences over long interactions. Existing memory systems mainly rely on static,…

计算与语言 · 计算机科学 2026-05-04 Derong Xu , Shuochen Liu , Pengfei Luo , Pengyue Jia , Yingyi Zhang , Yi Wen , Yimin Deng , Wenlin Zhang , Enhong Chen , Xiangyu Zhao , Tong Xu

Reward models (RMs) play a pivotal role in aligning large language models (LLMs) with human preferences. Due to the difficulty of obtaining high-quality human preference annotations, distilling preferences from generative LLMs has emerged…

计算与语言 · 计算机科学 2026-01-21 Hongli Zhou , Hui Huang , Wei Liu , Chenglong Wang , Xingyuan Bu , Lvyuan Han , Fuhai Song , Muyun Yang , Wenhao Jiang , Hailong Cao , Tiejun Zhao

While large language model (LLM) agents can effectively use external tools for complex real-world tasks, they require memory systems to leverage historical experiences. Current memory systems enable basic storage and retrieval but lack…

计算与语言 · 计算机科学 2025-10-09 Wujiang Xu , Zujie Liang , Kai Mei , Hang Gao , Juntao Tan , Yongfeng Zhang

Memory is the process of encoding, storing, and retrieving information, allowing humans to retain experiences, knowledge, skills, and facts over time, and serving as the foundation for growth and effective interaction with the world. It…

信息检索 · 计算机科学 2025-04-24 Yaxiong Wu , Sheng Liang , Chen Zhang , Yichao Wang , Yongyue Zhang , Huifeng Guo , Ruiming Tang , Yong Liu

Memory-augmented Large Language Models (LLMs) are essential for developing capable, long-term AI agents. Recently, applying Reinforcement Learning (RL) to optimize memory operations, such as extraction, updating, and retrieval, has emerged…

计算与语言 · 计算机科学 2026-04-08 Ziliang Guo , Ziheng Li , Bo Tang , Feiyu Xiong , Zhiyu Li

For LLM agents, memory management critically impacts efficiency, quality, and security. While much research focuses on retention, selective forgetting--inspired by human cognitive processes (hippocampal indexing/consolidation theory and…

人工智能 · 计算机科学 2026-04-24 Yingjie Gu , Wenjian Xiong , Liqiang Wang , Pengcheng Ren , Chao Li , Xiaojing Zhang , Yijuan Guo , Qi Sun , Jingyao Ma , Shidang Shi

Large Language Models (LLMs) represent a landmark achievement in Artificial Intelligence (AI), demonstrating unprecedented proficiency in procedural tasks such as text generation, code completion, and conversational coherence. These…

人工智能 · 计算机科学 2025-05-07 Schaun Wheeler , Olivier Jeunen

Memory plays a key role in enhancing LLMs' performance when deployed to real-world applications. Existing solutions face trade-offs: explicit memory designs based on external storage require complex management and incur storage overhead,…

计算与语言 · 计算机科学 2025-02-25 Xiaoqiang Wang , Suyuchen Wang , Yun Zhu , Bang Liu

Large Language Models (LLMs) are often evaluated against ideals of perfect Bayesian inference, yet growing evidence suggests that their in-context reasoning exhibits systematic forgetting of past information. Rather than viewing this…

计算与语言 · 计算机科学 2026-04-08 Alexandros Christoforos

As LLM-based agents are increasingly used in long-term interactions, cumulative memory is critical for enabling personalization and maintaining stylistic consistency. However, most existing systems adopt an ``all-or-nothing'' approach to…