中文
相关论文

相关论文: Remember the Decision, Not the Description: A Rate…

200 篇论文

Recent advancements in Large Language Models (LLMs) have exhibited notable efficacy in question-answering (QA) tasks across diverse domains. Their prowess in integrating extensive web knowledge has fueled interest in developing LLM-based…

Long-running AI agents need persistent memory. Memory supports learning across sessions, reduces repeated context injection, and enables auditing of past decisions. Current agent memory systems and database paradigms treat memory as…

人工智能 · 计算机科学 2026-05-27 Abdelghny Orogat , Essam Mansour

Language-model-based agents operating over extended interaction horizons face persistent challenges in preserving temporally grounded information and maintaining behavioral consistency across sessions, a failure mode we term soul erosion.…

计算与语言 · 计算机科学 2026-01-29 Yang Li , Jiaxiang Liu , Yusong Wang , Yujie Wu , Mingkun Xu

Driven by the development of persistent, self-adapting autonomous agents, equipping these systems with high-fidelity memory access for long-horizon reasoning has emerged as a critical requirement. However, prevalent retrieval-based memory…

人工智能 · 计算机科学 2026-03-20 Zhixing You , Jiachen Yuan , Jason Cai

Language model (LM)-based agents have demonstrated promising capabilities in automating complex tasks from natural language instructions, yet they continue to struggle with long-horizon planning and reasoning. To address this, we propose an…

人工智能 · 计算机科学 2026-05-05 Wenyi Wu , Sibo Zhu , Kun Zhou , Biwei Huang

All sequential decision-making agents explore so as to acquire knowledge about a particular target. It is often the responsibility of the agent designer to construct this target which, in rich and complex environments, constitutes a onerous…

机器学习 · 计算机科学 2021-10-28 Dilip Arumugam , Benjamin Van Roy

Large language model (LLM) agents are fundamentally bottlenecked by finite context windows on long-horizon tasks. As trajectories grow, retaining tool outputs and intermediate reasoning in-context quickly becomes infeasible: the working…

计算与语言 · 计算机科学 2026-03-05 Zhenting Wang , Huancheng Chen , Jiayun Wang , Wei Wei

Long-term memory systems enable conversational agents based on large language models (LLMs) to retain, retrieve, and apply user-specific information across multi-session interactions. However, existing evaluations mainly assess…

信息检索 · 计算机科学 2026-05-21 Zhen Tao , Jinxiang Zhao , Peng Liu , Dinghao Xi , Yanfang Chen , Wei Xu , Zhiyu Li

In some rate-distortion-type problems, the required fidelity of information is affected by past actions. As a result, the distortion function depends not only on the instantaneous distortion between a source symbol and its representation…

信息论 · 计算机科学 2026-01-30 Hamidreza Abin , Amin Gohari , Andrew W. Eckford

Memory systems for LLM agents struggle to determine what information deserves retention. Existing approaches rely on predefined heuristics such as importance scores, emotional tags, or factual templates, encoding designer intuition rather…

人工智能 · 计算机科学 2026-04-17 Wenquan Ma , Jiayan Nan , Wenlong Wu , Yize Chen

LLM-based conversational agents still struggle to maintain coherent, personalized interaction over many sessions: fixed context windows limit how much history can be kept in view, and most external memory approaches trade off between coarse…

计算与语言 · 计算机科学 2025-12-12 Sizhe Zhou , Jiawei Han

Although Transformers with fully connected self-attentions are powerful to model long-term dependencies, they are struggling to scale to long texts with thousands of words in language modeling. One of the solutions is to equip the model…

计算与语言 · 计算机科学 2022-04-27 Haozhe Ji , Rongsheng Zhang , Zhenyu Yang , Zhipeng Hu , Minlie Huang

Large Language Models (LLMs) often struggle with structural ambiguity in optimization problems, where a single problem admits multiple related but conflicting modeling paradigms, hindering effective solution generation. To address this, we…

计算与语言 · 计算机科学 2026-04-23 Xinyu Zhang , Yuchen Wan , Boxuan Zhang , Zesheng Yang , Lingling Zhang , Bifan Wei , Jun Liu

Long-horizon agents face the challenge of growing context size during interaction with environment, which degrades the performance and stability. Existing methods typically introduce the external memory module and look up the relevant…

人工智能 · 计算机科学 2026-04-10 Ruoran Li , Xinghua Zhang , Haiyang Yu , Shitong Duan , Xiang Li , Wenxin Xiang , Chonghua Liao , Xudong Guo , Yongbin Li , Jinli Suo

Recent advances in persona-centric memory have revealed the powerful capability of multi-agent systems in managing persona memory, especially in conversational scenarios. However, these complex frameworks often suffer from information loss…

计算与语言 · 计算机科学 2026-04-03 Qi Zhang , Shen Huang , Chu Liu , Shouqing Yang , Junbo Zhao , Haobo Wang , Pengjun Xie

Memory plays a central role in enabling large language models (LLMs) to operate over sequential tasks by accumulating and reusing experience over time. However, existing evaluations of LLM memory mostly rely on aggregate metrics such as…

机器学习 · 计算机科学 2026-05-18 Songwei Dong , Zihan Chen , Chengshuai Shi , Peng Wang , Jundong Li , Cong Shen

Long-term memory is crucial for agents in specialized web environments, where success depends on recalling interface affordances, state dynamics, workflows, and recurring failure modes. However, existing memory benchmarks for agents mostly…

计算与语言 · 计算机科学 2026-05-13 Di Wu , Zixiang Ji , Asmi Kawatkar , Bryan Kwan , Jia-Chen Gu , Nanyun Peng , Kai-Wei Chang

Large language model (LLM) agents demonstrate strong performance in short-text contexts but often underperform in extended dialogues due to inefficient memory management. Existing approaches face a fundamental trade-off between efficiency…

人工智能 · 计算机科学 2026-05-04 Xiaochen Zhao , Kaikai Wang , Xiaowen Zhang , Chen Yao , Aili Wang

Although long-term memory systems have made substantial progress in recent years, they still exhibit clear limitations in adaptability, scalability, and self-evolution under continuous interaction settings. Inspired by cognitive theories,…

人工智能 · 计算机科学 2026-01-13 Ningning Zhang , Xingxing Yang , Zhizhong Tan , Weiping Deng , Wenyong Wang

The quintessential model-based reinforcement-learning agent iteratively refines its estimates or prior beliefs about the true underlying model of the environment. Recent empirical successes in model-based reinforcement learning with…

机器学习 · 计算机科学 2022-11-02 Dilip Arumugam , Benjamin Van Roy