English
Related papers

Related papers: Novel Memory Forgetting Techniques for Autonomous …

200 papers

Recent advances in Large Language Models (LLMs) have enabled conversational AI agents to engage in extended multi-turn interactions spanning weeks or months. However, existing memory systems struggle to reason over temporally grounded facts…

Computation and Language · Computer Science 2026-03-18 Sahil Sen , Elias Lumer , Anmol Gulati , Vamse Kumar Subbiah

Long-horizon household tasks demand robust high-level planning and sustained reasoning capabilities, which are largely overlooked by existing embodied AI benchmarks that emphasize short-horizon navigation or manipulation and rely on fixed…

Artificial Intelligence · Computer Science 2026-05-19 Zilin Zhu , Longteng Guo , Yanghong Mei , Bowen Pang , Zongxun Zhang , Xingjian He , Ruyi Ji , Jing Liu

We introduce a lifelong imitation learning framework that enables continual policy refinement across sequential tasks under realistic memory and data constraints. Our approach departs from conventional experience replay by operating…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Fanqi Yu , Matteo Tiezzi , Tommaso Apicella , Cigdem Beyan , Vittorio Murino

Large language model (LLM) agents increasingly rely on accumulated memory to solve long-horizon decision-making tasks. However, most existing approaches store memory in fixed representations and reuse it at a single or implicit level of…

Artificial Intelligence · Computer Science 2026-01-13 Sirui Liang , Pengfei Cao , Jian Zhao , Wenhao Teng , Xiangwen Liao , Jun Zhao , Kang Liu

Large Language Models (LLMs) struggle with long-horizon tasks due to the "context bottleneck" and the "lost-in-the-middle" phenomenon, where accumulated noise from verbose environments degrades reasoning over multi-turn interactions. To…

Artificial Intelligence · Computer Science 2026-04-14 Xiaozhe Li , Tianyi Lyu , Yizhao Yang , Liang Shan , Siyi Yang , Ligao Zhang , Zhuoyi Huang , Qingwen Liu , Yang Li

Recent GUI agents have made substantial progress in visual grounding and action prediction, yet they remain brittle in long-horizon tasks that require maintaining task state across many interface transitions. Existing agents typically rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ziyun Zeng , Hang Hua , Bocheng Zou , Mu Cai , Rogerio Feris , Jiebo Luo

Recent advancements in LLM-powered agents have demonstrated significant potential in generating human-like responses; however, they continue to face challenges in maintaining long-term interactions within complex environments, primarily due…

General-purpose automatic speech recognition (ASR) systems do not always perform well in goal-oriented dialogue. Existing ASR correction methods rely on prior user data or named entities. We extend correction to tasks that have no prior…

Computation and Language · Computer Science 2025-01-13 Yuya Asano , Sabit Hassan , Paras Sharma , Anthony Sicilia , Katherine Atwell , Diane Litman , Malihe Alikhani

Recent vision-language-action (VLA) systems have demonstrated strong capabilities in embodied manipulation. However, most existing VLA policies rely on limited observation windows and end-to-end action prediction, which makes them brittle…

Robotics · Computer Science 2026-04-16 Zhen Liu , Xinyu Ning , Zhe Hu , Xinxin Xie , Weize Li , Zhipeng Tang , Chongyu Wang , Zejun Yang , Hanlin Wang , Yitong Liu , Zhongzhu Pu

Complex, long-horizon planning and its combinatorial nature pose steep challenges for learning-based agents. Difficulties in such settings are exacerbated in low data regimes where over-fitting stifles generalization and compounding errors…

Machine Learning · Computer Science 2023-06-23 Joey Hejna , Pieter Abbeel , Lerrel Pinto

Autonomous LLM agents increasingly operate in long-horizon, interactive settings where success depends on reusing experience accumulated over extended histories. However, existing agent memory systems are fundamentally constrained by…

Computation and Language · Computer Science 2026-04-30 Jinze Li , Yang Zhang , Xin Yang , Jiayi Qu , Jinfeng Xu , Shuo Yang , Junhua Ding , Edith Cheuk-Han Ngai

Large Language Models (LLMs) face significant computational and memory constraints when processing long contexts, despite growing demand for applications requiring reasoning over extensive documents, multi-session dialogues, and book length…

Computation and Language · Computer Science 2026-02-10 Chandra Vamsi Krishna Alla , Harish Naidu Gaddam , Manohar Kommi

We introduce a comprehensive benchmark for conversational memory evaluation containing 75,336 question-answer pairs across diverse categories including user facts, assistant recall, abstention, preferences, temporal changes, and implicit…

Computation and Language · Computer Science 2025-11-14 Egor Pakhomov , Erik Nijkamp , Caiming Xiong

Online reinforcement learning agents are currently able to process an increasing amount of data by converting it into a higher order value functions. This expansion of the information collected from the environment increases the agent's…

Machine Learning · Computer Science 2021-02-04 Mirza Ramicic , Andrea Bonarini

Although LLM agents can leverage tools for complex tasks, they still need memory to maintain cross-turn consistency and accumulate reusable information in long-horizon interactions. However, retrieval-based external memory systems incur low…

Artificial Intelligence · Computer Science 2026-04-23 Jiaquan Zhang , Chaoning Zhang , Shuxu Chen , Zhenzhen Huang , Pengcheng Zheng , Zhicheng Wang , Ping Guo , Fan Mo , Sung-Ho Bae , Jie Zou , Jiwei Wei , Yang Yang

Long-horizon interactions between users and LLM-based assistants necessitate effective memory management, yet current approaches face challenges in training and evaluation of memory. Existing memory benchmarks rely on static, off-policy…

Computation and Language · Computer Science 2026-03-03 Cheng Jiayang , Dongyu Ru , Lin Qiu , Yiyang Li , Xuezhi Cao , Yangqiu Song , Xunliang Cai

In the experts problem, on each of $T$ days, an agent needs to follow the advice of one of $n$ ``experts''. After each day, the loss associated with each expert's advice is revealed. A fundamental result in learning theory says that the…

Data Structures and Algorithms · Computer Science 2023-03-10 Binghui Peng , Aviad Rubinstein

Effective memory management is essential for large language model (LLM) agents handling long-term interactions. Current memory frameworks typically treat agents as passive "recorders" and retrieve information without understanding its…

Computation and Language · Computer Science 2026-03-03 Xiaohui Zhang , Zequn Sun , Chengyuan Yang , Yaqin Jin , Yazhong Zhang , Wei Hu

Large language model (LLM) agents increasingly rely on external memory to support long-horizon interaction, personalized assistance, and multi-step reasoning. However, existing memory systems still face three core challenges: they often…

Computation and Language · Computer Science 2026-04-30 Shannan Yan , Jingchen Ni , Leqi Zheng , Jiajun Zhang , Peixi Wu , Dacheng Yin , Jing Lyu , Chun Yuan , Fengyun Rao

Long-term conversational memory in practical LLM applications is inherently collaborative: information is produced by multiple participants, scattered across groups and channels, revised over time, and implicitly grounded in roles and…

Computation and Language · Computer Science 2026-03-12 Chuanrui Hu , Tong Li , Xingze Gao , Hongda Chen , Yi Bai , Dannong Xu , Tianwei Lin , Xiaohong Li , Yunyun Han , Jian Pei , Yafeng Deng