English
Related papers

Related papers: FadeMem: Biologically-Inspired Forgetting for Effi…

200 papers

Open-domain dialogue systems have seen remarkable advancements with the development of large language models (LLMs). Nonetheless, most existing dialogue systems predominantly focus on brief single-session interactions, neglecting the…

Computation and Language · Computer Science 2025-02-14 Hao Li , Chenghao Yang , An Zhang , Yang Deng , Xiang Wang , Tat-Seng Chua

Deploying Multimodal Large Language Models as the brain of embodied agents remains challenging, particularly under long-horizon observations and limited context budgets. Existing memory assisted methods often rely on textual summaries,…

Robotics · Computer Science 2026-03-03 Ji Li , Bo Wang , Jing Xia , Mingyi Li , Shiyan Hu

Memory, a fundamental component of human cognition, exhibits adaptive yet fallible characteristics as illustrated by Schacter's memory "sins".These cognitive phenomena have been studied extensively in psychology and neuroscience, but the…

Neurons and Cognition · Quantitative Biology 2025-10-23 Zhaoyang Cao , Lael Schooler , Reza Zafarani

Large language model (LLM) agents still struggle with long-term memory question answering, where answer-supporting evidence is often scattered across long conversational histories and buried in substantial irrelevant content. Existing…

Computation and Language · Computer Science 2026-05-22 Jianing Yin , Tan Tang

Long-horizon dialogue systems suffer from semanticdrift and unstable memory retention across extended sessions. This paper presents a Multi-Layer Memory Framework that decomposes dialogue history into working, episodic, and semantic layers…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Sunil Tiwari , Payal Fofadiya

Agentic systems powered by Large Language Models (LLMs) have shown strong potential in recommender systems but remain hindered by several challenges. Fine-tuning LLMs is parameter-inefficient, and prompt-based agentic reasoning is limited…

Information Retrieval · Computer Science 2026-02-10 Minh-Duc Nguyen , Hai-Dang Kieu , Dung D. Le

To enable reliable long-term interaction, LLM agents require a memory system that can faithfully store, efficiently retrieve, and deeply reason over accumulated dialogue history. Most existing methods adopt an extracted fact based paradigm:…

Computation and Language · Computer Science 2026-05-20 Jingwei Sun , Jianing Zhu , Jiangchao Yao , Tongliang Liu , Bo Han

Continual learning agents with finite capacity must balance acquiring new knowledge with retaining the old. This requires controlled forgetting of knowledge that is no longer needed, freeing up capacity to learn. Weight decay, viewed as a…

Machine Learning · Computer Science 2026-05-01 Aditya A. Ramesh , Alex Lewandowski , Jürgen Schmidhuber

As the general capabilities of artificial intelligence (AI) agents continue to evolve, their ability to learn to master multiple complex tasks through experience remains a key challenge. Current LLM agents, particularly those based on…

Machine Learning · Computer Science 2025-05-29 Minttu Alakuijala , Ya Gao , Georgy Ananov , Samuel Kaski , Pekka Marttinen , Alexander Ilin , Harri Valpola

Large language models face challenges in long-context question answering, where key evidence of a query may be dispersed across millions of tokens. Existing works equip large language models with a memory buffer that is dynamically updated…

Computation and Language · Computer Science 2026-03-03 Yaorui Shi , Yuxin Chen , Siyuan Wang , Sihang Li , Hengxing Cai , Qi Gu , Xiang Wang , An Zhang

We introduce EgoMem, the first lifelong memory agent tailored for full-duplex models that process real-time omnimodal streams. EgoMem enables real-time models to recognize multiple users directly from raw audiovisual streams, to provide…

Artificial Intelligence · Computer Science 2026-02-02 Yiqun Yao , Naitong Yu , Xiang Li , Xin Jiang , Xuezhi Fang , Wenjia Ma , Xuying Meng , Jing Li , Aixin Sun , Yequan Wang

Large language models (LLMs) are increasingly deployed in multi-turn dialogue settings, yet their behavior remains bottlenecked by naive history management strategies. Replaying the full conversation at every turn is simple but costly,…

Computation and Language · Computer Science 2025-12-29 Christopher Cruz

Embodied AI agents responsible for executing interconnected, long-sequence household tasks often face difficulties with in-context memory, leading to inefficiencies and errors in task execution. To address this issue, we introduce KARMA, an…

Robotics · Computer Science 2025-03-24 Zixuan Wang , Bo Yu , Junzhe Zhao , Wenhao Sun , Sai Hou , Shuai Liang , Xing Hu , Yinhe Han , Yiming Gan

While role-playing agents excel in short-term interactions, long-term conversations overwhelm context windows, motivating external memory frameworks. Current systems typically rely on persona-agnostic summarization, which records facts…

Computation and Language · Computer Science 2026-05-26 Rongsheng Zhang , Ruofan Hu , Weijie Chen , Jiji Tang , Junnan Ren , Wanying Wu , Xunuoyan Chen , Tangjie Lv , Tao Jin , Zhou Zhao

Large language models (LLMs) have recently demonstrated impressive capabilities in reasoning tasks. Currently, mainstream LLM reasoning frameworks predominantly focus on scaling up inference-time sampling to enhance performance. In…

Computation and Language · Computer Science 2026-03-24 Hongduan Tian , Xiao Feng , Ziyuan Zhao , Xiangyu Zhu , Rolan Yan , Bo Han

Reasoning over ultra-long documents requires synthesizing sparse evidence scattered across distant segments under strict memory constraints. While streaming agents enable scalable processing, their passive memory update strategy often fails…

Computation and Language · Computer Science 2026-02-04 Xinyu Wang , Mingze Li , Peng Lu , Xiao-Wen Chang , Lifeng Shang , Jinping Li , Fei Mi , Prasanna Parthasarathi , Yufei Cui

Personalized and continuous interactions are critical for LLM-based conversational agents, yet finite context windows and static parametric memory hinder the modeling of long-term, cross-session user states. Existing approaches, including…

Artificial Intelligence · Computer Science 2026-02-03 Ao Tian , Yunfeng Lu , Xinxin Fan , Changhao Wang , Lanzhi Zhou , Yeyao Zhang , Yanfang Liu

Multimodal large language models are increasingly deployed as long-horizon agents, where memory must do more than recall: it must track an evolving world, revise what has gone stale, and surface the right evidence at decision time. Existing…

Large Language Models (LLMs) possess remarkable generalization capabilities but struggle with multi-task adaptation, particularly in balancing knowledge retention with task-specific specialization. Conventional fine-tuning methods suffer…

Artificial Intelligence · Computer Science 2025-10-21 Dayan Pan , Zhaoyang Fu , Jingyuan Wang , Xiao Han , Yue Zhu , Xiangyu Zhao

External memory is a key component of modern large language model (LLM) systems, enabling long-term interaction and personalization. Despite its importance, memory management is still largely driven by hand-designed heuristics, offering…

Computation and Language · Computer Science 2025-12-29 Changzhi Sun , Xiangyu Chen , Jixiang Luo , Dell Zhang , Xuelong Li