English
Related papers

Related papers: Mem-Gallery: Benchmarking Multimodal Long-Term Con…

200 papers

Large Language Models (LLMs) based agents excel at diverse tasks, yet they suffer from brittle procedural memory that is manually engineered or entangled in static parameters. In this work, we investigate strategies to endow agents with a…

Computation and Language · Computer Science 2026-04-16 Runnan Fang , Yuan Liang , Xiaobin Wang , Jialong Wu , Shuofei Qiao , Pengjun Xie , Fei Huang , Huajun Chen , Ningyu Zhang

An effective healthcare agent must be able to recall and reason over a patient's longitudinal medical history. However, the absence of datasets with realistic long-term dialogue timelines limits systematic evaluation. Real clinical text is…

Computation and Language · Computer Science 2026-05-20 Hebin Hu , Renke Dai , Ah-Hwee Tan , Yilin Kang

Memory-augmented large language models extend reasoning beyond a fixed context window by maintaining long-term memory across interactions. However, existing memory systems often collapse stable user facts, episodic events, and behavioral…

Computation and Language · Computer Science 2026-05-28 Hyeonjeong Ha , Jeonghwan Kim , Cheng Qian , Jiayu Liu , William M. Campbell , Yue Wu , Yuji Zhang , Kathleen McKeown , Dilek Hakkani-Tur , Heng Ji

Large Language Models (LLMs) excel at generating coherent text within a single prompt but fall short in sustaining relevance, personalization, and continuity across extended interactions. Human communication, however, relies on multiple…

Computation and Language · Computer Science 2025-12-05 Stefano Zeppieri

Large language model (LLM) agents face fundamental limitations in long-horizon reasoning due to finite context windows, making effective memory management critical. Existing methods typically handle long-term memory (LTM) and short-term…

Computation and Language · Computer Science 2026-05-01 Yi Yu , Liuyi Yao , Yuexiang Xie , Qingquan Tan , Jiaqi Feng , Yaliang Li , Libing Wu

Open-domain dialogue systems have seen remarkable advancements with the development of large language models (LLMs). Nonetheless, most existing dialogue systems predominantly focus on brief single-session interactions, neglecting the…

Computation and Language · Computer Science 2025-02-14 Hao Li , Chenghao Yang , An Zhang , Yang Deng , Xiang Wang , Tat-Seng Chua

Large Language Models (LLMs) are constrained by their inability to process lengthy inputs, resulting in the loss of critical historical information. To address this limitation, in this paper, we propose the Self-Controlled Memory (SCM)…

Computation and Language · Computer Science 2025-03-19 Bing Wang , Xinnian Liang , Jian Yang , Hui Huang , Shuangzhi Wu , Peihao Wu , Lu Lu , Zejun Ma , Zhoujun Li

Long-term conversational memory is a core capability for LLM-based dialogue systems, yet existing benchmarks and evaluation protocols primarily focus on surface-level factual recall. In realistic interactions, appropriate responses often…

Computation and Language · Computer Science 2026-02-12 Yifei Li , Weidong Guo , Lingling Zhang , Rongman Xu , Muye Huang , Hui Liu , Lijiao Xu , Yu Xu , Jun Liu

Memory is a critical component in large language model (LLM)-based agents, enabling them to store and retrieve past executions to improve task performance over time. In this paper, we conduct an empirical study on how memory management…

Artificial Intelligence · Computer Science 2025-10-14 Zidi Xiong , Yuping Lin , Wenya Xie , Pengfei He , Zirui Liu , Jiliang Tang , Himabindu Lakkaraju , Zhen Xiang

Existing large language model (LLM) based memory systems apply universal, static policies that overlook a fundamental reality: the contexts that are worth storing in memory are different across users. This misalignment wastes limited memory…

Artificial Intelligence · Computer Science 2026-05-26 Yeonjun In , Wonjoong Kim , Sangwu Park , Kanghoon Yoon , Chanyoung Park

Recent works on context and memory benchmarking have primarily focused on conversational instances but the need for evaluating memory in dynamic enterprise environments is crucial for its effective application. We introduce MEMTRACK, a…

Artificial Intelligence · Computer Science 2025-10-03 Darshan Deshpande , Varun Gangal , Hersh Mehta , Anand Kannappan , Rebecca Qian , Peng Wang

Memory is fundamental to large language model (LLM)-based agents, but existing surveys emphasize application-level use (e.g., personalized dialogue), while overlooking the atomic operations governing memory dynamics. This work categorizes…

Computation and Language · Computer Science 2025-12-25 Yiming Du , Wenyu Huang , Danna Zheng , Zhaowei Wang , Sebastien Montella , Mirella Lapata , Kam-Fai Wong , Jeff Z. Pan

The evolution of Large Language Models (LLMs) into autonomous agents necessitates the management of extensive, dynamic contexts. Current benchmarks, however, remain largely static, relying on passive retrieval tasks that fail to simulate…

Computation and Language · Computer Science 2026-02-02 Shicheng Fang , Yuxin Wang , Xiaoran Liu , Jiahao Lu , Chuanyuan Tan , Xinchi Chen , Yining Zheng , Xuanjing Huang , Xipeng Qiu

Multimodal large language models (MLLMs) have emerged as a promising paradigm for dental image analysis. However, their ability to capture the multi-level cognitive processes required for radiographic analysis remains unclear. Here, we…

Computation and Language · Computer Science 2026-05-11 Rongyang Wang , Shuang Zhou , Jiashuo Wang , Wenya Xie , Xiaoxia Che

Long-horizon interactions between users and LLM-based assistants necessitate effective memory management, yet current approaches face challenges in training and evaluation of memory. Existing memory benchmarks rely on static, off-policy…

Computation and Language · Computer Science 2026-03-03 Cheng Jiayang , Dongyu Ru , Lin Qiu , Yiyang Li , Xuezhi Cao , Yangqiu Song , Xunliang Cai

Long-term memory is essential for conversational agents to maintain coherence, track persistent tasks, and provide personalized interactions across extended dialogues. However, existing approaches as Retrieval-Augmented Generation (RAG) and…

Computation and Language · Computer Science 2026-04-13 Juwei Yue , Chuanrui Hu , Jiawei Sheng , Zuyi Zhou , Wenyuan Zhang , Tingwen Liu , Li Guo , Yafeng Deng

Large Language Models (LLMs) have demonstrated remarkable prowess in generating contextually coherent responses, yet their fixed context windows pose fundamental challenges for maintaining consistency over prolonged multi-session dialogues.…

Computation and Language · Computer Science 2025-04-29 Prateek Chhikara , Dev Khant , Saket Aryan , Taranjeet Singh , Deshraj Yadav

Large language models (LLMs) increasingly serve as the central control unit of AI agents, yet current approaches remain limited in their ability to deliver personalized interactions. While Retrieval Augmented Generation enhances LLM…

Artificial Intelligence · Computer Science 2025-10-10 Rebecca Westhäußer , Wolfgang Minker , Sebatian Zepf

We introduce a dynamic benchmarking system for conversational agents that evaluates their performance through a single, simulated, and lengthy user$\leftrightarrow$agent interaction. The interaction is a conversation between the user and…

Computation and Language · Computer Science 2024-10-14 David Castillo-Bolado , Joseph Davidson , Finlay Gray , Marek Rosa

Despite significant advancements in Large Language Models (LLMs) and Large Vision-Language Models (LVLMs), current models still face substantial challenges in handling complex, multi-turn, and visually-grounded tasks that demand deep…

Computation and Language · Computer Science 2025-08-22 Seungmin Han , Haeun Kwon , Ji-jun Park , Taeyang Yoon