English
Related papers

Related papers: GRAVITY: Architecture-Agnostic Structured Anchorin…

200 papers

We introduce a comprehensive benchmark for conversational memory evaluation containing 75,336 question-answer pairs across diverse categories including user facts, assistant recall, abstention, preferences, temporal changes, and implicit…

Computation and Language · Computer Science 2025-11-14 Egor Pakhomov , Erik Nijkamp , Caiming Xiong

Temporal reasoning in multi-session dialogues presents a significant challenge which has been under-studied in previous temporal reasoning benchmarks. To bridge this gap, we propose a new evaluation task for temporal reasoning in…

Artificial Intelligence · Computer Science 2025-09-26 Yubin Ge , Salvatore Romeo , Jason Cai , Raphael Shu , Monica Sunkara , Yassine Benajiba , Yi Zhang

Large Language Model (LLM) agents increasingly serve as personal assistants and workplace collaborators, where their utility depends on memory systems that extract, retrieve, and apply information across long-running conversations. However,…

Computation and Language · Computer Science 2026-05-19 Jingbo Yang , Kwei-Herng Lai , Xiaowen Wang , Shiyu Chang , Yaar Harari , Evgeniy Gabrilovich

Long-horizon interactive agents often accumulate large trajectory histories yet still fail to answer questions about earlier events reliably. We argue that the main bottleneck is not context length alone, but the trajectory-to-answer…

Computation and Language · Computer Science 2026-05-29 Encheng Su , Jinouwen Zhang , Jianyu Wu , Qiucheng Yu , Chen Tang , Pengze Li , Lintao Wang , Yizhou Wang , Xinzhu Ma , Shixiang Tang , Aoran Wang

Retrieval Augmented Generation (RAG) has enjoyed increased attention in the recent past and recent advancements in Large Language Models (LLMs) have highlighted the importance of integrating world knowledge into these systems. Current RAG…

Computation and Language · Computer Science 2025-04-11 Joel Barmettler , Abraham Bernstein , Luca Rossetto

Large language models (LLMs) suffer from proactive interference (PI): outdated information in the context window disrupts retrieval of current values. This interference degrades retrieval accuracy log-linearly as stale associations…

Artificial Intelligence · Computer Science 2026-03-17 Ying Xie

Long-term conversational large language model (LLM) agents require memory systems that can recover relevant evidence from historical interactions without overwhelming the answer stage with irrelevant context. However, existing memory…

Computation and Language · Computer Science 2026-04-23 Shuqi Cao , Jingyi He , Fei Tan

Providing AI agents with reliable long-term memory that does not hallucinate remains an open problem. Current approaches to memory for LLM agents -- sliding windows, summarization, embedding-based RAG, and flat fact extraction -- each…

Computation and Language · Computer Science 2026-04-14 Artem Gadzhiev , Andrew Kislov

Large language models (LLMs) are known to exhibit brittle behavior under adversarial prompts and jailbreak attacks, even after extensive alignment and fine-tuning. This fragility reflects a broader challenge of modern neural language…

Computation and Language · Computer Science 2026-02-04 Patrick Cooper , Alireza Nadali , Ashutosh Trivedi , Alvaro Velasquez

Automatic open-domain dialogue evaluation has attracted increasing attention, yet remains challenging due to the complexity of assessing response appropriateness. Traditional evaluation metrics, typically trained with true positive and…

Computation and Language · Computer Science 2025-09-17 Bohao Yang , Kun Zhao , Dong Liu , Chen Tang , Liang Zhan , Chenghua Lin

Long-horizon conversational agents have to manage ever-growing interaction histories that quickly exceed the finite context windows of large language models (LLMs). Existing memory frameworks provide limited support for temporally…

Computation and Language · Computer Science 2026-05-01 Kai Li , Xuanqing Yu , Ziyi Ni , Yi Zeng , Yao Xu , Zheqing Zhang , Xin Li , Jitao Sang , Xiaogang Duan , Xuelei Wang , Chengbao Liu , Jie Tan

Link prediction in knowledge graphs requires integrating structural information and semantic context to infer missing entities. While large language models offer strong generative reasoning capabilities, their limited exploitation of…

Computation and Language · Computer Science 2025-09-09 Mengxue Yang , Chun Yang , Jiaqi Zhu , Jiafan Li , Jingqi Zhang , Yuyang Li , Ying Li

While large language models have achieved remarkable performance in complex tasks, they still need a memory system to utilize historical experience in long-term interactions. Existing memory methods (e.g., A-Mem, Mem0) place excessive…

Computation and Language · Computer Science 2026-04-21 Zhanyu Shen , Sijie Cheng , Zhicheng Guo , Weiqin Wang , Yile Wang , Hui Huang

Large Language Models (LLMs) have been widely adopted in conversational applications. However, their reliance on parametric knowledge limits reliability in real-world scenarios that require dynamic or domain-specific information.…

Computation and Language · Computer Science 2026-05-26 Kaiqiao Han , LuAn Tang , Renliang Sun , Peng Yuan , Wei Cheng , Haoyu Wang , Wei Wang , Yizhou Sun , Haifeng Chen

Conversational AI systems that rely on Large Language Models, like Transformers, have difficulty interweaving external data (like facts) with the language they generate. Vanilla Transformer architectures are not designed for answering…

Computation and Language · Computer Science 2024-03-01 Stephan Raaijmakers , Roos Bakker , Anita Cremers , Roy de Kleijn , Tom Kouwenhoven , Tessa Verhoef

Large language model-based agents operating in long-horizon interactions require memory systems that support temporal consistency, multi-hop reasoning, and evidence-grounded reuse across sessions. Existing approaches largely rely on…

Computation and Language · Computer Science 2026-01-27 Juexiang Ye , Xue Li , Xinyu Yang , Chengkai Huang , Lanshun Nie , Lina Yao , Dechen Zhan

Memory plays a foundational role in augmenting the reasoning, adaptability, and contextual fidelity of modern Large Language Models and Multi-Modal LLMs. As these models transition from static predictors to interactive systems capable of…

Artificial Intelligence · Computer Science 2026-01-15 Zixia Jia , Jiaqi Li , Yipeng Kang , Yuxuan Wang , Tong Wu , Quansen Wang , Xiaobo Wang , Shuyi Zhang , Junzhe Shen , Qing Li , Siyuan Qi , Yitao Liang , Di He , Zilong Zheng , Song-Chun Zhu

Large Language Models (LLMs) have achieved impressive capabilities in language understanding and generation, yet they continue to underperform on knowledge-intensive reasoning tasks due to limited access to structured context and multi-hop…

Computation and Language · Computer Science 2025-06-26 Travis Thompson , Seung-Hwan Lim , Paul Liu , Ruoying He , Dongkuan Xu

LLM-based conversational agents still struggle to maintain coherent, personalized interaction over many sessions: fixed context windows limit how much history can be kept in view, and most external memory approaches trade off between coarse…

Computation and Language · Computer Science 2025-12-12 Sizhe Zhou , Jiawei Han

This paper addresses the problems of missing reasoning chains and insufficient entity-level semantic understanding in large language models when dealing with tasks that require structured knowledge. It proposes a fine-tuning algorithm…

Computation and Language · Computer Science 2025-08-21 Wuyang Zhang , Yexin Tian , Xiandong Meng , Mengjie Wang , Junliang Du