English
Related papers

Related papers: HyperMem: Hypergraph Memory for Long-Term Conversa…

200 papers

Large language models (LLMs) exhibit strong semantic understanding, yet struggle when user instructions involve ambiguous or conceptually misaligned terms. We propose the Language Graph Model (LGM) to enhance conceptual clarity by…

Computation and Language · Computer Science 2025-11-06 Wenchang Lei , Ping Zou , Yue Wang , Feng Sun , Lei Zhao

Long-term conversational memory in practical LLM applications is inherently collaborative: information is produced by multiple participants, scattered across groups and channels, revised over time, and implicitly grounded in roles and…

Computation and Language · Computer Science 2026-03-12 Chuanrui Hu , Tong Li , Xingze Gao , Hongda Chen , Yi Bai , Dannong Xu , Tianwei Lin , Xiaohong Li , Yunyun Han , Jian Pei , Yafeng Deng

Retrieval-augmented generation (RAG) equips large language models (LLMs) with reliable knowledge memory. To strengthen cross-text associations, recent research integrates graphs and hypergraphs into RAG to capture pairwise and multi-entity…

Information Retrieval · Computer Science 2026-02-10 Xingliang Hou , Yuyan Liu , Qi Sun , haoxiu wang , Hao Hu , Shaoyi Du , Zhiqiang Tian

Due to the advantages of hypergraphs in modeling high-order relationships in complex systems, they have been applied to higher-order clustering, hypergraph neural networks and computer vision. These applications rely heavily on access to…

Social and Information Networks · Computer Science 2025-10-15 Bingqiao Gu , Jiale Zeng , Xingqin Qi , Dong Li

The remarkable progress of vision-language models (VLMs) has enabled GUI agents to interact with computers in a human-like manner. Yet real-world computer-use tasks remain difficult due to long-horizon workflows, diverse interfaces, and…

Artificial Intelligence · Computer Science 2026-03-12 Sibo Zhu , Wenyi Wu , Kun Zhou , Stephen Wang , Biwei Huang

In order to thrive in hostile and ever-changing natural environments, mammalian brains evolved to store large amounts of knowledge about the world and continually integrate new information while avoiding catastrophic forgetting. Despite the…

Computation and Language · Computer Science 2025-01-15 Bernal Jiménez Gutiérrez , Yiheng Shu , Yu Gu , Michihiro Yasunaga , Yu Su

Personalizing language models by effectively incorporating user interaction history remains a central challenge in the development of adaptive AI systems. While large language models (LLMs), combined with Retrieval-Augmented Generation…

Computation and Language · Computer Science 2026-04-14 Mikhail Menschikov , Dmitry Evseev , Victoria Dochkina , Ruslan Kostoev , Ilia Perepechkin , Petr Anokhin , Nikita Semenov , Evgeny Burnaev

To process contexts with unlimited length using Large Language Models (LLMs), recent studies explore hierarchically managing the long text. Only several text fragments are taken from the external memory and passed into the temporary working…

Computation and Language · Computer Science 2024-06-06 Xihang Yue , Linchao Zhu , Yi Yang

We focus on a conversational question answering task which combines the challenges of understanding questions in context and reasoning over evidence gathered from heterogeneous sources like text, knowledge graphs, tables, and infoboxes. Our…

Computation and Language · Computer Science 2024-07-16 Parag Jain , Mirella Lapata

Large Language Model (LLM) agents are increasingly used in real-world products, where personalized and context-aware user interactions are essential. A central enabler of such capabilities is the agent's long-term semantic memory system,…

Information Retrieval · Computer Science 2026-05-27 Zhentao Xu , Shangjin Zhang , Emir Poyraz , Yvonne Li , Ye Jin , Xie Lu , Xiaoyang Gu , Karthik Ramgopal , Praveen Kumar Bodigutla , Xiaofeng Wang

Existing memory-augmented LLM agents often treat memory as a static repository with pre-defined representations and fixed retrieval pipelines, which is brittle in dynamic agentic environments where feedback, task variation, and…

Clinical decision-making agents can benefit from reusing prior decision experience. However, many memory-augmented methods store experiences as independent records without explicit relational structure, which may introduce noisy retrieval,…

Artificial Intelligence · Computer Science 2026-03-24 Xiao Han , Yuzheng Fan , Sendong Zhao , Haochun Wang , Bing Qin

LLM-based conversational agents still struggle to maintain coherent, personalized interaction over many sessions: fixed context windows limit how much history can be kept in view, and most external memory approaches trade off between coarse…

Computation and Language · Computer Science 2025-12-12 Sizhe Zhou , Jiawei Han

Memory-Augmented Generation (MAG) extends Large Language Models with external memory to support long-context reasoning, but existing approaches largely rely on semantic similarity over monolithic memory stores, entangling temporal, causal,…

Artificial Intelligence · Computer Science 2026-04-17 Dongming Jiang , Yi Li , Guanpeng Li , Bingzhe Li

Extractive summarization for long documents is challenging due to the extended structured input context. The long-distance sentence dependency hinders cross-sentence relations modeling, the critical step of extractive summarization. This…

Computation and Language · Computer Science 2022-10-11 Haopeng Zhang , Xiao Liu , Jiawei Zhang

Large language model (LLM) agents face fundamental limitations in long-horizon reasoning due to finite context windows, making effective memory management critical. Existing methods typically handle long-term memory (LTM) and short-term…

Computation and Language · Computer Science 2026-05-01 Yi Yu , Liuyi Yao , Yuexiang Xie , Qingquan Tan , Jiaqi Feng , Yaliang Li , Libing Wu

As large language models (LLMs) evolve into autonomous agents, persistent memory at the API layer is essential for enabling context-aware behavior across LLMs and multi-session interactions. Existing approaches force vendor lock-in and rely…

Machine Learning · Computer Science 2026-03-23 Luiz C. Borro , Luiz A. B. Macarini , Gordon Tindall , Michael Montero , Adam B. Struck

To deliver coherent and personalized experiences in long-term conversations, existing approaches typically perform retrieval augmented response generation by constructing memory banks from conversation history at either the turn-level,…

Computation and Language · Computer Science 2025-03-04 Zhuoshi Pan , Qianhui Wu , Huiqiang Jiang , Xufang Luo , Hao Cheng , Dongsheng Li , Yuqing Yang , Chin-Yew Lin , H. Vicky Zhao , Lili Qiu , Jianfeng Gao

Memory retrieval in agentic large language model (LLM) systems is often treated as a static lookup problem, relying on flat vector search or fixed binary relational graphs. However, fixed graph structures cannot capture the varying…

Artificial Intelligence · Computer Science 2026-05-12 Dongming Jiang , Yi Li , Guanpeng Li , Qiannan Li , Bingzhe Li

Standard Retrieval Augmented Generation (RAG) is poorly matched to agent memory. Unlike large heterogeneous corpora, agent memory forms a bounded and coherent interaction stream in which many spans are highly correlated or near duplicates.…

Computation and Language · Computer Science 2026-05-13 Zhanghao Hu , Qinglin Zhu , Runcong Zhao , Di Liang , Hanqi Yan , Yulan He , Lin Gui