English
Related papers

Related papers: Cognis: Context-Aware Memory for Conversational AI…

200 papers

Large Language Models (LLMs) are increasingly utilized in multi-agent systems (MAS) to enhance collaborative problem-solving and interactive reasoning. Recent advancements have enabled LLMs to function as autonomous agents capable of…

Multiagent Systems · Computer Science 2025-04-11 Tooraj Helmi

The quadratic complexity and indefinitely growing key-value (KV) cache of standard Transformers pose a major barrier to long-context processing. To overcome this, we introduce the Collaborative Memory Transformer (CoMeT), a novel…

Machine Learning · Computer Science 2026-04-20 Runsong Zhao , Shilei Liu , Jiwei Tang , Langming Liu , Haibin Chen , Weidong Zhang , Yujin Yuan , Tong Xiao , Jingbo Zhu , Wenbo Su , Bo Zheng

Long-horizon LLM agents accumulate growing conversation histories that eventually exceed the model's context window. Context compaction via LLM-based summarization keeps the conversation bounded, but summarization is inherently lossy and…

Artificial Intelligence · Computer Science 2026-05-25 Musa Cim , Burak Topcu , Chita Das , Mahmut Taylan Kandemir

Conversational recommender systems (CRSs) aim to capture user preferences and provide personalized recommendations through multi-round natural language dialogues. However, most existing CRS models mainly focus on dialogue comprehension and…

Information Retrieval · Computer Science 2024-07-09 Yunjia Xi , Weiwen Liu , Jianghao Lin , Bo Chen , Ruiming Tang , Weinan Zhang , Yong Yu

Large Language Models (LLMs) often experience performance degradation during long-running interactions due to increasing context length, memory saturation, and computational overhead. This paper presents an adaptive context compression…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Payal Fofadiya , Sunil Tiwari

LLM-powered agents face a persistent challenge: learning from their execution experiences to improve future performance. While agents can successfully complete many tasks, they often repeat inefficient patterns, fail to recover from similar…

Artificial Intelligence · Computer Science 2026-03-12 Gaodan Fang , Vatche Isahagian , K. R. Jayaram , Ritesh Kumar , Vinod Muthusamy , Punleuk Oum , Gegi Thomas

Long-horizon interactions between users and LLM-based assistants necessitate effective memory management, yet current approaches face challenges in training and evaluation of memory. Existing memory benchmarks rely on static, off-policy…

Computation and Language · Computer Science 2026-03-03 Cheng Jiayang , Dongyu Ru , Lin Qiu , Yiyang Li , Xuezhi Cao , Yangqiu Song , Xunliang Cai

LLM agents increasingly rely on memory mechanisms to reuse knowledge from past problem-solving experiences. However, existing methods typically construct memory for a single agent and reuse it with the same underlying model, tightly…

Artificial Intelligence · Computer Science 2026-05-29 Yurui Chang , Yiran Wu , Qingyun Wu , Lu Lin

In recent years, large language models have demonstrated remarkable capabilities in natural language understanding and generation. However, these models often struggle with hallucinations and maintaining long term contextual relevance,…

Multiagent Systems · Computer Science 2024-10-15 Sumedh Rasal

We present NeuSymMS, an adaptive memory system that enables large language model (LLM) agents to learn, remember, and reason about users across sessions via a hybrid neuro-symbolic architecture. NeuSymMS couples neural fact extraction from…

Artificial Intelligence · Computer Science 2026-05-22 Mujahid Sultan , Sri Thuraisamy , Daya Rajaratnam

Knowledge-intensive conversations supported by large language models (LLMs) have become one of the most popular and helpful applications that can assist people in different aspects. Many current knowledge-intensive applications are centered…

Artificial Intelligence · Computer Science 2025-02-14 Zitao Li , Fei Wei , Yuexiang Xie , Dawei Gao , Weirui Kuang , Zhijian Ma , Bingchen Qian , Yaliang Li , Bolin Ding

Recent advancements in Large Language Models (LLMs) have improved their ability to process extended conversational contexts, yet fine-tuning and evaluating short- and long-term memories remain difficult due to the absence of datasets that…

Computation and Language · Computer Science 2026-04-15 Manoj Madushanka Perera , Adnan Mahmood , Kasun Eranda Wijethilake , Quan Z. Sheng

Long-term conversational large language model (LLM) agents require memory systems that can recover relevant evidence from historical interactions without overwhelming the answer stage with irrelevant context. However, existing memory…

Computation and Language · Computer Science 2026-04-23 Shuqi Cao , Jingyi He , Fei Tan

Large Language Models (LLMs) have demonstrated remarkable prowess in generating contextually coherent responses, yet their fixed context windows pose fundamental challenges for maintaining consistency over prolonged multi-session dialogues.…

Computation and Language · Computer Science 2025-04-29 Prateek Chhikara , Dev Khant , Saket Aryan , Taranjeet Singh , Deshraj Yadav

To support long-term interaction in complex environments, LLM agents require memory systems that manage historical experiences. Existing approaches either retain full interaction histories via passive context extension, leading to…

Artificial Intelligence · Computer Science 2026-01-30 Jiaqi Liu , Yaofeng Su , Peng Xia , Siwei Han , Zeyu Zheng , Cihang Xie , Mingyu Ding , Huaxiu Yao

Large Language Models (LLMs) lack persistent memory for long-term personalized conversations. Existing graph-based memory systems suffer from information dilution, absent provenance tracking, and uniform retrieval that ignores query…

Computation and Language · Computer Science 2026-05-05 Hung Pham Van , Nguyen Manh Hieu , Khang Pham Tran Tuan , Nam Le Hai , Linh Ngo Van , Nguyen Thi Ngoc Diep , Trung Le

Large Language Models (LLMs) have emerged as foundational infrastructure in the pursuit of Artificial General Intelligence (AGI). Despite their remarkable capabilities in language perception and generation, current LLMs fundamentally lack a…

Long-term memory systems enable conversational agents based on large language models (LLMs) to retain, retrieve, and apply user-specific information across multi-session interactions. However, existing evaluations mainly assess…

Information Retrieval · Computer Science 2026-05-21 Zhen Tao , Jinxiang Zhao , Peng Liu , Dinghao Xi , Yanfang Chen , Wei Xu , Zhiyu Li

Despite significant advancements in Large Language Models (LLMs) and Large Vision-Language Models (LVLMs), current models still face substantial challenges in handling complex, multi-turn, and visually-grounded tasks that demand deep…

Computation and Language · Computer Science 2025-08-22 Seungmin Han , Haeun Kwon , Ji-jun Park , Taeyang Yoon

Agentic AI require persistent memory to store user-specific histories beyond the limited context window of LLMs. Existing memory systems use dense vector databases or knowledge-graph traversal (or hybrid), incurring high retrieval latency…

Artificial Intelligence · Computer Science 2026-02-17 Yi Li , Lianjie Cao , Faraz Ahmed , Puneet Sharma , Bingzhe Li