English
Related papers

Related papers: Knowledge Access Beats Model Size: Memory Augmente…

200 papers

Skill routing is an important component in large-scale conversational systems. In contrast to traditional rule-based skill routing, state-of-the-art systems use a model-based approach to enable natural conversations. To provide supervision…

Machine Learning · Computer Science 2022-04-15 Mohammad Kachuee , Jinseok Nam , Sarthak Ahuja , Jin-Myung Won , Sungjin Lee

Online reinforcement learning agents are currently able to process an increasing amount of data by converting it into a higher order value functions. This expansion of the information collected from the environment increases the agent's…

Machine Learning · Computer Science 2021-02-04 Mirza Ramicic , Andrea Bonarini

Deep reinforcement learning algorithms have recently been used to train multiple interacting agents in a centralised manner whilst keeping their execution decentralised. When the agents can only acquire partial observations and are faced…

Machine Learning · Computer Science 2020-01-27 Emanuele Pesce , Giovanni Montana

Conversational AI (ConvAI) agents increasingly maintain structured memory to support long-term, task-oriented interactions. In-context memory approaches append the growing history to the model input, which scales poorly under context-window…

Artificial Intelligence · Computer Science 2026-03-03 Yifan Simon Liu , Ruifan Wu , Liam Gallagher , Jiazhou Liang , Armin Toroghi , Scott Sanner

Existing conversational memory systems rely on complex hierarchical summarization or reinforcement learning to manage long-term dialogue history, yet remain vulnerable to context dilution as conversations grow. In this work, we offer a…

Computation and Language · Computer Science 2026-04-15 Yuqian Wu , Wei Chen , Zhengjun Huang , Junle Chen , Qingxiang Liu , Kai Wang , Xiaofang Zhou , Yuxuan Liang

Agent-assisted memory recall is one critical research problem in the field of human-computer interaction. In conventional methods, the agent can retrieve information from its equipped memory module to help the person recall incomplete or…

Artificial Intelligence · Computer Science 2025-08-01 Qian Zhao , Zhuo Sun , Bin Guo , Zhiwen Yu

Large language models (LLMs) struggle with maintaining coherence in extended conversations spanning hundreds of turns, despite performing well within their context windows. This paper introduces HEMA (Hippocampus-Inspired Extended Memory…

Computation and Language · Computer Science 2025-04-24 Kwangseob Ahn

We study the problem of imposing conversational goals/keywords on open-domain conversational agents, where the agent is required to lead the conversation to a target keyword smoothly and fast. Solving this problem enables the application of…

Computation and Language · Computer Science 2021-03-02 Peixiang Zhong , Yong Liu , Hao Wang , Chunyan Miao

Retrieval-Augmented Generation (RAG) grounds large language models with external evidence, but many implementations rely on pre-built indices that remain static after construction. Related queries therefore repeat similar multi-hop…

Artificial Intelligence · Computer Science 2026-03-03 Yifan Wang , Mingxuan Jiang , Zhihao Sun , Yixin Cao , Yicun Liu , Keyang Chen , Guangnan Ye , Hongfeng Chai

Retrieval augmented models are becoming increasingly popular for computer vision tasks after their recent success in NLP problems. The goal is to enhance the recognition capabilities of the model by retrieving similar examples for the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Ahmet Iscen , Alireza Fathi , Cordelia Schmid

In this paper we propose a neural conversation model for conducting dialogues. We demonstrate the use of this model to generate help desk responses, where users are asking questions about PC applications. Our model is distinguished by two…

Computation and Language · Computer Science 2016-06-07 Kaisheng Yao , Baolin Peng , Geoffrey Zweig , Kam-Fai Wong

Large language models (LLMs) face inherent limitations in memory, including restricted context windows, long-term knowledge forgetting, redundant information accumulation, and hallucination generation. These issues severely constrain…

Artificial Intelligence · Computer Science 2026-03-20 Deliang Wen , Ke Sun

Large Language Models (LLMs) often struggle with dynamically changing knowledge and handling unknown static information. Retrieval-Augmented Generation (RAG) is employed to tackle these challenges and has a significant impact on improving…

Computation and Language · Computer Science 2025-09-18 Zhen Zhang , Xinyu Wang , Yong Jiang , Zile Qiao , Zhuo Chen , Guangyu Li , Feiteng Mu , Mengting Hu , Pengjun Xie , Fei Huang

Test-time scaling has emerged as an effective way to improve language models on challenging reasoning tasks. However, most existing methods treat each problem in isolation and do not systematically reuse knowledge from prior reasoning…

Computation and Language · Computer Science 2026-04-21 Di Wu , Devendra Singh Sachan , Wen-tau Yih , Mingda Chen

Memory is critical for enabling large language model (LLM) based agents to maintain coherent behavior over long-horizon interactions. However, existing agent memory systems suffer from two key gaps: they rely on a one-size-fits-all memory…

Artificial Intelligence · Computer Science 2026-02-17 Mingfei Lu , Mengjia Wu , Feng Liu , Jiawei Xu , Weikai Li , Haoyang Wang , Zhengdong Hu , Ying Ding , Yizhou Sun , Jie Lu , Yi Zhang

Large Language Model (LLM)-based agents are increasingly deployed for complex, tool-based tasks where long-term memory is critical to driving actions. Existing benchmarks, however, primarily test a angent's ability to passively retrieve…

Computation and Language · Computer Science 2026-01-29 Yiting Shen , Kun Li , Wei Zhou , Songlin Hu

Advances in inference methods have enabled language models to improve their predictions without additional training. These methods often prioritize raw performance over cost-effective compute usage. However, computational efficiency is key…

Artificial Intelligence · Computer Science 2026-05-05 Florian Valentin Wunderlich , Lars Benedikt Kaesberg , Jan Philip Wahle , Terry Ruas , Bela Gipp

Although large language model (LLM) conversational systems process millions of multi-turn dialogues daily, they remain fundamentally reactive: they respond only after the user types a query. A key step toward proactive interaction is…

Computation and Language · Computer Science 2026-05-25 Jiangwang Chen , Bowen Zhang , Zixin Song , Jiazheng Kang , Xiao Yang , Da Zhu , Guanjun Jiang

Large Language Model (LLM) agents exhibit remarkable conversational and reasoning capabilities but remain constrained by limited context windows and the lack of persistent memory. Recent efforts address these limitations via external memory…

Information Retrieval · Computer Science 2026-01-07 Zhengjun Huang , Zhoujin Tian , Qintian Guo , Fangyuan Zhang , Yingli Zhou , Di Jiang , Zeying Xie , Xiaofang Zhou

Recent conversational memory systems invest heavily in LLM-based structuring at ingestion time and learned retrieval policies at query time. We show that neither is necessary. SmartSearch retrieves from raw, unstructured conversation…

Machine Learning · Computer Science 2026-03-17 Jesper Derehag , Carlos Calva , Timmy Ghiurau