English
Related papers

Related papers: SmartSearch: How Ranking Beats Structure for Conve…

200 papers

Large language models (LLMs) are probabilistic in nature and perform more reliably when augmented with external information. As complex queries often require multi-step reasoning over the retrieved information, with no clear or…

Information Retrieval · Computer Science 2026-04-10 Roxana Petcu , Evangelos Kanoulas , Maarten de Rijke

Memory systems have been designed to leverage past experiences in Large Language Model (LLM) agents. However, many deployed memory systems primarily optimize compression and storage, with comparatively less emphasis on explicit, closed-loop…

Artificial Intelligence · Computer Science 2025-12-24 Xingbo Du , Loka Li , Duzhen Zhang , Le Song

Large Language Models (LLMs) have shown remarkable capabilities in reasoning, exemplified by the success of OpenAI-o1 and DeepSeek-R1. However, integrating reasoning with external search processes remains challenging, especially for complex…

As large language models (LLMs) evolve into autonomous agents, persistent memory at the API layer is essential for enabling context-aware behavior across LLMs and multi-session interactions. Existing approaches force vendor lock-in and rely…

Machine Learning · Computer Science 2026-03-23 Luiz C. Borro , Luiz A. B. Macarini , Gordon Tindall , Michael Montero , Adam B. Struck

Large language model assistants are increasingly expected to retain and reason over information accumulated across many sessions. We introduce EngramaBench, a benchmark for long-term conversational memory built around five personas, one…

Computation and Language · Computer Science 2026-04-24 Julian Acuna

Literature search questions, such as "Where can I find research on the evaluation of consistency in generated summaries?" pose significant challenges for modern search engines and retrieval systems. These questions often require a deep…

Information Retrieval · Computer Science 2024-10-18 Anirudh Ajith , Mengzhou Xia , Alexis Chevalier , Tanya Goyal , Danqi Chen , Tianyu Gao

Long-term conversational agents need memory systems that capture relationships between events, not merely isolated facts, to support temporal reasoning and multi-hop question answering. Current approaches face a fundamental trade-off: flat…

Computation and Language · Computer Science 2026-04-24 Buqiang Xu , Yijun Chen , Jizhan Fang , Ruobin Zhong , Yunzhi Yao , Yuqi Zhu , Lun Du , Shumin Deng

Effective conversational search demands a deep understanding of user intent across multiple dialogue turns. Users frequently use abbreviations and shift topics in the middle of conversations, posing challenges for conventional retrievers.…

Information Retrieval · Computer Science 2025-09-25 Seunghan Yang , Juntae Lee , Jihwan Bang , Kyuhong Shim , Minsoo Kim , Simyung Chang

To deliver coherent and personalized experiences in long-term conversations, existing approaches typically perform retrieval augmented response generation by constructing memory banks from conversation history at either the turn-level,…

Computation and Language · Computer Science 2025-03-04 Zhuoshi Pan , Qianhui Wu , Huiqiang Jiang , Xufang Luo , Hao Cheng , Dongsheng Li , Yuqing Yang , Chin-Yew Lin , H. Vicky Zhao , Lili Qiu , Jianfeng Gao

When LLM conversations grow beyond the context window, old content must be evicted -- but how does the model recover it when needed? We propose cooperative paging: evicted segments are replaced with minimal keyword bookmarks ([pN:keywords],…

Computation and Language · Computer Science 2026-05-26 Ziyang Liu

Long-term conversational memory is a core capability for LLM-based dialogue systems, yet existing benchmarks and evaluation protocols primarily focus on surface-level factual recall. In realistic interactions, appropriate responses often…

Computation and Language · Computer Science 2026-02-12 Yifei Li , Weidong Guo , Lingling Zhang , Rongman Xu , Muye Huang , Hui Liu , Lijiao Xu , Yu Xu , Jun Liu

Large language models (LLMs) have demonstrated strong capabilities in medical question answering; however, purely parametric models often suffer from knowledge gaps and limited factual grounding. Retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2026-04-09 Nusrat Sultana , Abdullah Muhammad Moosa , Kazi Afzalur Rahman , Sajal Chandra Banik

Existing benchmarks treat multi-turn conversation and reasoning-intensive retrieval separately, yet real-world information seeking requires both. To bridge this gap, we present a benchmark for reasoning-based conversational information…

Information Retrieval · Computer Science 2026-01-12 Mohammed Ali , Abdelrahman Abdallah , Amit Agarwal , Hitesh Laxmichand Patel , Adam Jatowt

Information retrieval systems have traditionally relied on exact term match methods such as BM25 for first-stage retrieval. However, recent advancements in neural network-based techniques have introduced a new method called dense retrieval.…

Information Retrieval · Computer Science 2025-03-25 Ahmed H. Salamah , Pierre McWhannel , Nicole Yan

Organizations increasingly rely on proprietary enterprise data, including HR records, structured reports, and tabular documents, for critical decision-making. While Large Language Models (LLMs) have strong generative capabilities, they are…

Computation and Language · Computer Science 2025-07-17 Chandana Cheerla

Large Language Models (LLMs) face significant computational and memory constraints when processing long contexts, despite growing demand for applications requiring reasoning over extensive documents, multi-session dialogues, and book length…

Computation and Language · Computer Science 2026-02-10 Chandra Vamsi Krishna Alla , Harish Naidu Gaddam , Manohar Kommi

How to enable human-like long-term memory in large language models (LLMs) has been a central question for unlocking more general capabilities such as few-shot generalization. Existing memory frameworks and benchmarks focus on finding the…

Computation and Language · Computer Science 2025-12-01 Yicong Zheng , Kevin L. McKee , Thomas Miconi , Zacharie Bugaud , Mick van Gelderen , Jed McCaleb

Reasoning-intensive retrieval requires deep semantic inference beyond surface-level keyword matching, posing a challenge for current LLM-based rerankers limited by context constraints and order sensitivity. We propose \textbf{\BracketRank},…

Information Retrieval · Computer Science 2026-04-13 Abdelrahman Abdallah , Mohammed Ali , Bhawna Piryani , Adam Jatowt

Large language model retrievers improve performance on complex queries, but their practical value depends on efficiency, robustness, and reliable confidence signals in addition to accuracy. We reproduce a reasoning-intensive retrieval…

Information Retrieval · Computer Science 2026-04-07 Abdelrahman Abdallah , Jamie Holdcroft , Mohammed Ali , Adam Jatowt

External memory systems are pivotal for enabling Large Language Model (LLM) agents to maintain persistent knowledge and perform long-horizon decision-making. Existing paradigms typically follow a two-stage process: computationally expensive…

Machine Learning · Computer Science 2026-04-27 Xiucheng Xu , Bingbing Xu , Xueyun Tian , Zihe Huang , Rongxin Chen , Yunfan Li , Huawei Shen