English
Related papers

Related papers: Xetrieval: Mechanistically Explaining Dense Retrie…

200 papers

Lexical and semantic matching capture different successful approaches to text retrieval and the fusion of their results has proven to be more effective and robust than either alone. Prior work performs hybrid retrieval by conducting lexical…

Information Retrieval · Computer Science 2023-02-28 Sheng-Chieh Lin , Jimmy Lin

Conversational search requires accurate interpretation of user intent from complex multi-turn contexts. This paper presents ChatRetriever, which inherits the strong generalization capability of large language models to robustly represent…

Information Retrieval · Computer Science 2024-04-23 Kelong Mao , Chenlong Deng , Haonan Chen , Fengran Mo , Zheng Liu , Tetsuya Sakai , Zhicheng Dou

Retrieval module can be plugged into many downstream NLP tasks to improve their performance, such as open-domain question answering and retrieval-augmented generation. The key to a retrieval system is to calculate relevance scores to query…

Computation and Language · Computer Science 2024-10-22 Lu Dai , Hao Liu , Hui Xiong

Text embedding representing natural language documents in a semantic vector space can be used for document retrieval using nearest neighbor lookup. In order to study the feasibility of neural models specialized for retrieval in a…

Information Retrieval · Computer Science 2019-05-03 Tolgahan Cakaloglu , Christian Szegedy , Xiaowei Xu

Current advances in Natural Language Processing (NLP) have made it increasingly feasible to build applications leveraging textual data. Generally, the core of these applications rely on having a good semantic representation of text into…

Computation and Language · Computer Science 2024-10-21 Thomas Uriot

Neural ranking models have shown outstanding performance across a variety of tasks, such as document retrieval, re-ranking, question answering and conversational retrieval. However, the inner decision process of these models remains largely…

Information Retrieval · Computer Science 2025-10-09 Cile van Marken , Roxana Petcu

LLMs confront inherent limitations in terms of its knowledge, memory, and action. The retrieval augmentation stands as a vital mechanism to address these limitations, which brings in useful information from external sources to augment the…

Information Retrieval · Computer Science 2026-01-06 Peitian Zhang , Shitao Xiao , Zheng Liu , Zhicheng Dou , Jian-Yun Nie

We propose RaDeR, a set of reasoning-based dense retrieval models trained with data derived from mathematical problem solving using large language models (LLMs). Our method leverages retrieval-augmented reasoning trajectories of an LLM and…

Computation and Language · Computer Science 2025-05-28 Debrup Das , Sam O' Nuallain , Razieh Rahimi

Conversational search aims to satisfy users' complex information needs via multiple-turn interactions. The key challenge lies in revealing real users' search intent from the context-dependent queries. Previous studies achieve conversational…

Information Retrieval · Computer Science 2025-11-13 Fengran Mo , Jinghan Zhang , Yuchen Hui , Jia Ao Sun , Zhichao Xu , Zhan Su , Jian-Yun Nie

Despite impressive advances in simultaneous localization and mapping, dense robotic mapping remains challenging due to its inherent nature of being a high-dimensional inference problem. In this paper, we propose a dense semantic robotic…

Robotics · Computer Science 2017-09-26 Lu Gan , Maani Ghaffari Jadidi , Steven A. Parkison , Ryan M. Eustice

Effective conversational search demands a deep understanding of user intent across multiple dialogue turns. Users frequently use abbreviations and shift topics in the middle of conversations, posing challenges for conventional retrievers.…

Information Retrieval · Computer Science 2025-09-25 Seunghan Yang , Juntae Lee , Jihwan Bang , Kyuhong Shim , Minsoo Kim , Simyung Chang

Information retrieval systems are crucial for enabling effective access to large document collections. Recent approaches have leveraged Large Language Models (LLMs) to enhance retrieval performance through query augmentation, but often rely…

Information Retrieval · Computer Science 2025-04-15 Pengcheng Jiang , Jiacheng Lin , Lang Cao , Runchu Tian , SeongKu Kang , Zifeng Wang , Jimeng Sun , Jiawei Han

In any ranking system, the retrieval model outputs a single score for a document based on its belief on how relevant it is to a given search query. While retrieval models have continued to improve with the introduction of increasingly…

Information Retrieval · Computer Science 2021-05-12 Daniel Cohen , Bhaskar Mitra , Oleg Lesota , Navid Rekabsaz , Carsten Eickhoff

Deep Reinforcement Learning (DRL) has achieved remarkable success in sequential decision-making tasks across diverse domains, yet its reliance on black-box neural architectures hinders interpretability, trust, and deployment in high-stakes…

Machine Learning · Computer Science 2025-02-12 Zelei Cheng , Jiahao Yu , Xinyu Xing

Ranking has always been one of the top concerns in information retrieval research. For decades, lexical matching signal has dominated the ad-hoc retrieval process, but it also has inherent defects, such as the vocabulary mismatch problem.…

Information Retrieval · Computer Science 2020-10-21 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Min Zhang , Shaoping Ma

The capability of large language models to handle long-context information is crucial across various real-world applications. Existing evaluation methods often rely either on real-world long texts, making it difficult to exclude the…

Computation and Language · Computer Science 2025-09-18 Mo Li , Songyang Zhang , Taolin Zhang , Haodong Duan , Yunxin Liu , Kai Chen

Traditional retrieval methods rely on transforming user queries into vector representations and retrieving documents based on cosine similarity within an embedding space. While efficient and scalable, this approach often fails to handle…

Computation and Language · Computer Science 2025-03-25 Felix Faltings , Wei Wei , Yujia Bao

Despite the success achieved on various natural language processing tasks, word embeddings are difficult to interpret due to the dense vector representations. This paper focuses on interpreting the embeddings for various aspects, including…

Computation and Language · Computer Science 2018-09-11 Ting-Yun Chang , Ta-Chung Chi , Shang-Chi Tsai , Yun-Nung Chen

We investigate the exploitation of both lexical and neural relevance signals for ad-hoc passage retrieval. Our exploration involves a large-scale training dataset in which dense neural representations of MS-MARCO queries and passages are…

Information Retrieval · Computer Science 2025-10-21 Franco Maria Nardini , Raffaele Perego , Nicola Tonellotto , Salvatore Trani

Generative retrieval generates identifiers of relevant documents in an end-to-end manner using a sequence-to-sequence architecture for a given query. The relation between generative retrieval and other retrieval methods, especially those…

Information Retrieval · Computer Science 2024-04-02 Shiguang Wu , Wenda Wei , Mengqi Zhang , Zhumin Chen , Jun Ma , Zhaochun Ren , Maarten de Rijke , Pengjie Ren