English
Related papers

Related papers: Dense X Retrieval: What Retrieval Granularity Shou…

200 papers

Text retrieval plays a crucial role in incorporating factual knowledge for decision making into language processing pipelines, ranging from chat-based web search to question answering systems. Current state-of-the-art text retrieval models…

Computation and Language · Computer Science 2024-11-26 Ge Gao , Jonathan D. Chang , Claire Cardie , Kianté Brantley , Thorsten Joachim

Neural retrieval models (NRMs) have been shown to outperform their statistical counterparts owing to their ability to capture semantic meaning via dense document representations. These models, however, suffer from poor interpretability as…

Information Retrieval · Computer Science 2023-04-26 Michael Llordes , Debasis Ganguly , Sumit Bhatia , Chirag Agarwal

Recently, dense passage retrieval has become a mainstream approach to finding relevant information in various natural language processing tasks. A number of studies have been devoted to improving the widely adopted dual-encoder…

Information Retrieval · Computer Science 2023-04-25 Ruiyang Ren , Shangwen Lv , Yingqi Qu , Jing Liu , Wayne Xin Zhao , QiaoQiao She , Hua Wu , Haifeng Wang , Ji-Rong Wen

Large language models (LLMs) have made significant advancements in various natural language processing tasks, including question answering (QA) tasks. While incorporating new information with the retrieval of relevant passages is a…

Computation and Language · Computer Science 2024-04-23 Jaehyung Kim , Jaehyun Nam , Sangwoo Mo , Jongjin Park , Sang-Woo Lee , Minjoon Seo , Jung-Woo Ha , Jinwoo Shin

Recently, retrieval systems based on dense representations have led to important improvements in open-domain question answering, and related tasks. While very effective, this approach is also memory intensive, as the dense vectors for the…

Computation and Language · Computer Science 2021-01-01 Gautier Izacard , Fabio Petroni , Lucas Hosseini , Nicola De Cao , Sebastian Riedel , Edouard Grave

While the current state-of-the-art dense retrieval models exhibit strong out-of-domain generalization, they might fail to capture nuanced domain-specific knowledge. In principle, fine-tuning these models for specialized retrieval tasks…

Information Retrieval · Computer Science 2025-02-28 Manveer Singh Tamber , Suleman Kazi , Vivek Sourabh , Jimmy Lin

Conversational search utilizes muli-turn natural language contexts to retrieve relevant passages. Existing conversational dense retrieval models mostly view a conversation as a fixed sequence of questions and responses, overlooking the…

Computation and Language · Computer Science 2024-06-05 Haonan Chen , Zhicheng Dou , Kelong Mao , Jiongnan Liu , Ziliang Zhao

Pre-trained language models have been successful in many knowledge-intensive NLP tasks. However, recent work has shown that models such as BERT are not ``structurally ready'' to aggregate textual information into a [CLS] vector for dense…

Information Retrieval · Computer Science 2023-05-26 Sheng-Chieh Lin , Minghan Li , Jimmy Lin

Convolutional Neural Network (CNN) is a very powerful approach to extract discriminative local descriptors for effective image search. Recent work adopts fine-tuned strategies to further improve the discriminative power of the descriptors.…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Tuan Hoang , Thanh-Toan Do , Dang-Khoa Le Tan , Ngai-Man Cheung

Learned dense representations are a popular family of techniques for encoding queries and documents using high-dimensional embeddings, which enable retrieval by performing approximate k nearest-neighbors search (A-kNN). A popular technique…

Information Retrieval · Computer Science 2024-08-12 Francesco Busolin , Claudio Lucchese , Franco Maria Nardini , Salvatore Orlando , Raffaele Perego , Salvatore Trani

The search of information in large text repositories has been plagued by the so-called document-query vocabulary gap, i.e. the semantic discordance between the contents in the stored document entities on the one hand and the human query on…

Information Retrieval · Computer Science 2020-04-22 Bhawani Selvaretnam , Mohammed Belkhatir

Differentiable Search Index is a recently proposed paradigm for document retrieval, that encodes information about a corpus of documents within the parameters of a neural network and directly maps queries to corresponding documents. These…

Information Retrieval · Computer Science 2024-08-20 Varsha Kishore , Chao Wan , Justin Lovelace , Yoav Artzi , Kilian Q. Weinberger

Retrieval approaches that score documents based on learned dense vectors (i.e., dense retrieval) rather than lexical signals (i.e., conventional retrieval) are increasingly popular. Their ability to identify related documents that do not…

Information Retrieval · Computer Science 2023-08-01 Hrishikesh Kulkarni , Sean MacAvaney , Nazli Goharian , Ophir Frieder

Query Performance Prediction (QPP) estimates the effectiveness of a search engine's results in response to a query without relevance judgments. Traditionally, post-retrieval predictors have focused upon either the distribution of the…

Information Retrieval · Computer Science 2023-10-18 Maria Vlachou , Craig Macdonald

A number of learned sparse and dense retrieval approaches have recently been proposed and proven effective in tasks such as passage retrieval and document retrieval. In this paper we analyze with a replicability study if the lessons learned…

Information Retrieval · Computer Science 2023-01-16 Gustavo Penha , Claudia Hauff

Large language models (LLMs) are incredible and versatile tools for text-based tasks that have enabled countless, previously unimaginable, applications. Retrieval models, in contrast, have not yet seen such capable general-purpose models…

Information Retrieval · Computer Science 2025-09-10 Julian Killingback , Hamed Zamani

Generative retrieval generates identifiers of relevant documents in an end-to-end manner using a sequence-to-sequence architecture for a given query. The relation between generative retrieval and other retrieval methods, especially those…

Information Retrieval · Computer Science 2024-04-02 Shiguang Wu , Wenda Wei , Mengqi Zhang , Zhumin Chen , Jun Ma , Zhaochun Ren , Maarten de Rijke , Pengjie Ren

The integration of external personalized context information into document-grounded conversational systems has significant potential business value, but has not been well-studied. Motivated by the concept of personalized context-aware…

Artificial Intelligence · Computer Science 2023-08-29 Hui Wan , Hongkang Li , Songtao Lu , Xiaodong Cui , Marina Danilevsky

Rerankers, typically cross-encoders, are computationally intensive but are frequently used because they are widely assumed to outperform cheaper initial IR systems. We challenge this assumption by measuring reranker performance for full…

Information Retrieval · Computer Science 2025-07-14 Mathew Jacob , Erik Lindgren , Matei Zaharia , Michael Carbin , Omar Khattab , Andrew Drozdov

Generative retrieval represents a novel approach to information retrieval. It uses an encoder-decoder architecture to directly produce relevant document identifiers (docids) for queries. While this method offers benefits, current approaches…

Information Retrieval · Computer Science 2024-09-30 Yubao Tang , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Wei Chen , Xueqi Cheng