English
Related papers

Related papers: MultiContrievers: Analysis of Dense Retrieval Repr…

200 papers

This article aims to provide the information retrieval community with some reflections on recent advances in retrieval learning by analyzing the reproducibility of image-text retrieval models. Due to the increase of multimodal data over the…

Information Retrieval · Computer Science 2022-08-30 Jun Rao , Fei Wang , Liang Ding , Shuhan Qi , Yibing Zhan , Weifeng Liu , Dacheng Tao

Despite the advantages of their low-resource settings, traditional sparse retrievers depend on exact matching approaches between high-dimensional bag-of-words (BoW) representations of both the queries and the collection. As a result,…

Information Retrieval · Computer Science 2024-04-16 Dahlia Shehata

This work investigates the effect of gender-stereotypical biases in the content of retrieved results on the relevance judgement of users/annotators. In particular, since relevance in information retrieval (IR) is a multi-dimensional…

Information Retrieval · Computer Science 2022-03-04 Klara Krieg , Emilia Parada-Cabaleiro , Markus Schedl , Navid Rekabsaz

Explaining why dense retrievers assign high relevance scores remains challenging because retrieval decisions are made through opaque high-dimensional embeddings. Existing explanations often focus on surface signals, such as lexical matches,…

Artificial Intelligence · Computer Science 2026-05-29 Zhixin Cai , Jun Bai , Yang Liu , Jiaqi Li , Yichi Zhang , Taichuan Li , Zhuofan Chen , Zixia Jia , Zilong Zheng , Wenge Rong

Knowledge-intensive tasks, particularly open-domain question answering (ODQA), document reranking, and retrieval-augmented language modeling, require a balance between retrieval accuracy and generative flexibility. Traditional retrieval…

Computation and Language · Computer Science 2025-02-28 Abdelrahman Abdallah , Jamshid Mozafari , Bhawna Piryani , Mohammed Ali , Adam Jatowt

Pre-trained language models have been successful in many knowledge-intensive NLP tasks. However, recent work has shown that models such as BERT are not ``structurally ready'' to aggregate textual information into a [CLS] vector for dense…

Information Retrieval · Computer Science 2023-05-26 Sheng-Chieh Lin , Minghan Li , Jimmy Lin

Efficiently retrieving a concise set of candidates from a large document corpus remains a pivotal challenge in Information Retrieval (IR). Neural retrieval models, particularly dense retrieval models built with transformers and pretrained…

Information Retrieval · Computer Science 2025-01-01 Haitian Chen , Qingyao Ai , Xiao Wang , Yiqun Liu , Fen Lin , Qin Liu

Dense retrieval has become the new paradigm in passage retrieval. Despite its effectiveness on typo-free queries, it is not robust when dealing with queries that contain typos. Current works on improving the typo-robustness of dense…

Information Retrieval · Computer Science 2024-03-19 Georgios Sidiropoulos , Evangelos Kanoulas

Query Performance Prediction (QPP) estimates the effectiveness of a search engine's results in response to a query without relevance judgments. Traditionally, post-retrieval predictors have focused upon either the distribution of the…

Information Retrieval · Computer Science 2023-10-18 Maria Vlachou , Craig Macdonald

Information retrieval involves selecting artifacts from a corpus that are most relevant to a given search query. The flavor of retrieval typically used in classical applications can be termed as homogeneous and relaxed, where queries and…

Information Retrieval · Computer Science 2023-10-10 Anirudh Khatry , Yasharth Bajpai , Priyanshu Gupta , Sumit Gulwani , Ashish Tiwari

The dual-encoder has become the de facto architecture for dense retrieval. Typically, it computes the latent representations of the query and document independently, thus failing to fully capture the interactions between the query and…

Computation and Language · Computer Science 2023-10-31 Xingwei He , Yeyun Gong , A-Long Jin , Hang Zhang , Anlei Dong , Jian Jiao , Siu Ming Yiu , Nan Duan

Dense retrievers have achieved impressive performance, but their demand for abundant training data limits their application scenarios. Contrastive pre-training, which constructs pseudo-positive examples from unlabeled data, has shown great…

Information Retrieval · Computer Science 2023-06-07 Yibin Lei , Liang Ding , Yu Cao , Changtong Zan , Andrew Yates , Dacheng Tao

The task of Information Retrieval (IR) requires a system to identify relevant documents based on users' information needs. In real-world scenarios, retrievers are expected to not only rely on the semantic relevance between the documents and…

Information Retrieval · Computer Science 2024-05-07 Xinran Zhao , Tong Chen , Sihao Chen , Hongming Zhang , Tongshuang Wu

Dense retrievers utilize pre-trained backbone language models (e.g., BERT, LLaMA) that are fine-tuned via contrastive learning to perform the task of encoding text into sense representations that can be then compared via a shallow…

Information Retrieval · Computer Science 2025-05-13 Zheng Yao , Shuai Wang , Guido Zuccon

Large vision-language models increasingly rely on long-context modeling to reason over documents, hour-level videos, and long-horizon agent trajectories, requiring them to locate relevant evidence across interleaved text and images. Prior…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Aaron Branson Cigres Li , Zhaowei Wang , Yu Zhao , Yiming Du , Haobo Li , Xiyu Ren , Ginny Wong , Simon See , Lishu Luo , Haodong Duan , Pasquale Minervini , Yangqiu Song

Ranker and retriever are two important components in dense passage retrieval. The retriever typically adopts a dual-encoder model, where queries and documents are separately input into two pre-trained models, and the vectors generated by…

Information Retrieval · Computer Science 2023-12-29 Haifeng Li , Mo Hai , Dong Tang

Conversational search provides a natural interface for information retrieval (IR). Recent approaches have demonstrated promising results in applying dense retrieval to conversational IR. However, training dense retrievers requires large…

Computation and Language · Computer Science 2023-09-14 Chao-Wei Huang , Chen-Yu Hsu , Tsu-Yuan Hsu , Chen-An Li , Yun-Nung Chen

Recent research demonstrates the effectiveness of using fine-tuned language models~(LM) for dense retrieval. However, dense retrievers are hard to train, typically requiring heavily engineered fine-tuning pipelines to realize their full…

Information Retrieval · Computer Science 2021-08-13 Luyu Gao , Jamie Callan

Dense retrieval models using a transformer-based bi-encoder design have emerged as an active area of research. In this work, we focus on the task of monolingual retrieval in a variety of typologically diverse languages using one such…

Information Retrieval · Computer Science 2022-04-06 Xinyu Zhang , Kelechi Ogueji , Xueguang Ma , Jimmy Lin

The task of information retrieval is an important component of many natural language processing systems, such as open domain question answering. While traditional methods were based on hand-crafted features, continuous representations based…

Computation and Language · Computer Science 2022-08-05 Gautier Izacard , Edouard Grave