English
Related papers

Related papers: Unsupervised dense retrieval with conterfactual co…

200 papers

Pseudo-relevance feedback (PRF) can enhance average retrieval effectiveness over a sufficiently large number of queries. However, PRF often introduces a drift into the original information need, thus hurting the retrieval effectiveness of…

Information Retrieval · Computer Science 2024-01-23 Suchana Datta , Debasis Ganguly , Sean MacAvaney , Derek Greene

Information retrieval involves selecting artifacts from a corpus that are most relevant to a given search query. The flavor of retrieval typically used in classical applications can be termed as homogeneous and relaxed, where queries and…

Information Retrieval · Computer Science 2023-10-10 Anirudh Khatry , Yasharth Bajpai , Priyanshu Gupta , Sumit Gulwani , Ashish Tiwari

Unsupervised contrastive learning has shown significant performance improvements in recent years, often approaching or even rivaling supervised learning in various tasks. However, its learning mechanism is fundamentally different from…

Machine Learning · Computer Science 2026-03-05 Yi-Ge Zhang , Jingyi Cui , Qiran Li , Yisen Wang

The prevalence of machine learning models in various industries has led to growing demands for model interpretability and for the ability to provide meaningful recourse to users. For example, patients hoping to improve their diagnoses or…

Machine Learning · Computer Science 2021-05-28 Daniel Nemirovsky , Nicolas Thiebaut , Ye Xu , Abhishek Gupta

Large Language Models (LLMs) have shown strong capabilities in document re-ranking, a key component in modern Information Retrieval (IR) systems. However, existing LLM-based approaches face notable limitations, including ranking…

Information Retrieval · Computer Science 2025-10-03 Pinhuan Wang , Zhiqiu Xia , Chunhua Liao , Feiyi Wang , Hang Liu

Dense retrievers compress source documents into (possibly lossy) vector representations, yet there is little analysis of what information is lost versus preserved, and how it affects downstream tasks. We conduct the first analysis of the…

Computation and Language · Computer Science 2024-10-07 Seraphina Goldfarb-Tarrant , Pedro Rodriguez , Jane Dwivedi-Yu , Patrick Lewis

When a retrieval system receives a query it has encountered before, previous relevance feedback, such as clicks or explicit judgments can help to improve retrieval results. However, the content of a previously relevant document may have…

Information Retrieval · Computer Science 2025-02-07 Jüri Keller , Maik Fröbe , Gijs Hendriksen , Daria Alexander , Martin Potthast , Matthias Hagen , Philipp Schaer

Information retrieval plays a crucial role in resource localization. Current dense retrievers retrieve the relevant documents within a corpus via embedding similarities, which compute similarities between dense vectors mainly depending on…

Information Retrieval · Computer Science 2025-05-30 Ganlin Xu , Zhoujia Zhang , Wangyi Mei , Jiaqing Liang , Weijia Lu , Xiaodong Zhang , Zhifei Yang , Xiaofeng Ma , Yanghua Xiao , Deqing Yang

The task of Information Retrieval (IR) requires a system to identify relevant documents based on users' information needs. In real-world scenarios, retrievers are expected to not only rely on the semantic relevance between the documents and…

Information Retrieval · Computer Science 2024-05-07 Xinran Zhao , Tong Chen , Sihao Chen , Hongming Zhang , Tongshuang Wu

Information Retriever (IR) aims to find the relevant documents (e.g. snippets, passages, and articles) to a given query at large scale. IR plays an important role in many tasks such as open domain question answering and dialogue systems,…

Computation and Language · Computer Science 2022-06-01 Man Luo

Spurious correlations threaten the validity of statistical classifiers. While model accuracy may appear high when the test data is from the same distribution as the training data, it can quickly degrade when the test distribution changes.…

Machine Learning · Computer Science 2020-12-21 Zhao Wang , Aron Culotta

Query rewriting is a fundamental technique in information retrieval (IR). It typically employs the retrieval result as relevance feedback to refine the query and thereby addresses the vocabulary mismatch between user queries and relevant…

Information Retrieval · Computer Science 2025-10-30 Yiteng Tu , Weihang Su , Yujia Zhou , Yiqun Liu , Fen Lin , Qin Liu , Qingyao Ai

Dense retrieval has shown promise in the first-stage retrieval process when trained on in-domain labeled datasets. However, previous studies have found that dense retrieval is hard to generalize to unseen domains due to its weak modeling of…

Information Retrieval · Computer Science 2023-05-19 Shicheng Xu , Liang Pang , Huawei Shen , Xueqi Cheng

Despite the efficacy on a variety of computer vision tasks, deep neural networks (DNNs) are vulnerable to adversarial attacks, limiting their applications in security-critical systems. Recent works have shown the possibility of generating…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Ziang Yan , Yiwen Guo , Changshui Zhang

Relevance plays a central role in information retrieval (IR), which has received extensive studies starting from the 20th century. The definition and the modeling of relevance has always been critical challenges in both information science…

Information Retrieval · Computer Science 2021-03-02 Yixing Fan , Jiafeng Guo , Xinyu Ma , Ruqing Zhang , Yanyan Lan , Xueqi Cheng

In this paper, we systematically study the potential of pre-training with Large Language Model(LLM)-based document expansion for dense passage retrieval. Concretely, we leverage the capabilities of LLMs for document expansion, i.e. query…

Information Retrieval · Computer Science 2023-08-17 Guangyuan Ma , Xing Wu , Peng Wang , Zijia Lin , Songlin Hu

Retriever-reader models achieve competitive performance across many different NLP tasks such as open question answering and dialogue conversations. In this work, we notice these models easily overfit the top-rank retrieval passages and…

Computation and Language · Computer Science 2022-11-04 Shujian Zhang , Chengyue Gong , Xingchao Liu

Dense retrievers have achieved state-of-the-art performance in various information retrieval tasks, but their robustness against tokenizer poisoning remains underexplored. In this work, we assess the vulnerability of dense retrieval systems…

Computation and Language · Computer Science 2024-10-29 Ming Zhong , Zhizhi Wu , Nanako Honda

Dense passage retrieval (DPR) is the first step in the retrieval augmented generation (RAG) paradigm for improving the performance of large language models (LLM). DPR fine-tunes pre-trained networks to enhance the alignment of the…

Computation and Language · Computer Science 2024-10-07 Benjamin Reichman , Larry Heck

Contextual ranking models have delivered impressive performance improvements over classical models in the document ranking task. However, these highly over-parameterized models tend to be data-hungry and require large amounts of data even…

Information Retrieval · Computer Science 2023-11-28 Abhijit Anand , Jurek Leonhardt , Jaspreet Singh , Koustav Rudra , Avishek Anand