English
Related papers

Related papers: Drowning in Documents: Consequences of Scaling Rer…

200 papers

Large-scale retrieval systems are often implemented as a cascading sequence of phases -- a first filtering step, in which a large set of candidate documents are extracted using a simple technique such as Boolean matching and/or static…

Information Retrieval · Computer Science 2015-06-03 Charles L. A. Clarke , J. Shane Culpepper , Alistair Moffat

Vocabulary mismatch is a central problem in information retrieval (IR), i.e., the relevant documents may not contain the same (symbolic) terms of the query. Recently, neural representations have shown great success in capturing semantic…

Information Retrieval · Computer Science 2018-07-24 Yan Xiao , Jiafeng Guo , Yixing Fan , Yanyan Lan , Jun Xu , Xueqi Cheng

With the growing popularity of LLM agents and RAG, it has become increasingly important to retrieve documents that are essential for solving a task, even when their connection to the task is indirect or implicit. Addressing this problem…

Information Retrieval · Computer Science 2025-10-14 Junwei Lan , Jianlyu Chen , Zheng Liu , Chaofan Li , Siqi Bao , Defu Lian

Establishing a docker-based replicability infrastructure offers the community a great opportunity: measuring the run time of information retrieval systems. The time required to present query results to a user is paramount to the users…

Information Retrieval · Computer Science 2019-07-11 Sebastian Hofstätter , Allan Hanbury

Despite the advantages of their low-resource settings, traditional sparse retrievers depend on exact matching approaches between high-dimensional bag-of-words (BoW) representations of both the queries and the collection. As a result,…

Information Retrieval · Computer Science 2022-08-11 Dahlia Shehata , Negar Arabzadeh , Charles L. A. Clarke

In an era dominated by information overload, effective recommender systems are essential for managing the deluge of data across digital platforms. Multi-stage cascade ranking systems are widely used in the industry, with retrieval and…

Information Retrieval · Computer Science 2025-10-14 Junjie Huang , Jizheng Chen , Jianghao Lin , Jiarui Qin , Ziming Feng , Weinan Zhang , Yong Yu

For multi-stage recommenders in industry, a user request would first trigger a simple and efficient retriever module that selects and ranks a list of relevant items, then the recommender calls a slower but more sophisticated reranking model…

Information Retrieval · Computer Science 2026-05-19 Wenyu Mao , Shuchang Liu , Hailan Yang , Xiaobei Wang , Xiaoyu Yang , Xu Gao , Xiang Li , Lantao Hu , Han Li , Kun Gai , An Zhang , Xiang Wang

Dense retrieval is becoming one of the standard approaches for document and passage ranking. The dual-encoder architecture is widely adopted for scoring question-passage pairs due to its efficiency and high performance. Typically, dense…

Information Retrieval · Computer Science 2022-05-06 Georgios Sidiropoulos , Evangelos Kanoulas

The ever-increasing size of language models curtails their widespread availability to the community, thereby galvanizing many companies into offering access to large language models through APIs. One particular type, suitable for dense…

Information Retrieval · Computer Science 2023-07-10 Ehsan Kamalloo , Xinyu Zhang , Odunayo Ogundepo , Nandan Thakur , David Alfonso-Hermelo , Mehdi Rezagholizadeh , Jimmy Lin

Retrieve-and-rerank is a popular retrieval pipeline because of its ability to make slow but effective rerankers efficient enough at query time by reducing the number of comparisons. Recent works in neural rerankers take advantage of large…

Information Retrieval · Computer Science 2025-05-21 Eugene Yang , Andrew Yates , Kathryn Ricci , Orion Weller , Vivek Chari , Benjamin Van Durme , Dawn Lawrie

Listwise reranking is a key yet computationally expensive component in vision-centric retrieval and multimodal retrieval-augmented generation (M-RAG) over long documents. While recent VLM-based rerankers achieve strong accuracy, their…

Information Retrieval · Computer Science 2026-05-13 Yiqun Sun , Pengfei Wei , Lawrence B. Hsieh

Current state-of-the-art approaches to cross-modal retrieval process text and visual input jointly, relying on Transformer-based architectures with cross-attention mechanisms that attend over all words and objects in an image. While…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Gregor Geigle , Jonas Pfeiffer , Nils Reimers , Ivan Vulić , Iryna Gurevych

Recent advances have demonstrated that large language models (LLMs) excel as listwise rerankers, but their high computational demands remain a barrier to widespread adoption. Further, the traditional language modeling (LM) objective is not…

Information Retrieval · Computer Science 2024-11-13 Zijian Chen , Ronak Pradeep , Jimmy Lin

Recent advances in embedding-based retrieval have enabled dense retrievers to serve as core infrastructure in many industrial systems, where a single retrieval backbone is often shared across multiple downstream applications. In such…

Information Retrieval · Computer Science 2026-04-21 Yunhan Li , Mingjie Xie , Zihan Gong , Zeyang Shi , Gengshen Wu , Min Yang

Information retrieval systems such as open web search and recommendation systems are ubiquitous and significantly impact how people receive and consume online information. Previous research has shown the importance of fairness in…

Information Retrieval · Computer Science 2025-03-28 Fumian Chen , Hui Fang

Dense encoders and LLM-based rerankers struggle with long documents: single-vector representations dilute fine-grained relevance, while cross-encoders are often too expensive for practical reranking. We present an efficient long-document…

Information Retrieval · Computer Science 2026-02-06 Minghan Li , Eric Gaussier , Guodong Zhou

With the recent success of dense retrieval methods based on bi-encoders, studies have applied this approach to various interesting downstream retrieval tasks with good efficiency and in-domain effectiveness. Recently, we have also seen the…

Information Retrieval · Computer Science 2022-10-24 Wei Zhong , Jheng-Hong Yang , Yuqing Xie , Jimmy Lin

Large language model (LLM) based listwise reranking has emerged as the dominant paradigm for achieving state-of-the-art ranking effectiveness in information retrieval. However, its reliance on feeding full passage texts into the LLM…

Information Retrieval · Computer Science 2026-04-27 Xiaojie Ke , Shuai Zhang , Liansheng Sun , Yongjin Wang , Hengjun Jiang , Xiangkun Liu , Cunxin Gu , Jian Xu , Guanjun Jiang

Large Language Models (LLMs) have shown strong capabilities in document re-ranking, a key component in modern Information Retrieval (IR) systems. However, existing LLM-based approaches face notable limitations, including ranking…

Information Retrieval · Computer Science 2025-10-03 Pinhuan Wang , Zhiqiu Xia , Chunhua Liao , Feiyi Wang , Hang Liu

State-of-the-art neural models typically encode document-query pairs using cross-attention for re-ranking. To this end, models generally utilize an encoder-only (like BERT) paradigm or an encoder-decoder (like T5) approach. These paradigms,…

Computation and Language · Computer Science 2022-04-26 Kai Hui , Honglei Zhuang , Tao Chen , Zhen Qin , Jing Lu , Dara Bahri , Ji Ma , Jai Prakash Gupta , Cicero Nogueira dos Santos , Yi Tay , Don Metzler