English
Related papers

Related papers: Rank-K: Test-Time Reasoning for Listwise Reranking

200 papers

Large Language Models (LLMs) can exhibit considerable variation in the quality of their sampled outputs. Reranking and selecting the best generation from the sampled set is a popular way of obtaining strong gains in generation quality. In…

Artificial Intelligence · Computer Science 2024-01-15 Siddhartha Jain , Xiaofei Ma , Anoop Deoras , Bing Xiang

Reasoning-intensive retrieval requires deep semantic inference beyond surface-level keyword matching, posing a challenge for current LLM-based rerankers limited by context constraints and order sensitivity. We propose \textbf{\BracketRank},…

Information Retrieval · Computer Science 2026-04-13 Abdelrahman Abdallah , Mohammed Ali , Bhawna Piryani , Adam Jatowt

Efficiently ranking relevant items from large candidate pools is a cornerstone of modern information retrieval systems -- such as web search, recommendation, and retrieval-augmented generation. Listwise rerankers, which improve relevance by…

Information Retrieval · Computer Science 2025-06-30 Evgeny Dedov

Document reranking is a key component in information retrieval (IR), aimed at refining initial retrieval results to improve ranking quality for downstream tasks. Recent studies--motivated by large reasoning models (LRMs)--have begun…

Information Retrieval · Computer Science 2025-10-13 Xuan Lu , Haohang Huang , Rui Meng , Yaohui Jin , Wenjun Zeng , Xiaoyu Shen

Reranking is a critical component of modern retrieval systems, which typically pair an efficient first-stage retriever with a more expressive model to refine results. While large reasoning models have driven rapid progress in text-centric…

Information Retrieval · Computer Science 2026-02-04 Tyler Skow , Alexander Martin , Benjamin Van Durme , Rama Chellappa , Reno Kriz

Accurate document retrieval is crucial for the success of retrieval-augmented generation (RAG) applications, including open-domain question answering and code completion. While large language models (LLMs) have been employed as dense…

Computation and Language · Computer Science 2024-11-04 Tong Niu , Shafiq Joty , Ye Liu , Caiming Xiong , Yingbo Zhou , Semih Yavuz

The conventional paradigm in neural question answering (QA) for narrative content is limited to a two-stage process: first, relevant text passages are retrieved and, subsequently, a neural network for machine comprehension extracts the…

Computation and Language · Computer Science 2019-08-13 Bernhard Kratzwald , Anna Eigenmann , Stefan Feuerriegel

In various natural language processing tasks, passage retrieval and passage re-ranking are two key procedures in finding and ranking relevant information. Since both the two procedures contribute to the final performance, it is important to…

Computation and Language · Computer Science 2023-04-25 Ruiyang Ren , Yingqi Qu , Jing Liu , Wayne Xin Zhao , Qiaoqiao She , Hua Wu , Haifeng Wang , Ji-Rong Wen

Large Language Models (LLMs) have demonstrated superior performance in listwise passage reranking task. However, directly applying them to rank long-form documents introduces both effectiveness and efficiency issues due to the substantially…

Information Retrieval · Computer Science 2026-03-26 Jincheng Feng , Wenhan Liu , Zhicheng Dou

Multi-stage information retrieval (IR) has become a widely-adopted paradigm in search. While Large Language Models (LLMs) have been extensively evaluated as second-stage reranking models for monolingual IR, a systematic large-scale…

Computation and Language · Computer Science 2025-09-19 Longfei Zuo , Pingjun Hong , Oliver Kraus , Barbara Plank , Robert Litschko

Deep research agents rely on iterative retrieval and reasoning to answer complex queries, but scaling test-time computation raises significant efficiency concerns. We study how to allocate reasoning budget in deep search pipelines, focusing…

Information Retrieval · Computer Science 2026-01-21 Sahel Sharifymoghaddam , Jimmy Lin

Recent advances have demonstrated that large language models (LLMs) excel as listwise rerankers, but their high computational demands remain a barrier to widespread adoption. Further, the traditional language modeling (LM) objective is not…

Information Retrieval · Computer Science 2024-11-13 Zijian Chen , Ronak Pradeep , Jimmy Lin

Listwise reranking with large language models (LLMs) enhances top-ranked results in retrieval-based applications. Due to the limit in context size and high inference cost of long context, reranking is typically performed over a fixed size…

Information Retrieval · Computer Science 2025-10-27 Soyoung Yoon , Gyuwan Kim , Gyu-Hwung Cho , Seung-won Hwang

The classical cascading pipeline of retrieve--rerank suffers from a bounded recall problem, stemming from limitations of the first-stage retriever. Most current approaches address the bounded recall problem by improving the first-stage…

Information Retrieval · Computer Science 2026-05-01 Mandeep Rathee , V Venktesh , Sean MacAvaney , Avishek Anand

Utilizing large language models (LLMs) for document reranking has been a popular and promising research direction in recent years, many studies are dedicated to improving the performance and efficiency of using LLMs for reranking. Besides,…

Information Retrieval · Computer Science 2025-04-11 Qi Liu , Haozhe Duan , Yiqun Chen , Quanfeng Lu , Weiwei Sun , Jiaxin Mao

In this work, we present a systematic and comprehensive empirical evaluation of state-of-the-art reranking methods, encompassing large language model (LLM)-based, lightweight contextual, and zero-shot approaches, with respect to their…

Computation and Language · Computer Science 2025-08-26 Abdelrahman Abdallah , Bhawna Piryani , Jamshid Mozafari , Mohammed Ali , Adam Jatowt

Large Language Models (LLMs) have shown remarkable capabilities in reasoning, exemplified by the success of OpenAI-o1 and DeepSeek-R1. However, integrating reasoning with external search processes remains challenging, especially for complex…

Most conventional Retrieval-Augmented Generation (RAG) pipelines rely on relevance-based retrieval, which often misaligns with utility -- that is, whether the retrieved passages actually improve the quality of the generated text specific to…

Information Retrieval · Computer Science 2026-01-28 Manish Chandra , Debasis Ganguly , Iadh Ounis

We propose a simple and effective re-ranking method for improving passage retrieval in open question answering. The re-ranker re-scores retrieved passages with a zero-shot question generation model, which uses a pre-trained language model…

Computation and Language · Computer Science 2023-04-04 Devendra Singh Sachan , Mike Lewis , Mandar Joshi , Armen Aghajanyan , Wen-tau Yih , Joelle Pineau , Luke Zettlemoyer

Text embedding models serve as a fundamental component in real-world search applications. By mapping queries and documents into a shared embedding space, they deliver competitive retrieval performance with high efficiency. However, their…

Computation and Language · Computer Science 2025-11-03 Qi Liu , Yanzhao Zhang , Mingxin Li , Dingkun Long , Pengjun Xie , Jiaxin Mao