English
Related papers

Related papers: Rider: Reader-Guided Passage Reranking for Open-Do…

200 papers

We propose a novel Chain Guided Retriever-reader ({\tt CGR}) framework to model the reasoning chain for multi-hop Science Question Answering. Our framework is capable of performing explainable reasoning without the need of any…

Computation and Language · Computer Science 2021-09-08 Weiwen Xu , Yang Deng , Huihui Zhang , Deng Cai , Wai Lam

Retrieval Augmented Generation (RAG) has greatly improved the performance of Large Language Model (LLM) responses by grounding generation with context from existing documents. These systems work well when documents are clearly relevant to a…

Computation and Language · Computer Science 2024-05-29 Jialin Dong , Bahare Fatemi , Bryan Perozzi , Lin F. Yang , Anton Tsitsulin

Ranking consistently emerges as a primary focus in information retrieval research. Retrieval and ranking models serve as the foundation for numerous applications, including web search, open domain QA, enterprise domain QA, and text-based…

Information Retrieval · Computer Science 2024-12-16 Hansa Meghwani

Recently, there has been increasing interest in applying large language models (LLMs) as zero-shot passage rankers. However, few studies have explored how to select appropriate in-context demonstrations for the passage ranking task, which…

Information Retrieval · Computer Science 2024-09-26 Wenhan Liu , Yutao Zhu , Zhicheng Dou

Given a query and a document corpus, the information retrieval (IR) task is to output a ranked list of relevant documents. Combining large language models (LLMs) with embedding-based retrieval models, recent work shows promising results on…

Computation and Language · Computer Science 2023-11-01 Daman Arora , Anush Kini , Sayak Ray Chowdhury , Nagarajan Natarajan , Gaurav Sinha , Amit Sharma

Answering multiple-choice questions in a setting in which no supporting documents are explicitly provided continues to stand as a core problem in natural language processing. The contribution of this article is two-fold. First, it describes…

Computation and Language · Computer Science 2019-11-15 George-Sebastian Pîrtoacă , Traian Rebedea , Stefan Ruseti

We introduce LADDER (Learning through Autonomous Difficulty-Driven Example Recursion), a framework which enables Large Language Models to autonomously improve their problem-solving capabilities through self-guided learning by recursively…

Machine Learning · Computer Science 2025-03-06 Toby Simonds , Akira Yoshiyama

Dense retrieval systems increasingly need to handle complex queries. In many realistic settings, users express intent through long instructions or task-specific descriptions, while target documents remain relatively simple and static. This…

Information Retrieval · Computer Science 2026-04-07 Seiji Maekawa , Moin Aminnaseri , Pouya Pezeshkpour , Estevam Hruschka

The task of Reading Comprehension with Multiple Choice Questions, requires a human (or machine) to read a given passage, question pair and select one of the n given options. The current state of the art model for this task first computes a…

Computation and Language · Computer Science 2019-04-05 Soham Parikh , Ananya B. Sai , Preksha Nema , Mitesh M. Khapra

Large language models (LLMs) achieve higher accuracy on challenging reasoning tasks by scaling test-time compute through multiple trajectory sampling. However, standard aggregation methods like majority voting or individual confidence-based…

Machine Learning · Computer Science 2026-02-04 Yingchuan Zhang , Terry Ma , Wenxuan Zhong , Ping Ma

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external documents at inference time, enabling up-to-date knowledge access without costly retraining. However, conventional RAG methods retrieve…

Computation and Language · Computer Science 2025-07-08 Ting-Wen Ko , Jyun-Yu Jiang , Pu-Jen Cheng

Recent developments of dense retrieval rely on quality representations of queries and contexts from pre-trained query and context encoders. In this paper, we introduce TOUR (Test-Time Optimization of Query Representations), which further…

Computation and Language · Computer Science 2023-05-30 Mujeen Sung , Jungsoo Park , Jaewoo Kang , Danqi Chen , Jinhyuk Lee

While the ``deep reasoning'' paradigm has spurred significant advances in verifiable domains like mathematics, its application to open-ended, creative generation remains a critical challenge. The two dominant methods for instilling…

Artificial Intelligence · Computer Science 2025-09-09 Haozhe Wang , Haoran Que , Qixin Xu , Minghao Liu , Wangchunshu Zhou , Jiazhan Feng , Wanjun Zhong , Wei Ye , Tong Yang , Wenhao Huang , Ge Zhang , Fangzhen Lin

Iterative retrieval refers to the process in which the model continuously queries the retriever during generation to enhance the relevance of the retrieved knowledge, thereby improving the performance of Retrieval-Augmented Generation…

Computation and Language · Computer Science 2024-12-02 Tian Yu , Shaolei Zhang , Yang Feng

Clinicians need ranking systems that work in real time and still justify their choices. Motivated by the need for a low-latency, decoder-based reranker, we present OG-Rank, a single-decoder approach that pairs a pooled first-token scoring…

Artificial Intelligence · Computer Science 2025-10-21 Praphul Singh , Corey Barrett , Sumana Srivasta , Irfan Bulu , Sri Gadde , Krishnaram Kenthapadi

Rerankers, typically cross-encoders, are computationally intensive but are frequently used because they are widely assumed to outperform cheaper initial IR systems. We challenge this assumption by measuring reranker performance for full…

Information Retrieval · Computer Science 2025-07-14 Mathew Jacob , Erik Lindgren , Matei Zaharia , Michael Carbin , Omar Khattab , Andrew Drozdov

Large language models (LLMs) have revolutionized natural language processing, yet hallucinations in knowledge-intensive tasks remain a critical challenge. Retrieval-augmented generation (RAG) addresses this by integrating external…

Computation and Language · Computer Science 2026-02-17 Zhipeng Song , Xiangyu Kong , Xinrui Bao , Yizhi Zhou , Jiulong Jiao , Sitong Liu , Yuhang Zhou , Heng Qi

Recent studies have demonstrated the effectiveness of using large language language models (LLMs) in passage ranking. The listwise approaches, such as RankGPT, have become new state-of-the-art in this task. However, the efficiency of…

Computation and Language · Computer Science 2025-01-29 Qi Liu , Bo Wang , Nan Wang , Jiaxin Mao

Inspired by the PageRank and HITS (hubs and authorities) algorithms for Web search, we propose a structural re-ranking approach to ad hoc information retrieval: we reorder the documents in an initially retrieved set by exploiting asymmetric…

Information Retrieval · Computer Science 2007-05-23 Oren Kurland , Lillian Lee

Dense retrievers have made significant strides in text retrieval and open-domain question answering. However, most of these achievements have relied heavily on extensive human-annotated supervision. In this study, we aim to develop…

Computation and Language · Computer Science 2024-10-31 Rui Meng , Ye Liu , Semih Yavuz , Divyansh Agarwal , Lifu Tu , Ning Yu , Jianguo Zhang , Meghana Bhat , Yingbo Zhou