English
Related papers

Related papers: Can we repurpose multiple-choice question-answerin…

200 papers

Recent advances in using retrieval components over external knowledge sources have shown impressive results for a variety of downstream tasks in natural language processing. Here, we explore the use of unstructured external knowledge…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Shir Gur , Natalia Neverova , Chris Stauffer , Ser-Nam Lim , Douwe Kiela , Austin Reiter

Retrieval-augmented generation (RAG) has shown promising potential in knowledge intensive question answering (QA). However, existing approaches only consider the query itself, neither specifying the retrieval preferences for the retrievers…

Information Retrieval · Computer Science 2025-02-18 Zhongwu Chen , Chengjin Xu , Dingmin Wang , Zhen Huang , Yong Dou , Xuhui Jiang , Jian Guo

Large language models augmented with task-relevant documents have demonstrated impressive performance on knowledge-intensive tasks. However, regarding how to obtain effective documents, the existing methods are mainly divided into two…

Computation and Language · Computer Science 2023-10-10 Zhangyin Feng , Xiaocheng Feng , Dezhi Zhao , Maojin Yang , Bing Qin

Search systems often employ a re-ranking pipeline, wherein documents (or passages) from an initial pool of candidates are assigned new ranking scores. The process enables the use of highly-effective but expensive scoring functions that are…

Information Retrieval · Computer Science 2022-08-19 Sean MacAvaney , Nicola Tonellotto , Craig Macdonald

In this paper, we propose to boost low-resource cross-lingual document retrieval performance with deep bilingual query-document representations. We match queries and documents in both source and target languages with four components, each…

Computation and Language · Computer Science 2019-06-11 Rui Zhang , Caitlin Westerfield , Sungrok Shim , Garrett Bingham , Alexander Fabbri , Neha Verma , William Hu , Dragomir Radev

Multi-Hop Question Answering (MHQA) tasks permeate real-world applications, posing challenges in orchestrating multi-step reasoning across diverse knowledge domains. While existing approaches have been improved with iterative retrieval,…

Machine Learning · Computer Science 2025-10-06 Rong Cheng , Jinyi Liu , Yan Zheng , Fei Ni , Jiazhen Du , Hangyu Mao , Fuzheng Zhang , Bo Wang , Jianye Hao

Accurate document retrieval is crucial for the success of retrieval-augmented generation (RAG) applications, including open-domain question answering and code completion. While large language models (LLMs) have been employed as dense…

Computation and Language · Computer Science 2024-11-04 Tong Niu , Shafiq Joty , Ye Liu , Caiming Xiong , Yingbo Zhou , Semih Yavuz

Retrieval-Augmented Generation (RAG) improves Large Language Models (LLMs) by grounding generation in external, non-parametric knowledge. However, when a task requires choosing among competing options, simply grounding generation in broadly…

Computation and Language · Computer Science 2026-03-20 Hangeol Chang , Changsun Lee , Seungjoon Rho , Junho Yeo , Jong Chul Ye

In this document I present an approach to answer validation and reranking for question answering (QA) systems. A cased-based reasoning (CBR) system judges answer candidates for questions from annotated answer candidates for earlier…

Artificial Intelligence · Computer Science 2015-03-11 Karl-Heinz Weis

Conversational search is one of the ultimate goals of information retrieval. Recent research approaches conversational search by simplified settings of response ranking and conversational question answering, where an answer is either…

Information Retrieval · Computer Science 2020-05-26 Chen Qu , Liu Yang , Cen Chen , Minghui Qiu , W. Bruce Croft , Mohit Iyyer

The results of information retrieval (IR) are usually presented in the form of a ranked list of candidate documents, such as web search for humans and retrieval-augmented generation for large language models (LLMs). List-aware retrieval…

Information Retrieval · Computer Science 2024-02-06 Shicheng Xu , Liang Pang , Jun Xu , Huawei Shen , Xueqi Cheng

This paper is a short description of an information retrieval system enhanced by three model driven retrieval services: (1) co-word analysis based query expansion, re-ranking via (2) Bradfordizing and (3) author centrality. The different…

Information Retrieval · Computer Science 2017-05-03 Philipp Schaer , Philipp Mayr , Peter Mutschke

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for enhancing the capabilities of large language models. However, existing RAG evaluation predominantly focuses on text retrieval and relies on opaque, end-to-end…

Information Retrieval · Computer Science 2025-05-19 Chuan Xu , Qiaosheng Chen , Yutong Feng , Gong Cheng

Information retrieval systems such as open web search and recommendation systems are ubiquitous and significantly impact how people receive and consume online information. Previous research has shown the importance of fairness in…

Information Retrieval · Computer Science 2025-03-28 Fumian Chen , Hui Fang

Question answering (QA) over tables and text has gained much popularity over the years. Multi-hop table-text QA requires multiple hops between the table and text, making it a challenging QA task. Although several works have attempted to…

Computation and Language · Computer Science 2024-10-02 Jayetri Bardhan , Bushi Xiao , Daisy Zhe Wang

One technique to improve the retrieval effectiveness of a search engine is to expand documents with terms that are related or representative of the documents' content.From the perspective of a question answering system, this might comprise…

Information Retrieval · Computer Science 2019-09-26 Rodrigo Nogueira , Wei Yang , Jimmy Lin , Kyunghyun Cho

The task of multiple choice question answering (MCQA) refers to identifying a suitable answer from multiple candidates, by estimating the matching score among the triple of the passage, question and answer. Despite the general research…

Computation and Language · Computer Science 2021-09-28 Xun Yao , Junlong Ma , Xinrong Hu , Junping Liu , Jie Yang , Wanqing Li

This paper introduces our proposed system for the MIA Shared Task on Cross-lingual Open-retrieval Question Answering (COQA). In this challenging scenario, given an input question the system has to gather evidence documents from a…

This resource paper addresses the challenge of evaluating Information Retrieval (IR) systems in the era of autoregressive Large Language Models (LLMs). Traditional methods relying on passage-level judgments are no longer effective due to…

Information Retrieval · Computer Science 2024-05-24 Laura Dietz

Supervised ranking methods based on bi-encoder or cross-encoder architectures have shown success in multi-stage text ranking tasks, but they require large amounts of relevance judgments as training data. In this work, we propose Listwise…

Information Retrieval · Computer Science 2023-05-04 Xueguang Ma , Xinyu Zhang , Ronak Pradeep , Jimmy Lin