English
Related papers

Related papers: RocketQA: An Optimized Training Approach to Dense …

200 papers

This paper considers the reading comprehension task in which multiple documents are given as input. Prior work has shown that a pipeline of retriever, reader, and reranker can improve the overall performance. However, the pipeline system is…

Computation and Language · Computer Science 2019-06-12 Minghao Hu , Yuxing Peng , Zhen Huang , Dongsheng Li

Retrieving evidences from tabular and textual resources is essential for open-domain question answering (OpenQA), which provides more comprehensive information. However, training an effective dense table-text retriever is difficult due to…

Computation and Language · Computer Science 2022-10-14 Junjie Huang , Wanjun Zhong , Qian Liu , Ming Gong , Daxin Jiang , Nan Duan

In open question answering (QA), the answer to a question is produced by retrieving and then analyzing documents that might contain answers to the question. Most open QA systems have considered only retrieving information from unstructured…

Computation and Language · Computer Science 2021-02-11 Wenhu Chen , Ming-Wei Chang , Eva Schlinger , William Wang , William W. Cohen

Open Domain Question Answering (ODQA) has been advancing rapidly in recent times, driven by significant developments in dense passage retrieval and pretrained language models. Current models typically incorporate the FiD framework, which is…

Computation and Language · Computer Science 2024-08-13 Yufei Huang , Xu Han , Maosong Sun

We consider the problem of pretraining a two-stage open-domain question answering (QA) system (retriever + reader) with strong transfer capabilities. The key challenge is how to construct a large amount of high-quality…

Computation and Language · Computer Science 2022-03-23 Xiang Yue , Xiaoman Pan , Wenlin Yao , Dian Yu , Dong Yu , Jianshu Chen

Temporal awareness is crucial in many information retrieval tasks, particularly in scenarios where the relevance of documents depends on their alignment with the query's temporal context. Traditional approaches such as BM25 and Dense…

Information Retrieval · Computer Science 2025-04-09 Abdelrahman Abdallah , Bhawna Piryani , Jonas Wallat , Avishek Anand , Adam Jatowt

We introduce an approach for open-domain question answering (QA) that retrieves and reads a passage graph, where vertices are passages of text and edges represent relationships that are derived from an external knowledge base or…

Computation and Language · Computer Science 2020-04-14 Sewon Min , Danqi Chen , Luke Zettlemoyer , Hannaneh Hajishirzi

Dense retrieval, as the core component of e-commerce search engines, maps user queries and items into a unified semantic space through pre-trained embedding models to enable large-scale real-time semantic retrieval. Despite the rapid…

Information Retrieval · Computer Science 2026-02-10 Xingxian Liu , Dongshuai Li , Jiahui Wan , Tao Wen , Gui Ling , Yuliang Yan , Fuyu Lv , Dan Ou , Haihong Tang , Bo Zheng

Passage retrieval is a fundamental task in many information systems, such as web search and question answering, where both efficiency and effectiveness are critical concerns. In recent years, neural retrievers based on pre-trained language…

Information Retrieval · Computer Science 2024-03-21 Qian Dong , Yiding Liu , Qingyao Ai , Haitao Li , Shuaiqiang Wang , Yiqun Liu , Dawei Yin , Shaoping Ma

Recently, the retrieval models based on dense representations have been gradually applied in the first stage of the document retrieval tasks, showing better performance than traditional sparse vector space models. To obtain high efficiency,…

Information Retrieval · Computer Science 2021-08-20 Hongyin Tang , Xingwu Sun , Beihong Jin , Jingang Wang , Fuzheng Zhang , Wei Wu

We investigate the exploitation of both lexical and neural relevance signals for ad-hoc passage retrieval. Our exploration involves a large-scale training dataset in which dense neural representations of MS-MARCO queries and passages are…

Information Retrieval · Computer Science 2025-10-21 Franco Maria Nardini , Raffaele Perego , Nicola Tonellotto , Salvatore Trani

In this work, we address multi-modal information needs that contain text questions and images by focusing on passage retrieval for outside-knowledge visual question answering. This task requires access to outside knowledge, which in our…

Information Retrieval · Computer Science 2021-05-11 Chen Qu , Hamed Zamani , Liu Yang , W. Bruce Croft , Erik Learned-Miller

Dense retrievers for open-domain question answering (ODQA) have been shown to achieve impressive performance by training on large datasets of question-passage pairs. In this work we ask whether this dependence on labeled data can be reduced…

Computation and Language · Computer Science 2022-05-18 Ori Ram , Gal Shachaf , Omer Levy , Jonathan Berant , Amir Globerson

In this paper, we propose a new dense retrieval model which learns diverse document representations with deep query interactions. Our model encodes each document with a set of generated pseudo-queries to get query-informed, multi-view…

Information Retrieval · Computer Science 2022-08-09 Zehan Li , Nan Yang , Liang Wang , Furu Wei

Question answering is a task that answers factoid questions using a large collection of documents. It aims to provide precise answers in response to the user's questions in natural language. Question answering relies on efficient passage…

Computation and Language · Computer Science 2023-08-09 Shashank Gupta

Most domain adaptation methods for machine reading comprehension (MRC) use a pre-trained question-answer (QA) construction model to generate pseudo QA pairs for MRC transfer. Such a process will inevitably introduce mismatched pairs (i.e.,…

Machine Learning · Computer Science 2022-09-26 Liang Jiang , Zhenyu Huang , Jia Liu , Zujie Wen , Xi Peng

In table-text open-domain question answering, a retriever system retrieves relevant evidence from tables and text to answer questions. Previous studies in table-text open-domain question answering have two common challenges: firstly, their…

Computation and Language · Computer Science 2024-03-27 Deokhyung Kang , Baikjin Jung , Yunsu Kim , Gary Geunbae Lee

A fundamental trade-off between effectiveness and efficiency needs to be balanced when designing an online question answering system. Effectiveness comes from sophisticated functions such as extractive machine reading comprehension (MRC),…

Computation and Language · Computer Science 2019-08-14 Ming Yan , Jiangnan Xia , Chen Wu , Bin Bi , Zhongzhou Zhao , Ji Zhang , Luo Si , Rui Wang , Wei Wang , Haiqing Chen

Most state-of-the-art open-domain question answering systems use a neural retrieval model to encode passages into continuous vectors and extract them from a knowledge source. However, such retrieval models often require large memory to run…

Computation and Language · Computer Science 2021-06-03 Ikuya Yamada , Akari Asai , Hannaneh Hajishirzi

Building automatic technical support system is an important yet challenge task. Conceptually, to answer a user question on a technical forum, a human expert has to first retrieve relevant documents, and then read them carefully to identify…

Computation and Language · Computer Science 2021-05-19 Wenhao Yu , Lingfei Wu , Yu Deng , Qingkai Zeng , Ruchi Mahindru , Sinem Guven , Meng Jiang