English
Related papers

Related papers: Dense Passage Retrieval for Open-Domain Question A…

200 papers

We propose a simple and efficient multi-hop dense retrieval approach for answering complex open-domain questions, which achieves state-of-the-art performance on two multi-hop datasets, HotpotQA and multi-evidence FEVER. Contrary to previous…

Open-domain table question answering aims to provide answers to a question by retrieving and extracting information from a large collection of tables. Existing studies of open-domain table QA either directly adopt text retrieval methods or…

Computation and Language · Computer Science 2023-09-20 Nengzheng Jin , Dongfang Li , Junying Chen , Joanna Siebert , Qingcai Chen

In simple open-domain question answering (QA), dense retrieval has become one of the standard approaches for retrieving the relevant passages to infer an answer. Recently, dense retrieval also achieved state-of-the-art results in multi-hop…

Information Retrieval · Computer Science 2021-09-23 Georgios Sidiropoulos , Nikos Voskarides , Svitlana Vakulenko , Evangelos Kanoulas

Existing open-domain question answering (QA) models are not suitable for real-time usage because they need to process several long documents on-demand for every input query. In this paper, we introduce the query-agnostic indexable…

Computation and Language · Computer Science 2019-06-17 Minjoon Seo , Jinhyuk Lee , Tom Kwiatkowski , Ankur P. Parikh , Ali Farhadi , Hannaneh Hajishirzi

Dense retrieval has achieved impressive advances in first-stage retrieval from a large-scale document collection, which is built on bi-encoder architecture to produce single vector representation of query and document. However, a document…

Computation and Language · Computer Science 2022-03-17 Shunyu Zhang , Yaobo Liang , Ming Gong , Daxin Jiang , Nan Duan

Recent research demonstrates the effectiveness of using fine-tuned language models~(LM) for dense retrieval. However, dense retrievers are hard to train, typically requiring heavily engineered fine-tuning pipelines to realize their full…

Information Retrieval · Computer Science 2021-08-13 Luyu Gao , Jamie Callan

Dense retrieval methods have shown great promise over sparse retrieval methods in a range of NLP problems. Among them, dense phrase retrieval-the most fine-grained retrieval unit-is appealing because phrases can be directly used as the…

Computation and Language · Computer Science 2021-09-17 Jinhyuk Lee , Alexander Wettig , Danqi Chen

Neural passage retrieval is a new and promising approach in open retrieval question answering. In this work, we stress-test the Dense Passage Retriever (DPR) -- a state-of-the-art (SOTA) open domain neural retrieval model -- on closed and…

Computation and Language · Computer Science 2022-04-21 Revanth Gangi Reddy , Bhavani Iyer , Md Arafat Sultan , Rong Zhang , Avirup Sil , Vittorio Castelli , Radu Florian , Salim Roukos

Unlike the Open Domain Question Answering (ODQA) setting, the conversational (ODConvQA) domain has received limited attention when it comes to reevaluating baselines for both efficiency and effectiveness. In this paper, we study the…

Computation and Language · Computer Science 2023-10-24 Andrei C. Coman , Gianni Barlacchi , Adrià de Gispert

Recent work on open domain question answering (QA) assumes strong supervision of the supporting evidence and/or assumes a blackbox information retrieval (IR) system to retrieve evidence candidates. We argue that both are suboptimal, since…

Computation and Language · Computer Science 2019-07-01 Kenton Lee , Ming-Wei Chang , Kristina Toutanova

Dense passage retrieval aims to retrieve the relevant passages of a query from a large corpus based on dense representations (i.e., vectors) of the query and the passages. Recent studies have explored improving pre-trained language models…

Computation and Language · Computer Science 2022-12-05 Xing Wu , Guangyuan Ma , Meng Lin , Zijia Lin , Zhongyuan Wang , Songlin Hu

Long-context multiple-choice question answering tasks require robust reasoning over extensive text sources. Since most of the pre-trained transformer models are restricted to processing only a few hundred words at a time, successful…

Information Retrieval · Computer Science 2025-01-28 Manish Singh , Manish Shrivastava

Open-domain conversational question answering can be viewed as two tasks: passage retrieval and conversational question answering, where the former relies on selecting candidate passages from a large corpus and the latter requires better…

Computation and Language · Computer Science 2022-11-18 Hung-Chieh Fang , Kuo-Han Hung , Chao-Wei Huang , Yun-Nung Chen

This paper proposes a new problem of complementary evidence identification for open-domain question answering (QA). The problem aims to efficiently find a small set of passages that covers full evidence from multiple aspects as to answer a…

Computation and Language · Computer Science 2021-04-06 Xiangyang Mou , Mo Yu , Shiyu Chang , Yufei Feng , Li Zhang , Hui Su

Domain specific question answering is an evolving field that requires specialized solutions to address unique challenges. In this paper, we show that a hybrid approach combining a fine-tuned dense retriever with keyword based sparse search…

Open-domain extractive question answering works well on textual data by first retrieving candidate texts and then extracting the answer from those candidates. However, some questions cannot be answered by text alone but require information…

Computation and Language · Computer Science 2021-10-20 Bogdan Kostić , Julian Risch , Timo Möller

Knowledge-Intensive Visual Question Answering (KI-VQA) refers to answering a question about an image whose answer does not lie in the image. This paper presents a new pipeline for KI-VQA tasks, consisting of a retriever and a reader. First,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Alireza Salemi , Juan Altmayer Pizzorno , Hamed Zamani

In the domain of question-answering in NLP, the retrieval of Frequently Asked Questions (FAQ) is an important sub-area which is well researched and has been worked upon for many languages. Here, in response to a user query, a retrieval…

Information Retrieval · Computer Science 2024-03-04 Debopriyo Banerjee , Mausam Jain , Ashish Kulkarni

Recent dense retrievers increasingly leverage the robust text understanding capabilities of Large Language Models (LLMs), encoding queries and documents into a shared embedding space for effective retrieval. However, most existing methods…

Information Retrieval · Computer Science 2025-10-07 Yifan Ji , Zhipeng Xu , Zhenghao Liu , Yukun Yan , Shi Yu , Yishan Li , Zhiyuan Liu , Yu Gu , Ge Yu , Maosong Sun

Dense retrieval has been shown to be effective for retrieving relevant documents for Open Domain QA, surpassing popular sparse retrieval methods like BM25. REALM (Guu et al., 2020) is an end-to-end dense retrieval system that relies on MLM…

Computation and Language · Computer Science 2021-04-20 Vidhisha Balachandran , Ashish Vaswani , Yulia Tsvetkov , Niki Parmar