English
Related papers

Related papers: Relation-Guided Pre-Training for Open-Domain Quest…

200 papers

Recent advances in open-domain QA have led to strong models based on dense retrieval, but only focused on retrieving textual passages. In this work, we tackle open-domain QA over tables for the first time, and show that retrieval can be…

Computation and Language · Computer Science 2021-06-10 Jonathan Herzig , Thomas Müller , Syrine Krichene , Julian Martin Eisenschlos

With the rise of large-scale pre-trained language models, open-domain question-answering (ODQA) has become an important research topic in NLP. Based on the popular pre-training fine-tuning approach, we posit that an additional in-domain…

Computation and Language · Computer Science 2022-05-03 Patrick Huber , Armen Aghajanyan , Barlas Oğuz , Dmytro Okhonko , Wen-tau Yih , Sonal Gupta , Xilun Chen

We consider the problem of pretraining a two-stage open-domain question answering (QA) system (retriever + reader) with strong transfer capabilities. The key challenge is how to construct a large amount of high-quality…

Computation and Language · Computer Science 2022-03-23 Xiang Yue , Xiaoman Pan , Wenlin Yao , Dian Yu , Dong Yu , Jianshu Chen

Closed-book question answering (QA) requires a model to directly answer an open-domain question without access to any external knowledge. Prior work on closed-book QA either directly finetunes or prompts a pretrained language model (LM) to…

Computation and Language · Computer Science 2023-04-28 Dan Su , Mostofa Patwary , Shrimai Prabhumoye , Peng Xu , Ryan Prenger , Mohammad Shoeybi , Pascale Fung , Anima Anandkumar , Bryan Catanzaro

Distantly supervised relation extraction is widely used to extract relational facts from text, but suffers from noisy labels. Current relation extraction methods try to alleviate the noise by multi-instance learning and by providing…

Computation and Language · Computer Science 2019-06-21 Christoph Alt , Marc Hübner , Leonhard Hennig

Outside-Knowledge Visual Question Answering (OK-VQA) is a challenging VQA task that requires retrieval of external knowledge to answer questions about images. Recent OK-VQA systems use Dense Passage Retrieval (DPR) to retrieve documents…

Computation and Language · Computer Science 2022-11-01 Weizhe Lin , Bill Byrne

We introduce an approach for open-domain question answering (QA) that retrieves and reads a passage graph, where vertices are passages of text and edges represent relationships that are derived from an external knowledge base or…

Computation and Language · Computer Science 2020-04-14 Sewon Min , Danqi Chen , Luke Zettlemoyer , Hannaneh Hajishirzi

Dense passage retrieval (DPR) is the first step in the retrieval augmented generation (RAG) paradigm for improving the performance of large language models (LLM). DPR fine-tunes pre-trained networks to enhance the alignment of the…

Computation and Language · Computer Science 2024-10-07 Benjamin Reichman , Larry Heck

The performance of Open-Domain Question Answering (ODQA) retrieval systems can exhibit sub-optimal behavior, providing text excerpts with varying degrees of irrelevance. Unfortunately, many existing ODQA datasets lack examples specifically…

Computation and Language · Computer Science 2024-03-05 Rustam Abdumalikov , Pasquale Minervini , Yova Kementchedjhieva

Open-domain complex Question Answering (QA) is a difficult task with challenges in evidence retrieval and reasoning. The complexity of such questions could stem from questions being compositional, hybrid evidence, or ambiguity in questions.…

Computation and Language · Computer Science 2024-06-26 Venktesh V. Deepali Prabhu , Avishek Anand

In open-domain question answering, dense passage retrieval has become a new paradigm to retrieve relevant passages for finding answers. Typically, the dual-encoder architecture is adopted to learn dense representations of questions and…

Computation and Language · Computer Science 2021-05-13 Yingqi Qu , Yuchen Ding , Jing Liu , Kai Liu , Ruiyang Ren , Wayne Xin Zhao , Daxiang Dong , Hua Wu , Haifeng Wang

In knowledge-intensive tasks such as open-domain question answering (OpenQA), large language models (LLMs) often struggle to generate factual answers, relying solely on their internal (parametric) knowledge. To address this limitation,…

Computation and Language · Computer Science 2025-04-29 Jinming Nian , Zhiyuan Peng , Qifan Wang , Yi Fang

Recent work has investigated the interesting question using pre-trained language models (PLMs) as knowledge bases for answering open questions. However, existing work is limited in using small benchmarks with high test-train overlaps. We…

Computation and Language · Computer Science 2021-06-04 Cunxiang Wang , Pai Liu , Yue Zhang

Open domain conversational agents can answer a broad range of targeted queries. However, the sequential nature of interaction with these systems makes knowledge exploration a lengthy task which burdens the user with asking a chain of well…

Computation and Language · Computer Science 2023-02-23 Christopher Richardson , Sudipta Kar , Anjishnu Kumar , Anand Ramachandran , Omar Zia Khan , Zeynab Raeesy , Abhinav Sethy

A major challenge of research on non-English machine reading for question answering (QA) is the lack of annotated datasets. In this paper, we present GermanQuAD, a dataset of 13,722 extractive question/answer pairs. To improve the…

Computation and Language · Computer Science 2021-04-27 Timo Möller , Julian Risch , Malte Pietsch

Open-domain Question Answering models which directly leverage question-answer (QA) pairs, such as closed-book QA (CBQA) models and QA-pair retrievers, show promise in terms of speed and memory compared to conventional models which retrieve…

Computation and Language · Computer Science 2021-02-16 Patrick Lewis , Yuxiang Wu , Linqing Liu , Pasquale Minervini , Heinrich Küttler , Aleksandra Piktus , Pontus Stenetorp , Sebastian Riedel

Retrieval augmented language models have recently become the standard for knowledge intensive tasks. Rather than relying purely on latent semantics within the parameters of large neural models, these methods enlist a semi-parametric memory…

Computation and Language · Computer Science 2023-01-24 Wenhu Chen , Pat Verga , Michiel de Jong , John Wieting , William Cohen

The retriever-reader framework is popular for open-domain question answering (ODQA) due to its ability to use explicit knowledge. Although prior work has sought to increase the knowledge coverage by incorporating structured knowledge beyond…

Computation and Language · Computer Science 2022-03-22 Kaixin Ma , Hao Cheng , Xiaodong Liu , Eric Nyberg , Jianfeng Gao

To alleviate the data scarcity problem in training question answering systems, recent works propose additional intermediate pre-training for dense passage retrieval (DPR). However, there still remains a large discrepancy between the…

Computation and Language · Computer Science 2022-04-13 Jiawei Zhou , Xiaoguang Li , Lifeng Shang , Lan Luo , Ke Zhan , Enrui Hu , Xinyu Zhang , Hao Jiang , Zhao Cao , Fan Yu , Xin Jiang , Qun Liu , Lei Chen

Recent work on open domain question answering (QA) assumes strong supervision of the supporting evidence and/or assumes a blackbox information retrieval (IR) system to retrieve evidence candidates. We argue that both are suboptimal, since…

Computation and Language · Computer Science 2019-07-01 Kenton Lee , Ming-Wei Chang , Kristina Toutanova
‹ Prev 1 2 3 10 Next ›