English
Related papers

Related papers: Answering Complex Open-Domain Questions with Multi…

200 papers

Multi-hop question answering requires a model to connect multiple pieces of evidence scattered in a long context to answer the question. In this paper, we show that in the multi-hop HotpotQA (Yang et al., 2018) dataset, the examples often…

Computation and Language · Computer Science 2019-06-18 Yichen Jiang , Mohit Bansal

Decomposition-based multi-hop retrieval methods rely on many autoregressive steps to break down complex queries, which breaks end-to-end differentiability and is computationally expensive. Decomposition-free methods tackle this, but current…

Information Retrieval · Computer Science 2026-01-23 Justus-Jonas Erker , Nils Reimers , Iryna Gurevych

Recent advances regarding question answering and reading comprehension have resulted in models that surpass human performance when the answer is contained in a single, continuous passage of text, requiring only single-hop reasoning.…

Computation and Language · Computer Science 2021-01-18 Xing Cao , Yun Liu

Domain specific question answering is an evolving field that requires specialized solutions to address unique challenges. In this paper, we show that a hybrid approach combining a fine-tuned dense retriever with keyword based sparse search…

We introduce HoVer (HOppy VERification), a dataset for many-hop evidence extraction and fact verification. It challenges models to extract facts from several Wikipedia articles that are relevant to a claim and classify whether the claim is…

Computation and Language · Computer Science 2020-11-17 Yichen Jiang , Shikha Bordia , Zheng Zhong , Charles Dognin , Maneesh Singh , Mohit Bansal

In recent years, the use of large language models (LLMs) has significantly increased, and these models have demonstrated remarkable performance in a variety of general language tasks. However, the evaluation of their performance in…

Computation and Language · Computer Science 2025-01-14 Iman Barati , Arash Ghafouri , Behrouz Minaei-Bidgoli

Multi-hop QA (Question Answering) is the task of finding the answer to a question across multiple documents. In recent years, a number of Deep Learning-based approaches have been proposed to tackle this complex task, as well as a few…

Computation and Language · Computer Science 2023-01-30 Yunjie He , Philip John Gorinski , Ieva Staliunaite , Pontus Stenetorp

Existing open-domain question answering (QA) models are not suitable for real-time usage because they need to process several long documents on-demand for every input query. In this paper, we introduce the query-agnostic indexable…

Computation and Language · Computer Science 2019-06-17 Minjoon Seo , Jinhyuk Lee , Tom Kwiatkowski , Ankur P. Parikh , Ali Farhadi , Hannaneh Hajishirzi

Multi-hop QA requires the machine to answer complex questions through finding multiple clues and reasoning, and provide explanatory evidence to demonstrate the machine reasoning process. We propose Relation Extractor-Reader and Comparator…

Computation and Language · Computer Science 2021-10-27 Ruiliu Fu , Han Wang , Xuejun Zhang , Jun Zhou , Yonghong Yan

To extract answers from a large corpus, open-domain question answering (QA) systems usually rely on information retrieval (IR) techniques to narrow the search space. Standard inverted index methods such as TF-IDF are commonly used as thanks…

Computation and Language · Computer Science 2021-02-22 Wenhan Xiong , Hong Wang , William Yang Wang

Multi-Hop Question Answering (MHQA) is crucial for evaluating the model's capability to integrate information from diverse sources. However, creating extensive and high-quality MHQA datasets is challenging: (i) manual annotation is…

Computation and Language · Computer Science 2026-04-21 Zhiyu Shen , Jiyuan Liu , Yunhe Pang , Yanghui Rao , Fu Lee Wang , Jianxing Yu

Relation Extraction (RE) has been extended to cross-document scenarios because many relations are not simply described in a single document. This inevitably brings the challenge of efficient open-space evidence retrieval to support the…

Computation and Language · Computer Science 2023-06-06 Keming Lu , I-Hung Hsu , Wenxuan Zhou , Mingyu Derek Ma , Muhao Chen

A multi-hop question answering (QA) dataset aims to test reasoning and inference skills by requiring a model to read multiple paragraphs to answer a given question. However, current datasets do not provide a complete explanation for the…

Computation and Language · Computer Science 2020-11-13 Xanh Ho , Anh-Khoa Duong Nguyen , Saku Sugawara , Akiko Aizawa

It is challenging for current one-step retrieve-and-read question answering (QA) systems to answer questions like "Which novel by the author of 'Armada' will be adapted as a feature film by Steven Spielberg?" because the question seldom…

Computation and Language · Computer Science 2019-10-17 Peng Qi , Xiaowen Lin , Leo Mehr , Zijian Wang , Christopher D. Manning

Reading Comprehension has received significant attention in recent years as high quality Question Answering (QA) datasets have become available. Despite state-of-the-art methods achieving strong overall accuracy, Multi-Hop (MH) reasoning…

Computation and Language · Computer Science 2019-05-24 Alex Long , Joel Mason , Alan Blair , Wei Wang

Open-domain question answering aims at solving the task of locating the answers to user-generated questions in massive collections of documents. There are two families of solutions available: retriever-readers, and knowledge-graph-based…

Computation and Language · Computer Science 2020-10-26 Jinfeng Xiao , Lidan Wang , Franck Dernoncourt , Trung Bui , Tong Sun , Jiawei Han

Open-domain table question answering aims to provide answers to a question by retrieving and extracting information from a large collection of tables. Existing studies of open-domain table QA either directly adopt text retrieval methods or…

Computation and Language · Computer Science 2023-09-20 Nengzheng Jin , Dongfang Li , Junying Chen , Joanna Siebert , Qingcai Chen

In open-domain question answering, dense passage retrieval has become a new paradigm to retrieve relevant passages for finding answers. Typically, the dual-encoder architecture is adopted to learn dense representations of questions and…

Computation and Language · Computer Science 2021-05-13 Yingqi Qu , Yuchen Ding , Jing Liu , Kai Liu , Ruiyang Ren , Wayne Xin Zhao , Daxiang Dong , Hua Wu , Haifeng Wang

We develop a unified system to answer directly from text open-domain questions that may require a varying number of retrieval steps. We employ a single multi-task transformer model to perform all the necessary subtasks -- retrieving…

Computation and Language · Computer Science 2021-11-01 Peng Qi , Haejun Lee , Oghenetegiri "TG" Sido , Christopher D. Manning

Most existing multi-hop datasets are extractive answer datasets, where the answers to the questions can be extracted directly from the provided context. This often leads models to use heuristics or shortcuts instead of performing true…

Computation and Language · Computer Science 2024-06-21 Julian Schnitzler , Xanh Ho , Jiahao Huang , Florian Boudin , Saku Sugawara , Akiko Aizawa