English
Related papers

Related papers: HotpotQA: A Dataset for Diverse, Explainable Multi…

200 papers

When answering a question, humans utilize the information available across different modalities to synthesize a consistent and complete chain of thought (CoT). This process is normally a black box in the case of deep learning models like…

Computation and Language · Computer Science 2022-10-18 Pan Lu , Swaroop Mishra , Tony Xia , Liang Qiu , Kai-Wei Chang , Song-Chun Zhu , Oyvind Tafjord , Peter Clark , Ashwin Kalyan

State-of-the-art models for multi-hop question answering typically augment large-scale language models like BERT with additional, intuitively useful capabilities such as named entity recognition, graph-based reasoning, and question…

Computation and Language · Computer Science 2020-04-16 Dirk Groeneveld , Tushar Khot , Mausam , Ashish Sabharwal

In this paper, we propose a new dataset, ReasonVQA, for the Visual Question Answering (VQA) task. Our dataset is automatically integrated with structured encyclopedic knowledge and constructed using a low-cost framework, which is capable of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Duong T. Tran , Trung-Kien Tran , Manfred Hauswirth , Danh Le Phuoc

Multi-hop question answering requires models to gather information from different parts of a text to answer a question. Most current approaches learn to address this task in an end-to-end way with neural networks, without maintaining an…

Computation and Language · Computer Science 2021-06-08 Jifan Chen , Shih-ting Lin , Greg Durrett

One type of question that is commonly found in day-to-day scenarios is ``fan-out'' questions, complex multi-hop, multi-document reasoning questions that require finding information about a large number of entities. However, there exist few…

Computation and Language · Computer Science 2024-06-07 Andrew Zhu , Alyssa Hwang , Liam Dugan , Chris Callison-Burch

Multi-hop question answering requires a model to connect multiple pieces of evidence scattered in a long context to answer the question. In this paper, we show that in the multi-hop HotpotQA (Yang et al., 2018) dataset, the examples often…

Computation and Language · Computer Science 2019-06-18 Yichen Jiang , Mohit Bansal

This paper is concerned with the task of multi-hop open-domain Question Answering (QA). This task is particularly challenging since it requires the simultaneous performance of textual reasoning and efficient searching. We present a method…

Computation and Language · Computer Science 2019-06-18 Yair Feldman , Ran El-Yaniv

Complex question answering over knowledge base (Complex KBQA) is challenging because it requires various compositional reasoning capabilities, such as multi-hop inference, attribute comparison, set operation. Existing benchmarks have some…

Computation and Language · Computer Science 2022-06-24 Shulin Cao , Jiaxin Shi , Liangming Pan , Lunyiu Nie , Yutong Xiang , Lei Hou , Juanzi Li , Bin He , Hanwang Zhang

Composing knowledge from multiple pieces of texts is a key challenge in multi-hop question answering. We present a multi-hop reasoning dataset, Question Answering via Sentence Composition(QASC), that requires retrieving facts from a large…

Computation and Language · Computer Science 2020-02-06 Tushar Khot , Peter Clark , Michal Guerquin , Peter Jansen , Ashish Sabharwal

Resolving knowledge conflicts is a crucial challenge in Question Answering (QA) tasks, as the internet contains numerous conflicting facts and opinions. While some research has made progress in tackling ambiguous settings where multiple…

Computation and Language · Computer Science 2024-10-30 Sagi Shaier , Ari Kobren , Philip Ogren

Several multi-hop reading comprehension datasets have been proposed to resolve the issue of reasoning shortcuts by which questions can be answered without performing multi-hop reasoning. However, the ability of multi-hop models to perform…

Computation and Language · Computer Science 2022-10-12 Xanh Ho , Saku Sugawara , Akiko Aizawa

Question generation (QG) attempts to solve the inverse of question answering (QA) problem by generating a natural language question given a document and an answer. While sequence to sequence neural models surpass rule-based systems for QG,…

Computation and Language · Computer Science 2020-11-03 Deepak Gupta , Hardik Chauhan , Akella Ravi Tej , Asif Ekbal , Pushpak Bhattacharyya

We propose a simple and efficient multi-hop dense retrieval approach for answering complex open-domain questions, which achieves state-of-the-art performance on two multi-hop datasets, HotpotQA and multi-evidence FEVER. Contrary to previous…

Multi-hop QA (Question Answering) is the task of finding the answer to a question across multiple documents. In recent years, a number of Deep Learning-based approaches have been proposed to tackle this complex task, as well as a few…

Computation and Language · Computer Science 2023-01-30 Yunjie He , Philip John Gorinski , Ieva Staliunaite , Pontus Stenetorp

Existing table question answering datasets contain abundant factual questions that primarily evaluate the query and schema comprehension capability of a system, but they fail to include questions that require complex reasoning and…

Multihop reasoning remains an elusive goal as existing multihop benchmarks are known to be largely solvable via shortcuts. Can we create a question answering (QA) dataset that, by construction, \emph{requires} proper multihop reasoning? To…

Computation and Language · Computer Science 2022-05-06 Harsh Trivedi , Niranjan Balasubramanian , Tushar Khot , Ashish Sabharwal

Multi-hop Question Answering (QA) is a challenging task since it requires an accurate aggregation of information from multiple context paragraphs and a thorough understanding of the underlying reasoning chains. Recent work in multi-hop QA…

Computation and Language · Computer Science 2022-11-02 Kaige Xie , Sarah Wiegreffe , Mark Riedl

While diverse question answering (QA) datasets have been proposed and contributed significantly to the development of deep learning models for QA tasks, the existing datasets fall short in two aspects. First, we lack QA datasets covering…

Computation and Language · Computer Science 2021-10-15 Qiyuan Zhang , Lei Wang , Sicheng Yu , Shuohang Wang , Yang Wang , Jing Jiang , Ee-Peng Lim

In the open book question answering (OBQA) task, selecting the relevant passages and sentences from distracting information is crucial to reason the answer to a question. HotpotQA dataset is designed to teach and evaluate systems to do both…

Computation and Language · Computer Science 2022-08-03 Man Luo , Shuguang Chen , Chitta Baral

Existing Scholarly Question Answering (QA) methods typically target homogeneous data sources, relying solely on either text or Knowledge Graphs (KGs). However, scholarly information often spans heterogeneous sources, necessitating the…

Computation and Language · Computer Science 2024-12-06 Tilahun Abedissa Taffa , Debayan Banerjee , Yaregal Assabie , Ricardo Usbeck