English
Related papers

Related papers: Is Multihop QA in DiRe Condition? Measuring and Re…

200 papers

Multi-hop reading comprehension (RC) questions are challenging because they require reading and reasoning over multiple paragraphs. We argue that it can be difficult to construct large multi-hop RC datasets. For example, even highly…

Computation and Language · Computer Science 2019-06-10 Sewon Min , Eric Wallace , Sameer Singh , Matt Gardner , Hannaneh Hajishirzi , Luke Zettlemoyer

Fact-checking real-world claims often requires complex, multi-step reasoning due to the absence of direct evidence to support or refute them. However, existing fact-checking systems often lack transparency in their decision-making, making…

Computation and Language · Computer Science 2023-10-12 Liangming Pan , Xinyuan Lu , Min-Yen Kan , Preslav Nakov

Generative question answering (QA) models generate answers to questions either solely based on the parameters of the model (the closed-book setting) or additionally retrieving relevant evidence (the open-book setting). Generative QA models…

Computation and Language · Computer Science 2022-10-11 Zhengbao Jiang , Jun Araki , Haibo Ding , Graham Neubig

Multi-hop reasoning is an effective approach for query answering (QA) over incomplete knowledge graphs (KGs). The problem can be formulated in a reinforcement learning (RL) setup, where a policy-based agent sequentially extends its…

Artificial Intelligence · Computer Science 2018-09-13 Xi Victoria Lin , Richard Socher , Caiming Xiong

This paper studies the bias problem of multi-hop question answering models, of answering correctly without correct reasoning. One way to robustify these models is by supervising to not only answer right, but also with right reasoning…

Computation and Language · Computer Science 2021-07-08 Kyungjae Lee , Seung-won Hwang , Sang-eun Han , Dohyeon Lee

Multi-hop QA requires a model to connect multiple pieces of evidence scattered in a long context to answer the question. The recently proposed HotpotQA (Yang et al., 2018) dataset is comprised of questions embodying four different multi-hop…

Computation and Language · Computer Science 2019-11-01 Yichen Jiang , Mohit Bansal

To explain the predicted answers and evaluate the reasoning abilities of models, several studies have utilized underlying reasoning (UR) tasks in multi-hop question answering (QA) datasets. However, it remains an open question as to how…

Computation and Language · Computer Science 2023-02-14 Xanh Ho , Anh-Khoa Duong Nguyen , Saku Sugawara , Akiko Aizawa

Multi-hop question answering (QA) requires an information retrieval (IR) system that can find \emph{multiple} supporting evidence needed to answer the question, making the retrieval process very challenging. This paper introduces an IR…

Computation and Language · Computer Science 2019-09-18 Ameya Godbole , Dilip Kavarthapu , Rajarshi Das , Zhiyu Gong , Abhishek Singhal , Hamed Zamani , Mo Yu , Tian Gao , Xiaoxiao Guo , Manzil Zaheer , Andrew McCallum

Question answering (QA) using textual sources for purposes such as reading comprehension (RC) has attracted much attention. This study focuses on the task of explainable multi-hop QA, which requires the system to return the answer with…

Computation and Language · Computer Science 2019-05-30 Kosuke Nishida , Kyosuke Nishida , Masaaki Nagata , Atsushi Otsuka , Itsumi Saito , Hisako Asano , Junji Tomita

Multi-hop reasoning requires aggregating multiple documents to answer a complex question. Existing methods usually decompose the multi-hop question into simpler single-hop questions to solve the problem for illustrating the explainable…

Computation and Language · Computer Science 2022-08-23 Siyuan Wang , Zhongyu Wei , Zhihao Fan , Qi Zhang , Xuanjing Huang

When answering a question, humans utilize the information available across different modalities to synthesize a consistent and complete chain of thought (CoT). This process is normally a black box in the case of deep learning models like…

Computation and Language · Computer Science 2022-10-18 Pan Lu , Swaroop Mishra , Tony Xia , Liang Qiu , Kai-Wei Chang , Song-Chun Zhu , Oyvind Tafjord , Peter Clark , Ashwin Kalyan

Recent work has proposed multi-hop models and datasets for studying complex natural language reasoning. One notable task requiring multi-hop reasoning is fact checking, where a set of connected evidence pieces leads to the final verdict of…

Computation and Language · Computer Science 2021-06-02 Wojciech Ostrowski , Arnav Arora , Pepa Atanasova , Isabelle Augenstein

Explainable multi-hop question answering (QA) not only predicts answers but also identifies rationales, i. e. subsets of input sentences used to derive the answers. This problem has been extensively studied under the supervised setting,…

Computation and Language · Computer Science 2023-05-24 Wenting Zhao , Justin T. Chiu , Claire Cardie , Alexander M. Rush

While large language models exhibit remarkable performance in the Question Answering task, they are susceptible to hallucinations. Challenges arise when these models grapple with understanding multi-hop relations in complex questions or…

Computation and Language · Computer Science 2023-11-14 Hejing Cao , Zhenwei An , Jiazhan Feng , Kun Xu , Liwei Chen , Dongyan Zhao

While Large Language Models (LLMs) excel in question-answering (QA) tasks, their real reasoning abilities on multiple evidence retrieval and integration on Multi-hop QA tasks remain less explored. Firstly, LLMs sometimes generate answers…

Computation and Language · Computer Science 2024-10-16 Jian Wu , Linyi Yang , Zhen Wang , Manabu Okumura , Yue Zhang

A key challenge of multi-hop question answering (QA) in the open-domain setting is to accurately retrieve the supporting passages from a large corpus. Existing work on open-domain QA typically relies on off-the-shelf information retrieval…

Computation and Language · Computer Science 2019-11-05 Wenhan Xiong , Mo Yu , Xiaoxiao Guo , Hong Wang , Shiyu Chang , Murray Campbell , William Yang Wang

The emergence of reasoning models and their integration into practical AI chat bots has led to breakthroughs in solving advanced math, deep search, and extractive question answering problems that requires a complex and multi-step thought…

State-of-the-art approaches to reasoning and question answering over knowledge graphs (KGs) usually scale with the number of edges and can only be applied effectively on small instance-dependent subgraphs. In this paper, we address this…

Machine Learning · Computer Science 2021-10-28 Mattia Atzeni , Jasmina Bogojeska , Andreas Loukas

Multi-hop question answering (QA) is widely used to evaluate the reasoning capabilities of large language models, yet most benchmarks focus on final answer correctness and overlook intermediate reasoning, especially in long multimodal…

Computation and Language · Computer Science 2026-03-10 Biao Xiang , Soyeon Caren Han , Yihao Ding

State-of-the-art Large Language Models (LLMs) are accredited with an increasing number of different capabilities, ranging from reading comprehension, over advanced mathematical and reasoning skills to possessing scientific knowledge. In…

Computation and Language · Computer Science 2024-11-01 Neeladri Bhuiya , Viktor Schlegel , Stefan Winkler