English
Related papers

Related papers: Constructing Datasets for Multi-hop Reading Compre…

200 papers

Question Answering for complex questions is often modeled as a graph construction or traversal task, where a solver must build or traverse a graph of facts that answer and explain a given question. This "multi-hop" inference has been shown…

Computation and Language · Computer Science 2018-05-30 Peter Jansen

Reading comprehension has recently seen rapid progress, with systems matching humans on the most popular datasets for the task. However, a large body of work has highlighted the brittleness of these systems, showing that there is much work…

Computation and Language · Computer Science 2019-04-18 Dheeru Dua , Yizhong Wang , Pradeep Dasigi , Gabriel Stanovsky , Sameer Singh , Matt Gardner

Multi-hop reading comprehension (RC) questions are challenging because they require reading and reasoning over multiple paragraphs. We argue that it can be difficult to construct large multi-hop RC datasets. For example, even highly…

Computation and Language · Computer Science 2019-06-10 Sewon Min , Eric Wallace , Sameer Singh , Matt Gardner , Hannaneh Hajishirzi , Luke Zettlemoyer

Multi-hop Reading Comprehension (RC) requires reasoning and aggregation across several paragraphs. We propose a system for multi-hop RC that decomposes a compositional question into simpler sub-questions that can be answered by…

Computation and Language · Computer Science 2019-07-02 Sewon Min , Victor Zhong , Luke Zettlemoyer , Hannaneh Hajishirzi

Multi-hop inference is necessary for machine learning systems to successfully solve tasks such as Recognising Textual Entailment and Machine Reading. In this work, we demonstrate the effectiveness of adaptive computation for learning the…

Computation and Language · Computer Science 2016-11-17 Mark Neumann , Pontus Stenetorp , Sebastian Riedel

In this study, we introduced a new benchmark consisting of a curated dataset and a defined evaluation process to assess the compositional reasoning capabilities of large language models within the chemistry domain. We designed and validated…

Computation and Language · Computer Science 2025-08-07 Mohammad Khodadad , Ali Shiraee Kasmaee , Mahdi Astaraki , Nicholas Sherck , Hamidreza Mahyar , Soheila Samiee

Multi-hop reasoning (i.e., reasoning across two or more documents) is a key ingredient for NLP models that leverage large corpora to exhibit broad knowledge. To retrieve evidence passages, multi-hop models must contend with a fast-growing…

Computation and Language · Computer Science 2022-07-12 Omar Khattab , Christopher Potts , Matei Zaharia

Document-level relation extraction requires integrating information within and across multiple sentences of a document and capturing complex interactions between inter-sentence entities. However, effective aggregation of relevant…

Computation and Language · Computer Science 2020-07-29 Guoshun Nan , Zhijiang Guo , Ivan Sekulić , Wei Lu

Multi-choice Machine Reading Comprehension (MRC) is a challenging extension of Natural Language Processing (NLP) that requires the ability to comprehend the semantics and logical relationships between entities in a given text. The MRC task…

Computation and Language · Computer Science 2023-07-19 Ruiqing Sun , Ping Jian

Interacting and understanding with text heavy visual content with multiple images is a major challenge for traditional vision models. This paper is on enhancing vision models' capability to comprehend or understand and learn from images…

Computer Vision and Pattern Recognition · Computer Science 2024-08-31 Adithya TG , Adithya SK , Abhinav R Bharadwaj , Abhiram HA , Surabhi Narayan

Detectives frequently engage in information detection and reasoning simultaneously when making decisions across various cases, especially when confronted with a vast amount of information. With the rapid development of large language…

Computation and Language · Computer Science 2024-03-21 Zhouhong Gu , Lin Zhang , Jiangjie Chen , Haoning Ye , Xiaoxuan Zhu , Zihan Li , Zheyu Ye , Yan Gao , Yao Hu , Yanghua Xiao , Hongwei Feng

Reading comprehension is a challenging task, especially when executed across longer or across multiple evidence documents, where the answer is likely to reoccur. Existing neural architectures typically do not scale to the entire evidence,…

Computation and Language · Computer Science 2018-06-01 Swabha Swayamdipta , Ankur P. Parikh , Tom Kwiatkowski

Teaching machines to read natural language documents remains an elusive challenge. Machine reading systems can be tested on their ability to answer questions posed on the contents of documents that they have seen, but until now large scale…

Computation and Language · Computer Science 2015-11-20 Karl Moritz Hermann , Tomáš Kočiský , Edward Grefenstette , Lasse Espeholt , Will Kay , Mustafa Suleyman , Phil Blunsom

Reading comprehension models are based on recurrent neural networks that sequentially process the document tokens. As interest turns to answering more complex questions over longer documents, sequential reading of large portions of text…

Computation and Language · Computer Science 2018-09-11 Mor Geva , Jonathan Berant

To make machines better understand sentiments, research needs to move from polarity identification to understanding the reasons that underlie the expression of sentiment. Categorizing the goals or needs of humans is one way to explain the…

Computation and Language · Computer Science 2019-04-02 Debjit Paul , Anette Frank

Existing claim verification datasets often do not require systems to perform complex reasoning or effectively interpret multimodal evidence. To address this, we introduce a new task: multi-hop multimodal claim verification. This task…

Computation and Language · Computer Science 2024-12-16 Haoran Wang , Aman Rangapur , Xiongxiao Xu , Yueqing Liang , Haroon Gharwi , Carl Yang , Kai Shu

Composing knowledge from multiple pieces of texts is a key challenge in multi-hop question answering. We present a multi-hop reasoning dataset, Question Answering via Sentence Composition(QASC), that requires retrieving facts from a large…

Computation and Language · Computer Science 2020-02-06 Tushar Khot , Peter Clark , Michal Guerquin , Peter Jansen , Ashish Sabharwal

A challenge in creating a dataset for machine reading comprehension (MRC) is to collect questions that require a sophisticated understanding of language to answer beyond using superficial cues. In this work, we investigate what makes…

Computation and Language · Computer Science 2018-08-29 Saku Sugawara , Kentaro Inui , Satoshi Sekine , Akiko Aizawa

Machine comprehension of texts longer than a single sentence often requires coreference resolution. However, most current reading comprehension benchmarks do not contain complex coreferential phenomena and hence fail to evaluate the ability…

Computation and Language · Computer Science 2019-09-06 Pradeep Dasigi , Nelson F. Liu , Ana Marasović , Noah A. Smith , Matt Gardner

Machine reading comprehension (MRC) requires reasoning about both the knowledge involved in a document and knowledge about the world. However, existing datasets are typically dominated by questions that can be well solved by context…

Computation and Language · Computer Science 2018-09-13 Yibo Sun , Daya Guo , Duyu Tang , Nan Duan , Zhao Yan , Xiaocheng Feng , Bing Qin