English
Related papers

Related papers: A Comprehensive Survey on Multi-hop Machine Readin…

200 papers

We propose a multi-task learning framework to learn a joint Machine Reading Comprehension (MRC) model that can be applied to a wide range of MRC tasks in different domains. Inspired by recent ideas of data selection in machine translation,…

Computation and Language · Computer Science 2019-04-02 Yichong Xu , Xiaodong Liu , Yelong Shen , Jingjing Liu , Jianfeng Gao

Existing analysis work in machine reading comprehension (MRC) is largely concerned with evaluating the capabilities of systems. However, the capabilities of datasets are not assessed for benchmarking language understanding precisely. We…

Computation and Language · Computer Science 2019-11-22 Saku Sugawara , Pontus Stenetorp , Kentaro Inui , Akiko Aizawa

Recent studies on machine reading comprehension have focused on text-level understanding but have not yet reached the level of human understanding of the visual layout and content of real-world documents. In this study, we introduce a new…

Computation and Language · Computer Science 2021-05-11 Ryota Tanaka , Kyosuke Nishida , Sen Yoshida

Interpretable multi-hop reading comprehension (RC) over multiple documents is a challenging problem because it demands reasoning over multiple information sources and explaining the answer prediction by providing supporting evidences. In…

Computation and Language · Computer Science 2020-02-12 Ming Tu , Kevin Huang , Guangtao Wang , Jing Huang , Xiaodong He , Bowen Zhou

Referring Expression Comprehension (REC) is a crucial cross-modal task that objectively evaluates the capabilities of language understanding, image comprehension, and language-to-image grounding. Consequently, it serves as an ideal testing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Junzhuo Liu , Xuzheng Yang , Weiwei Li , Peng Wang

Most existing multi-hop datasets are extractive answer datasets, where the answers to the questions can be extracted directly from the provided context. This often leads models to use heuristics or shortcuts instead of performing true…

Computation and Language · Computer Science 2024-06-21 Julian Schnitzler , Xanh Ho , Jiahao Huang , Florian Boudin , Saku Sugawara , Akiko Aizawa

Recent studies report that many machine reading comprehension (MRC) models can perform closely to or even better than humans on benchmark datasets. However, existing works indicate that many MRC models may learn shortcuts to outwit these…

Computation and Language · Computer Science 2021-06-03 Yuxuan Lai , Chen Zhang , Yansong Feng , Quzhe Huang , Dongyan Zhao

Machine Learning is a diverse field applied across various domains such as computer science, social sciences, medicine, chemistry, and finance. This diversity results in varied evaluation approaches, making it difficult to compare models…

Machine Learning · Computer Science 2025-07-08 Silvia Beddar-Wiesing , Alice Moallemy-Oureh , Marie Kempkes , Josephine M. Thomas

Multiple Object Tracking (MOT) has gained increasing attention due to its academic and commercial potential. Although different approaches have been proposed to tackle this problem, it still remains challenging due to factors like abrupt…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Wenhan Luo , Junliang Xing , Anton Milan , Xiaoqin Zhang , Wei Liu , Tae-Kyun Kim

Multimodal learning, a rapidly evolving field in artificial intelligence, seeks to construct more versatile and robust systems by integrating and analyzing diverse types of data, including text, images, audio, and video. Inspired by the…

Artificial Intelligence · Computer Science 2024-12-24 Priyaranjan Pattnayak , Hitesh Laxmichand Patel , Bhargava Kumar , Amit Agarwal , Ishan Banerjee , Srikant Panda , Tejaswini Kumar

Multi-choice Machine Reading Comprehension (MMRC) aims to select the correct answer from a set of options based on a given passage and question. Due to task specific of MMRC, it is non-trivial to transfer knowledge from other MRC tasks such…

Computation and Language · Computer Science 2020-11-18 Yufan Jiang , Shuangzhi Wu , Jing Gong , Yahui Cheng , Peng Meng , Weiliang Lin , Zhibo Chen , Mu li

Multi-hop QA with annotated supporting facts, which is the task of reading comprehension (RC) considering the interpretability of the answer, has been extensively studied. In this study, we define an interpretable reading comprehension…

Computation and Language · Computer Science 2021-11-19 Kosuke Nishida , Kyosuke Nishida , Itsumi Saito , Sen Yoshida

Multiple-choice Machine Reading Comprehension (MRC) is an important and challenging Natural Language Understanding (NLU) task, in which a machine must choose the answer to a question from a set of choices, with the question placed in…

Computation and Language · Computer Science 2020-03-12 Hui Wan

We present a large-scale dataset, ReCoRD, for machine reading comprehension requiring commonsense reasoning. Experiments on this dataset demonstrate that the performance of state-of-the-art MRC systems fall far behind human performance.…

Computation and Language · Computer Science 2018-10-31 Sheng Zhang , Xiaodong Liu , Jingjing Liu , Jianfeng Gao , Kevin Duh , Benjamin Van Durme

Existing RAG benchmarks often overlook query difficulty, leading to inflated performance on simpler questions and unreliable evaluations. A robust benchmark dataset must satisfy three key criteria: quality, diversity, and difficulty, which…

Information Retrieval · Computer Science 2025-06-02 Jeongsoo Lee , Daeyong Kwon , Kyohoon Jin , Junnyeong Jeong , Minwoo Sim , Minwoo Kim

Reading Comprehension (RC) is a task of answering a question from a given passage or a set of passages. In the case of multiple passages, the task is to find the best possible answer to the question. Recent trials and experiments in the…

Computation and Language · Computer Science 2022-01-06 Avi Chawla

Reading comprehension has recently seen rapid progress, with systems matching humans on the most popular datasets for the task. However, a large body of work has highlighted the brittleness of these systems, showing that there is much work…

Computation and Language · Computer Science 2019-04-18 Dheeru Dua , Yizhong Wang , Pradeep Dasigi , Gabriel Stanovsky , Sameer Singh , Matt Gardner

Multi-hop QA requires the machine to answer complex questions through finding multiple clues and reasoning, and provide explanatory evidence to demonstrate the machine reasoning process. We propose Relation Extractor-Reader and Comparator…

Computation and Language · Computer Science 2021-10-27 Ruiliu Fu , Han Wang , Xuejun Zhang , Jun Zhou , Yonghong Yan

Reading Comprehension has received significant attention in recent years as high quality Question Answering (QA) datasets have become available. Despite state-of-the-art methods achieving strong overall accuracy, Multi-Hop (MH) reasoning…

Computation and Language · Computer Science 2019-05-24 Alex Long , Joel Mason , Alan Blair , Wei Wang

Multi-hop reasoning (MHR) is a process in artificial intelligence and natural language processing where a system needs to make multiple inferential steps to arrive at a conclusion or answer. In the context of knowledge graphs or databases,…

Artificial Intelligence · Computer Science 2024-06-13 Jesmin Jahan Tithi , Fabio Checconi , Fabrizio Petrini