English
Related papers

Related papers: MRQA 2019 Shared Task: Evaluating Generalization i…

200 papers

Machine comprehension plays an essential role in NLP and has been widely explored with dataset like MCTest. However, this dataset is too simple and too small for learning true reasoning abilities. \cite{hermann2015teaching} therefore…

Computation and Language · Computer Science 2016-05-16 Tian Tian , Yuezhang Li

When answering a question, people often draw upon their rich world knowledge in addition to the particular context. Recent work has focused primarily on answering questions given some relevant document or context, and required very little…

Computation and Language · Computer Science 2019-03-19 Alon Talmor , Jonathan Herzig , Nicholas Lourie , Jonathan Berant

This paper focuses on how to take advantage of external relational knowledge to improve machine reading comprehension (MRC) with multi-task learning. Most of the traditional methods in MRC assume that the knowledge used to get the correct…

Computation and Language · Computer Science 2019-09-06 Jiangnan Xia , Chen Wu , Ming Yan

Existing approaches on Question Answering over Knowledge Graphs (KGQA) have weak generalizability. That is often due to the standard i.i.d. assumption on the underlying dataset. Recently, three levels of generalization for KGQA were…

Computation and Language · Computer Science 2022-05-16 Longquan Jiang , Ricardo Usbeck

In this paper, we investigate the tendency of end-to-end neural Machine Reading Comprehension (MRC) models to match shallow patterns rather than perform inference-oriented reasoning on RC benchmarks. We aim to test the ability of these…

Computation and Language · Computer Science 2018-05-11 Soumya Wadhwa , Varsha Embar , Matthias Grabmair , Eric Nyberg

Machine reading comprehension (MRC) on real web data usually requires the machine to answer a question by analyzing multiple passages retrieved by search engine. Compared with MRC on a single passage, multi-passage MRC is more challenging,…

Computation and Language · Computer Science 2018-05-11 Yizhong Wang , Kai Liu , Jing Liu , Wei He , Yajuan Lyu , Hua Wu , Sujian Li , Haifeng Wang

Achieving human-level performance on some of Machine Reading Comprehension (MRC) datasets is no longer challenging with the help of powerful Pre-trained Language Models (PLMs). However, it is necessary to provide both answer prediction and…

Computation and Language · Computer Science 2022-04-29 Yiming Cui , Ting Liu , Wanxiang Che , Zhigang Chen , Shijin Wang

Question answering over knowledge bases (KBQA) has become a popular approach to help users extract information from knowledge bases. Although several systems exist, choosing one suitable for a particular application scenario is difficult.…

Computation and Language · Computer Science 2022-11-16 Khiem Vinh Tran , Hao Phu Phan , Khang Nguyen Duc Quach , Ngan Luu-Thuy Nguyen , Jun Jo , Thanh Tam Nguyen

Performance of NLP systems is typically evaluated by collecting a large-scale dataset by means of crowd-sourcing to train a data-driven model and evaluate it on a held-out portion of the data. This approach has been shown to suffer from…

Computation and Language · Computer Science 2024-08-12 Viktor Schlegel , Goran Nenadic , Riza Batista-Navarro

We introduce GQA, a new dataset for real-world visual reasoning and compositional question answering, seeking to address key shortcomings of previous VQA datasets. We have developed a strong and robust question engine that leverages scene…

Computation and Language · Computer Science 2019-07-12 Drew A. Hudson , Christopher D. Manning

Advances in machine reading comprehension (MRC) rely heavily on the collection of large scale human-annotated examples in the form of (question, paragraph, answer) triples. In contrast, humans are typically able to generalize with only a…

Computation and Language · Computer Science 2020-10-15 Qinyuan Ye , Xiao Huang , Elizabeth Boschee , Xiang Ren

Open-domain Question Answering (OpenQA) is an important task in Natural Language Processing (NLP), which aims to answer a question in the form of natural language based on large-scale unstructured documents. Recently, there has been a surge…

Artificial Intelligence · Computer Science 2021-05-11 Fengbin Zhu , Wenqiang Lei , Chao Wang , Jianming Zheng , Soujanya Poria , Tat-Seng Chua

In recent years, low-resource Machine Reading Comprehension (MRC) has made significant progress, with models getting remarkable performance on various language datasets. However, none of these models have been customized for the Urdu…

Computation and Language · Computer Science 2021-11-04 Samreen Kazi , Shakeel Khoja

Coreference resolution is essential for natural language understanding and has been long studied in NLP. In recent years, as the format of Question Answering (QA) became a standard for machine reading comprehension (MRC), there have been…

Computation and Language · Computer Science 2021-06-10 Mingzhu Wu , Nafise Sadat Moosavi , Dan Roth , Iryna Gurevych

Machine reading comprehension (MRC) is a long-standing topic in natural language processing (NLP). The MRC task aims to answer a question based on the given context. Recently studies focus on multi-hop MRC which is a more challenging…

Computation and Language · Computer Science 2022-12-09 Azade Mohammadi , Reza Ramezani , Ahmad Baraani

Machine Reading Comprehension (MRC) has become enormously popular recently and has attracted a lot of attention. However, the existing reading comprehension datasets are mostly in English. In this paper, we introduce a Span-Extraction…

Computation and Language · Computer Science 2019-11-05 Yiming Cui , Ting Liu , Wanxiang Che , Li Xiao , Zhipeng Chen , Wentao Ma , Shijin Wang , Guoping Hu

Humans often have to read multiple documents to address their information needs. However, most existing reading comprehension (RC) tasks only focus on questions for which the contexts provide all the information required to answer them,…

Computation and Language · Computer Science 2020-11-17 James Ferguson , Matt Gardner , Hannaneh Hajishirzi , Tushar Khot , Pradeep Dasigi

Although transfer learning has been shown to be successful for tasks like object and speech recognition, its applicability to question answering (QA) has yet to be well-studied. In this paper, we conduct extensive experiments to investigate…

Computation and Language · Computer Science 2018-04-24 Yu-An Chung , Hung-Yi Lee , James Glass

We present a large-scale dataset, ReCoRD, for machine reading comprehension requiring commonsense reasoning. Experiments on this dataset demonstrate that the performance of state-of-the-art MRC systems fall far behind human performance.…

Computation and Language · Computer Science 2018-10-31 Sheng Zhang , Xiaodong Liu , Jingjing Liu , Jianfeng Gao , Kevin Duh , Benjamin Van Durme

Machine reading comprehension tasks require a machine reader to answer questions relevant to the given document. In this paper, we present the first free-form multiple-Choice Chinese machine reading Comprehension dataset (C^3), containing…

Computation and Language · Computer Science 2019-12-18 Kai Sun , Dian Yu , Dong Yu , Claire Cardie