English
Related papers

Related papers: ExpMRC: Explainability Evaluation for Machine Read…

200 papers

To provide a survey on the existing tasks and models in Machine Reading Comprehension (MRC), this report reviews: 1) the dataset collection and performance evaluation of some representative simple-reasoning and complex-reasoning MRC tasks;…

Computation and Language · Computer Science 2020-01-24 Chao Wang

Textual Question Answering (QA) aims to provide precise answers to user's questions in natural language using unstructured data. One of the most popular approaches to this goal is machine reading comprehension(MRC). In recent years, many…

Computation and Language · Computer Science 2022-02-07 Yang Bai , Daisy Zhe Wang

Advances in NLP have yielded impressive results for the task of machine reading comprehension (MRC), with approaches having been reported to achieve performance comparable to that of humans. In this paper, we investigate whether…

Computation and Language · Computer Science 2021-06-16 Viktor Schlegel , Goran Nenadic , Riza Batista-Navarro

Interpretable Machine Learning (IML) has become increasingly important in many real-world applications, such as autonomous cars and medical diagnosis, where explanations are significantly preferred to help people better understand how…

Machine Learning · Computer Science 2019-08-19 Fan Yang , Mengnan Du , Xia Hu

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

Artificial Intelligence · Computer Science 2018-02-05 Menaka Narayanan , Emily Chen , Jeffrey He , Been Kim , Sam Gershman , Finale Doshi-Velez

While pre-trained language models (LMs) have brought great improvements in many NLP tasks, there is increasing attention to explore capabilities of LMs and interpret their predictions. However, existing works usually focus only on a certain…

Computation and Language · Computer Science 2022-07-29 Yaozong Shen , Lijie Wang , Ying Chen , Xinyan Xiao , Jing Liu , Hua Wu

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

Machine Learning · Computer Science 2019-08-30 Isaac Lage , Emily Chen , Jeffrey He , Menaka Narayanan , Been Kim , Sam Gershman , Finale Doshi-Velez

We introduce BIOMRC, a large-scale cloze-style biomedical MRC dataset. Care was taken to reduce noise, compared to the previous BIOREAD dataset of Pappas et al. (2018). Experiments show that simple heuristics do not perform well on the new…

Computation and Language · Computer Science 2020-05-14 Petros Stavropoulos , Dimitris Pappas , Ion Androutsopoulos , Ryan McDonald

Coreference resolution is essential for natural language understanding and has been long studied in NLP. In recent years, as the format of Question Answering (QA) became a standard for machine reading comprehension (MRC), there have been…

Computation and Language · Computer Science 2021-06-10 Mingzhu Wu , Nafise Sadat Moosavi , Dan Roth , Iryna Gurevych

Machine Reading Comprehension (MRC) has become enormously popular recently and has attracted a lot of attention. However, existing reading comprehension datasets are mostly in English. To add diversity in reading comprehension datasets, in…

Computation and Language · Computer Science 2018-03-16 Yiming Cui , Ting Liu , Zhipeng Chen , Wentao Ma , Shijin Wang , Guoping Hu

Machine Reading Comprehension (MRC) reveals the ability to understand a given text passage and answer questions based on it. Existing research works in MRC rely heavily on large-size models and corpus to improve the performance evaluated by…

Computation and Language · Computer Science 2022-03-08 Xiaoqiang Wang , Bang Liu , Fangli Xu , Bo Long , Siliang Tang , Lingfei Wu

Recent studies report that many machine reading comprehension (MRC) models can perform closely to or even better than humans on benchmark datasets. However, existing works indicate that many MRC models may learn shortcuts to outwit these…

Computation and Language · Computer Science 2021-06-03 Yuxuan Lai , Chen Zhang , Yansong Feng , Quzhe Huang , Dongyan Zhao

Machine reading comprehension has made great progress in recent years owing to large-scale annotated datasets. In the clinical domain, however, creating such datasets is quite difficult due to the domain expertise required for annotation.…

Computation and Language · Computer Science 2020-05-05 Xiang Yue , Bernal Jimenez Gutierrez , Huan Sun

Numerical reasoning, such as addition, subtraction, sorting and counting is a critical skill in human's reading comprehension, which has not been well considered in existing machine reading comprehension (MRC) systems. To address this…

Computation and Language · Computer Science 2019-10-16 Qiu Ran , Yankai Lin , Peng Li , Jie Zhou , Zhiyuan Liu

Scientific machine reading comprehension (SMRC) aims to understand scientific texts through interactions with humans by given questions. As far as we know, there is only one dataset focused on exploring full-text scientific machine reading…

Computation and Language · Computer Science 2023-06-27 Xiao Zhang , Heqi Zheng , Yuxiang Nie , Heyan Huang , Xian-Ling Mao

There has been considerable progress on academic benchmarks for the Reading Comprehension (RC) task with State-of-the-Art models closing the gap with human performance on extractive question answering. Datasets such as SQuAD 2.0 & NQ have…

Computation and Language · Computer Science 2021-02-25 Rishav Chakravarti , Avirup Sil

Machine reading comprehension(MRC) has attracted significant amounts of research attention recently, due to an increase of challenging reading comprehension datasets. In this paper, we aim to improve a MRC model's ability to determine…

Computation and Language · Computer Science 2019-10-25 Kevin Huang , Yun Tang , Jing Huang , Xiaodong He , Bowen Zhou

Remarkable success has been achieved in the last few years on some limited machine reading comprehension (MRC) tasks. However, it is still difficult to interpret the predictions of existing MRC models. In this paper, we focus on extracting…

Computation and Language · Computer Science 2019-09-25 Hai Wang , Dian Yu , Kai Sun , Jianshu Chen , Dong Yu , David McAllester , Dan Roth

Task requirements (TRs) writing is an important question type in Key English Test and Preliminary English Test. A TR writing question may include multiple requirements and a high-quality essay must respond to each requirement thoroughly and…

Computation and Language · Computer Science 2021-07-19 Shiting Xu , Guowei Xu , Peilei Jia , Wenbiao Ding , Zhongqin Wu , Zitao Liu

The lack of transparency in the decision-making processes of deep learning systems presents a significant challenge in modern artificial intelligence (AI), as it impairs users' ability to rely on and verify these systems. To address this…

Artificial Intelligence · Computer Science 2024-11-18 David Debot , Pietro Barbiero , Francesco Giannini , Gabriele Ciravegna , Michelangelo Diligenti , Giuseppe Marra