English
Related papers

Related papers: A Framework for Evaluation of Machine Reading Comp…

200 papers

Machine reading comprehension aims to teach machines to understand a text like a human and is a new challenging direction in Artificial Intelligence. This article summarizes recent advances in MRC, mainly focusing on two aspects (i.e.,…

Computation and Language · Computer Science 2019-07-04 Xin Zhang , An Yang , Sujian Li , Yizhong Wang

Task requirements (TRs) writing is an important question type in Key English Test and Preliminary English Test. A TR writing question may include multiple requirements and a high-quality essay must respond to each requirement thoroughly and…

Computation and Language · Computer Science 2021-07-19 Shiting Xu , Guowei Xu , Peilei Jia , Wenbiao Ding , Zhongqin Wu , Zitao Liu

Understanding unstructured text is a major goal within natural language processing. Comprehension tests pose questions based on short text passages to evaluate such understanding. In this work, we investigate machine comprehension on the…

Computation and Language · Computer Science 2016-03-30 Adam Trischler , Zheng Ye , Xingdi Yuan , Jing He , Phillip Bachman , Kaheer Suleman

Reading strategies have been shown to improve comprehension levels, especially for readers lacking adequate prior knowledge. Just as the process of knowledge accumulation is time-consuming for human readers, it is resource-demanding to…

Computation and Language · Computer Science 2019-03-26 Kai Sun , Dian Yu , Dong Yu , Claire Cardie

Machine reading comprehension (MRC) requires reasoning about both the knowledge involved in a document and knowledge about the world. However, existing datasets are typically dominated by questions that can be well solved by context…

Computation and Language · Computer Science 2018-09-13 Yibo Sun , Daya Guo , Duyu Tang , Nan Duan , Zhao Yan , Xiaocheng Feng , Bing Qin

Current evaluation metrics to question answering based machine reading comprehension (MRC) systems generally focus on the lexical overlap between the candidate and reference answers, such as ROUGE and BLEU. However, bias may appear when…

Computation and Language · Computer Science 2018-06-12 An Yang , Kai Liu , Jing Liu , Yajuan Lyu , Sujian Li

As neural language models achieve human-comparable performance on Machine Reading Comprehension (MRC) and see widespread adoption, ensuring their robustness in real-world scenarios has become increasingly important. Current robustness…

Computation and Language · Computer Science 2025-09-11 Yulong Wu , Viktor Schlegel , Riza Batista-Navarro

The issue of shortcut learning is widely known in NLP and has been an important research focus in recent years. Unintended correlations in the data enable models to easily solve tasks that were meant to exhibit advanced language…

Computation and Language · Computer Science 2023-09-07 Xanh Ho , Johannes Mario Meissner , Saku Sugawara , Akiko Aizawa

Machine Comprehension (MC) is a challenging task in Natural Language Processing field, which aims to guide the machine to comprehend a passage and answer the given question. Many existing approaches on MC task are suffering the inefficiency…

Computation and Language · Computer Science 2017-10-10 Zheqian Chen , Rongqin Yang , Bin Cao , Zhou Zhao , Deng Cai , Xiaofei He

Recent studies report that many machine reading comprehension (MRC) models can perform closely to or even better than humans on benchmark datasets. However, existing works indicate that many MRC models may learn shortcuts to outwit these…

Computation and Language · Computer Science 2021-06-03 Yuxuan Lai , Chen Zhang , Yansong Feng , Quzhe Huang , Dongyan Zhao

Cross-lingual Machine Reading Comprehension (xMRC) is challenging due to the lack of training data in low-resource languages. The recent approaches use training data only in a resource-rich language like English to fine-tune large-scale…

Machine Learning · Computer Science 2021-12-10 Nuo Chen , Linjun Shou , Min Gong , Jian Pei , Daxin Jiang

Machine reading comprehension is a challenging task and hot topic in natural language processing. Its goal is to develop systems to answer the questions regarding a given context. In this paper, we present a comprehensive survey on…

Computation and Language · Computer Science 2020-10-22 Razieh Baradaran , Razieh Ghiasi , Hossein Amirkhani

Machine reading comprehension (MRC) is a long-standing topic in natural language processing (NLP). The MRC task aims to answer a question based on the given context. Recently studies focus on multi-hop MRC which is a more challenging…

Computation and Language · Computer Science 2022-12-09 Azade Mohammadi , Reza Ramezani , Ahmad Baraani

There has been considerable progress on academic benchmarks for the Reading Comprehension (RC) task with State-of-the-Art models closing the gap with human performance on extractive question answering. Datasets such as SQuAD 2.0 & NQ have…

Computation and Language · Computer Science 2021-02-25 Rishav Chakravarti , Avirup Sil

Reading comprehension (RC)---in contrast to information retrieval---requires integrating information and reasoning about events, entities, and their relations across a full document. Question answering is conventionally used to assess RC…

Computation and Language · Computer Science 2017-12-20 Tomáš Kočiský , Jonathan Schwarz , Phil Blunsom , Chris Dyer , Karl Moritz Hermann , Gábor Melis , Edward Grefenstette

Achieving human-level performance on some of the Machine Reading Comprehension (MRC) datasets is no longer challenging with the help of powerful Pre-trained Language Models (PLMs). However, the internal mechanism of these artifacts remains…

Computation and Language · Computer Science 2024-10-29 Yiming Cui , Wei-Nan Zhang , Wanxiang Che , Ting Liu , Zhigang Chen , Shijin Wang

Existing question answering systems can only predict answers without explicit reasoning processes, which hinder their explainability and make us overestimate their ability of understanding and reasoning over natural language. In this work,…

Computation and Language · Computer Science 2020-04-06 Ran Wang , Kun Tao , Dingjie Song , Zhilong Zhang , Xiao Ma , Xi'ao Su , Xinyu Dai

We present an accurate and interpretable method for answer extraction in machine reading comprehension that is reminiscent of case-based reasoning (CBR) from classical AI. Our method (CBR-MRC) builds upon the hypothesis that contextualized…

Computation and Language · Computer Science 2025-11-27 Dung Thai , Dhruv Agarwal , Mudit Chaudhary , Wenlong Zhao , Rajarshi Das , Manzil Zaheer , Jay-Yoon Lee , Hannaneh Hajishirzi , Andrew McCallum

Multi-choice Machine Reading Comprehension (MMRC) aims to select the correct answer from a set of options based on a given passage and question. Due to task specific of MMRC, it is non-trivial to transfer knowledge from other MRC tasks such…

Computation and Language · Computer Science 2020-11-18 Yufan Jiang , Shuangzhi Wu , Jing Gong , Yahui Cheng , Peng Meng , Weiliang Lin , Zhibo Chen , Mu li

This paper provides a thorough examination of recent developments in the field of multi-choice Machine Reading Comprehension (MRC). Focused on benchmark datasets, methodologies, challenges, and future trajectories, our goal is to offer…

Computation and Language · Computer Science 2024-08-06 Shima Foolad , Kourosh Kiani , Razieh Rastgoo