English
Related papers

Related papers: A Framework for Evaluation of Machine Reading Comp…

200 papers

Machine reading comprehension (MRC) has received considerable attention as a benchmark for natural language understanding. However, the conventional task design of MRC lacks explainability beyond the model interpretation, i.e., reading…

Computation and Language · Computer Science 2021-01-27 Saku Sugawara , Pontus Stenetorp , Akiko Aizawa

Machine Reading Comprehension (MRC) is a challenging Natural Language Processing(NLP) research field with wide real-world applications. The great progress of this field in recent years is mainly due to the emergence of large-scale datasets…

Computation and Language · Computer Science 2020-10-22 Changchang Zeng , Shaobo Li , Qin Li , Jie Hu , Jianjun Hu

Machine reading comprehension (MRC), which requires a machine to answer questions based on a given context, has attracted increasing attention with the incorporation of various deep-learning techniques over the past few years. Although…

Computation and Language · Computer Science 2019-11-06 Shanshan Liu , Xin Zhang , Sheng Zhang , Hui Wang , Weiming Zhang

To provide a survey on the existing tasks and models in Machine Reading Comprehension (MRC), this report reviews: 1) the dataset collection and performance evaluation of some representative simple-reasoning and complex-reasoning MRC tasks;…

Computation and Language · Computer Science 2020-01-24 Chao Wang

This paper presents a systematic review of benchmarks and approaches for explainability in Machine Reading Comprehension (MRC). We present how the representation and inference challenges evolved and the steps which were taken to tackle…

Computation and Language · Computer Science 2020-10-02 Mokanarangan Thayaparan , Marco Valentino , André Freitas

Machine reading comprehension (MRC) is an AI challenge that requires machine to determine the correct answers to questions based on a given passage. MRC systems must not only answer question when necessary but also distinguish when no…

Computation and Language · Computer Science 2020-12-14 Zhuosheng Zhang , Junjie Yang , Hai Zhao

Textual Question Answering (QA) aims to provide precise answers to user's questions in natural language using unstructured data. One of the most popular approaches to this goal is machine reading comprehension(MRC). In recent years, many…

Computation and Language · Computer Science 2022-02-07 Yang Bai , Daisy Zhe Wang

Existing analysis work in machine reading comprehension (MRC) is largely concerned with evaluating the capabilities of systems. However, the capabilities of datasets are not assessed for benchmarking language understanding precisely. We…

Computation and Language · Computer Science 2019-11-22 Saku Sugawara , Pontus Stenetorp , Kentaro Inui , Akiko Aizawa

Advances in machine reading comprehension (MRC) rely heavily on the collection of large scale human-annotated examples in the form of (question, paragraph, answer) triples. In contrast, humans are typically able to generalize with only a…

Computation and Language · Computer Science 2020-10-15 Qinyuan Ye , Xiao Huang , Elizabeth Boschee , Xiang Ren

With the blooming of various Pre-trained Language Models (PLMs), Machine Reading Comprehension (MRC) has embraced significant improvements on various benchmarks and even surpass human performances. However, the existing works only target on…

Computation and Language · Computer Science 2020-11-16 Yiming Cui , Ting Liu , Shijin Wang , Guoping Hu

Many tasks aim to measure machine reading comprehension (MRC), often focusing on question types presumed to be difficult. Rarely, however, do task designers start by considering what systems should in fact comprehend. In this paper we make…

Computation and Language · Computer Science 2020-05-12 Jesse Dunietz , Gregory Burnham , Akash Bharadwaj , Owen Rambow , Jennifer Chu-Carroll , David Ferrucci

Machine Reading Comprehension (MRC) is an essential task in evaluating natural language understanding. Existing MRC datasets primarily assess specific aspects of reading comprehension (RC), lacking a comprehensive MRC benchmark. To fill…

Computation and Language · Computer Science 2025-03-11 Shengkun Ma , Hao Peng , Lei Hou , Juanzi Li

Machine reading comprehension (MRC) aims to teach machines to read and comprehend human languages, which is a long-standing goal of natural language processing (NLP). With the burst of deep neural networks and the evolution of…

Computation and Language · Computer Science 2020-05-14 Zhuosheng Zhang , Hai Zhao , Rui Wang

Machine Reading Comprehension (MRC) reveals the ability to understand a given text passage and answer questions based on it. Existing research works in MRC rely heavily on large-size models and corpus to improve the performance evaluated by…

Computation and Language · Computer Science 2022-03-08 Xiaoqiang Wang , Bang Liu , Fangli Xu , Bo Long , Siliang Tang , Lingfei Wu

Achieving human-level performance on some of Machine Reading Comprehension (MRC) datasets is no longer challenging with the help of powerful Pre-trained Language Models (PLMs). However, it is necessary to provide both answer prediction and…

Computation and Language · Computer Science 2022-04-29 Yiming Cui , Ting Liu , Wanxiang Che , Zhigang Chen , Shijin Wang

Multilingual pre-trained models could leverage the training data from a rich source language (such as English) to improve performance on low resource languages. However, the transfer quality for multilingual Machine Reading Comprehension…

Computation and Language · Computer Science 2020-05-11 Fei Yuan , Linjun Shou , Xuanyu Bai , Ming Gong , Yaobo Liang , Nan Duan , Yan Fu , Daxin Jiang

Answer validation in machine reading comprehension (MRC) consists of verifying an extracted answer against an input context and question pair. Previous work has looked at re-assessing the "answerability" of the question given the extracted…

Computation and Language · Computer Science 2020-11-09 Revanth Gangi Reddy , Md Arafat Sultan , Efsun Sarioglu Kayi , Rong Zhang , Vittorio Castelli , Avirup Sil

Machine reading comprehension (MRC) on real web data usually requires the machine to answer a question by analyzing multiple passages retrieved by search engine. Compared with MRC on a single passage, multi-passage MRC is more challenging,…

Computation and Language · Computer Science 2018-05-11 Yizhong Wang , Kai Liu , Jing Liu , Wei He , Yajuan Lyu , Hua Wu , Sujian Li , Haifeng Wang

A challenge in creating a dataset for machine reading comprehension (MRC) is to collect questions that require a sophisticated understanding of language to answer beyond using superficial cues. In this work, we investigate what makes…

Computation and Language · Computer Science 2018-08-29 Saku Sugawara , Kentaro Inui , Satoshi Sekine , Akiko Aizawa

Despite recent success in machine reading comprehension (MRC), learning high-quality MRC models still requires large-scale labeled training data, even using strong pre-trained language models (PLMs). The pre-training tasks for PLMs are not…

Computation and Language · Computer Science 2021-07-20 Ning Bian , Xianpei Han , Bo Chen , Hongyu Lin , Ben He , Le Sun
‹ Prev 1 2 3 10 Next ›