English
Related papers

Related papers: Why Machine Reading Comprehension Models Learn Sho…

200 papers

Language models (LMs), despite their advances, often depend on spurious correlations, undermining their accuracy and generalizability. This study addresses the overlooked impact of subtler, more complex shortcuts that compromise model…

Computation and Language · Computer Science 2024-11-13 Yuqing Zhou , Ruixiang Tang , Ziyu Yao , Ziwei Zhu

Cross-lingual Machine Reading Comprehension (xMRC) is challenging due to the lack of training data in low-resource languages. The recent approaches use training data only in a resource-rich language like English to fine-tune large-scale…

Machine Learning · Computer Science 2021-12-10 Nuo Chen , Linjun Shou , Min Gong , Jian Pei , Daxin Jiang

The advent of large language models (LLMs) has enabled significant performance gains in the field of natural language processing. However, recent studies have found that LLMs often resort to shortcuts when performing tasks, creating an…

Computation and Language · Computer Science 2024-12-18 Geetanjali Bihani , Julia Taylor Rayz

With the blooming of various Pre-trained Language Models (PLMs), Machine Reading Comprehension (MRC) has embraced significant improvements on various benchmarks and even surpass human performances. However, the existing works only target on…

Computation and Language · Computer Science 2020-11-16 Yiming Cui , Ting Liu , Shijin Wang , Guoping Hu

Reading comprehension (RC)---in contrast to information retrieval---requires integrating information and reasoning about events, entities, and their relations across a full document. Question answering is conventionally used to assess RC…

Computation and Language · Computer Science 2017-12-20 Tomáš Kočiský , Jonathan Schwarz , Phil Blunsom , Chris Dyer , Karl Moritz Hermann , Gábor Melis , Edward Grefenstette

Pre-trained Language Models (PLMs) have achieved great success on Machine Reading Comprehension (MRC) over the past few years. Although the general language representation learned from large-scale corpora does benefit MRC, the poor support…

Computation and Language · Computer Science 2021-05-19 Fangkai Jiao , Yangyang Guo , Yilin Niu , Feng Ji , Feng-Lin Li , Liqiang Nie

Machine reading comprehension (MRC) aims to teach machines to read and comprehend human languages, which is a long-standing goal of natural language processing (NLP). With the burst of deep neural networks and the evolution of…

Computation and Language · Computer Science 2020-05-14 Zhuosheng Zhang , Hai Zhao , Rui Wang

Achieving human-level performance on some of the Machine Reading Comprehension (MRC) datasets is no longer challenging with the help of powerful Pre-trained Language Models (PLMs). However, the internal mechanism of these artifacts remains…

Computation and Language · Computer Science 2024-10-29 Yiming Cui , Wei-Nan Zhang , Wanxiang Che , Ting Liu , Zhigang Chen , Shijin Wang

Understanding unstructured text is a major goal within natural language processing. Comprehension tests pose questions based on short text passages to evaluate such understanding. In this work, we investigate machine comprehension on the…

Computation and Language · Computer Science 2016-03-30 Adam Trischler , Zheng Ye , Xingdi Yuan , Jing He , Phillip Bachman , Kaheer Suleman

Multi-choice Machine Reading Comprehension (MMRC) aims to select the correct answer from a set of options based on a given passage and question. Due to task specific of MMRC, it is non-trivial to transfer knowledge from other MRC tasks such…

Computation and Language · Computer Science 2020-11-18 Yufan Jiang , Shuangzhi Wu , Jing Gong , Yahui Cheng , Peng Meng , Weiliang Lin , Zhibo Chen , Mu li

Machine Reading Comprehension (MRC) is the task of answering a question over a paragraph of text. While neural MRC systems gain popularity and achieve noticeable performance, issues are being raised with the methodology used to establish…

Computation and Language · Computer Science 2020-03-11 Viktor Schlegel , Marco Valentino , André Freitas , Goran Nenadic , Riza Batista-Navarro

Multi-choice Machine Reading Comprehension (MRC) is a challenging extension of Natural Language Processing (NLP) that requires the ability to comprehend the semantics and logical relationships between entities in a given text. The MRC task…

Computation and Language · Computer Science 2023-07-19 Ruiqing Sun , Ping Jian

Many tasks aim to measure machine reading comprehension (MRC), often focusing on question types presumed to be difficult. Rarely, however, do task designers start by considering what systems should in fact comprehend. In this paper we make…

Computation and Language · Computer Science 2020-05-12 Jesse Dunietz , Gregory Burnham , Akash Bharadwaj , Owen Rambow , Jennifer Chu-Carroll , David Ferrucci

Despite recent success in machine reading comprehension (MRC), learning high-quality MRC models still requires large-scale labeled training data, even using strong pre-trained language models (PLMs). The pre-training tasks for PLMs are not…

Computation and Language · Computer Science 2021-07-20 Ning Bian , Xianpei Han , Bo Chen , Hongyu Lin , Ben He , Le Sun

Existing analysis work in machine reading comprehension (MRC) is largely concerned with evaluating the capabilities of systems. However, the capabilities of datasets are not assessed for benchmarking language understanding precisely. We…

Computation and Language · Computer Science 2019-11-22 Saku Sugawara , Pontus Stenetorp , Kentaro Inui , Akiko Aizawa

Achieving human-level performance on some of Machine Reading Comprehension (MRC) datasets is no longer challenging with the help of powerful Pre-trained Language Models (PLMs). However, it is necessary to provide both answer prediction and…

Computation and Language · Computer Science 2022-04-29 Yiming Cui , Ting Liu , Wanxiang Che , Zhigang Chen , Shijin Wang

Machine reading comprehension (MRC) is an AI challenge that requires machine to determine the correct answers to questions based on a given passage. MRC systems must not only answer question when necessary but also distinguish when no…

Computation and Language · Computer Science 2020-12-14 Zhuosheng Zhang , Junjie Yang , Hai Zhao

Machine Learning has been successfully applied in systems applications such as memory prefetching and caching, where learned models have been shown to outperform heuristics. However, the lack of understanding the inner workings of these…

Machine Learning · Computer Science 2022-02-14 Leon Sixt , Evan Zheran Liu , Marie Pellat , James Wexler , Milad Hashemi , Been Kim , Martin Maas

Currently, contextualized word representations are learned by intricate neural network models, such as masked neural language models (MNLMs). The new representations significantly enhanced the performance in automated question answering by…

Computation and Language · Computer Science 2019-11-11 Sunjae Kwon , Cheongwoong Kang , Jiyeon Han , Jaesik Choi

In spite of much recent research in the area, it is still unclear whether subject-area question-answering data is useful for machine reading comprehension (MRC) tasks. In this paper, we investigate this question. We collect a large-scale…

Computation and Language · Computer Science 2021-04-08 Dian Yu , Kai Sun , Dong Yu , Claire Cardie