English
Related papers

Related papers: A Survey on Measuring and Mitigating Reasoning Sho…

200 papers

Machine Reading Comprehension (MRC) is an essential task in evaluating natural language understanding. Existing MRC datasets primarily assess specific aspects of reading comprehension (RC), lacking a comprehensive MRC benchmark. To fill…

Computation and Language · Computer Science 2025-03-11 Shengkun Ma , Hao Peng , Lei Hou , Juanzi Li

Recent applications of LLMs in Machine Reading Comprehension (MRC) systems have shown impressive results, but the use of shortcuts, mechanisms triggered by features spuriously correlated to the true label, has emerged as a potential threat…

Computation and Language · Computer Science 2023-10-31 Mosh Levy , Shauli Ravfogel , Yoav Goldberg

Machine reading comprehension is a challenging task and hot topic in natural language processing. Its goal is to develop systems to answer the questions regarding a given context. In this paper, we present a comprehensive survey on…

Computation and Language · Computer Science 2020-10-22 Razieh Baradaran , Razieh Ghiasi , Hossein Amirkhani

Achieving human-level performance on some of the Machine Reading Comprehension (MRC) datasets is no longer challenging with the help of powerful Pre-trained Language Models (PLMs). However, the internal mechanism of these artifacts remains…

Computation and Language · Computer Science 2024-10-29 Yiming Cui , Wei-Nan Zhang , Wanxiang Che , Ting Liu , Zhigang Chen , Shijin Wang

A challenge in creating a dataset for machine reading comprehension (MRC) is to collect questions that require a sophisticated understanding of language to answer beyond using superficial cues. In this work, we investigate what makes…

Computation and Language · Computer Science 2018-08-29 Saku Sugawara , Kentaro Inui , Satoshi Sekine , Akiko Aizawa

Machine comprehension plays an essential role in NLP and has been widely explored with dataset like MCTest. However, this dataset is too simple and too small for learning true reasoning abilities. \cite{hermann2015teaching} therefore…

Computation and Language · Computer Science 2016-05-16 Tian Tian , Yuezhang Li

Despite recent success in machine reading comprehension (MRC), learning high-quality MRC models still requires large-scale labeled training data, even using strong pre-trained language models (PLMs). The pre-training tasks for PLMs are not…

Computation and Language · Computer Science 2021-07-20 Ning Bian , Xianpei Han , Bo Chen , Hongyu Lin , Ben He , Le Sun

Large language models exhibit strong reasoning capabilities, yet often rely on shortcuts such as surface pattern matching and answer memorization rather than genuine logical inference. We propose Shortcut-Aware Reasoning Training (SART), a…

Computation and Language · Computer Science 2026-03-24 Hongyu Cao , Kunpeng Liu , Dongjie Wang , Yanjie Fu

Shortcut learning, i.e., a model's reliance on undesired features not directly relevant to the task, is a major challenge that severely limits the applications of machine learning algorithms, particularly when deploying them to assist in…

Machine Learning · Computer Science 2025-06-17 Lukas Kuhn , Sari Sadiya , Jorg Schlotterer , Florian Buettner , Christin Seifert , Gemma Roig

Many tasks aim to measure machine reading comprehension (MRC), often focusing on question types presumed to be difficult. Rarely, however, do task designers start by considering what systems should in fact comprehend. In this paper we make…

Computation and Language · Computer Science 2020-05-12 Jesse Dunietz , Gregory Burnham , Akash Bharadwaj , Owen Rambow , Jennifer Chu-Carroll , David Ferrucci

Neuro-symbolic predictors learn a mapping from sub-symbolic inputs to higher-level concepts and then carry out (probabilistic) logical inference on this intermediate representation. This setup offers clear advantages in terms of consistency…

Artificial Intelligence · Computer Science 2023-03-23 Emanuele Marconato , Stefano Teso , Andrea Passerini

Multilingual pre-trained models could leverage the training data from a rich source language (such as English) to improve performance on low resource languages. However, the transfer quality for multilingual Machine Reading Comprehension…

Computation and Language · Computer Science 2020-05-11 Fei Yuan , Linjun Shou , Xuanyu Bai , Ming Gong , Yaobo Liang , Nan Duan , Yan Fu , Daxin Jiang

Machine reading comprehension (MRC) is an AI challenge that requires machine to determine the correct answers to questions based on a given passage. MRC systems must not only answer question when necessary but also distinguish when no…

Computation and Language · Computer Science 2020-12-14 Zhuosheng Zhang , Junjie Yang , Hai Zhao

This paper provides a thorough examination of recent developments in the field of multi-choice Machine Reading Comprehension (MRC). Focused on benchmark datasets, methodologies, challenges, and future trajectories, our goal is to offer…

Computation and Language · Computer Science 2024-08-06 Shima Foolad , Kourosh Kiani , Razieh Rastgoo

Numerical reasoning based machine reading comprehension is a task that involves reading comprehension along with using arithmetic operations such as addition, subtraction, sorting, and counting. The DROP benchmark (Dua et al., 2019) is a…

Computation and Language · Computer Science 2021-09-20 Hadeel Al-Negheimish , Pranava Madhyastha , Alessandra Russo

Shortcut learning is a phenomenon where machine learning models prioritize learning simple, potentially misleading cues from data that do not generalize well beyond the training set. While existing research primarily investigates this in…

Image and Video Processing · Electrical Eng. & Systems 2024-06-28 Manxi Lin , Nina Weng , Kamil Mikolaj , Zahra Bashir , Morten Bo Søndergaard Svendsen , Martin Tolsgaard , Anders Nymark Christensen , Aasa Feragen

Pre-trained Language Models (PLMs) have achieved great success on Machine Reading Comprehension (MRC) over the past few years. Although the general language representation learned from large-scale corpora does benefit MRC, the poor support…

Computation and Language · Computer Science 2021-05-19 Fangkai Jiao , Yangyang Guo , Yilin Niu , Feng Ji , Feng-Lin Li , Liqiang Nie

With the blooming of various Pre-trained Language Models (PLMs), Machine Reading Comprehension (MRC) has embraced significant improvements on various benchmarks and even surpass human performances. However, the existing works only target on…

Computation and Language · Computer Science 2020-11-16 Yiming Cui , Ting Liu , Shijin Wang , Guoping Hu

Multi-hop Machine reading comprehension is a challenging task with aim of answering a question based on disjoint pieces of information across the different passages. The evaluation metrics and datasets are a vital part of multi-hop MRC…

Computation and Language · Computer Science 2022-12-09 Azade Mohammadi , Reza Ramezani , Ahmad Baraani

Though the community has made great progress on Machine Reading Comprehension (MRC) task, most of the previous works are solving English-based MRC problems, and there are few efforts on other languages mainly due to the lack of large-scale…

Computation and Language · Computer Science 2019-11-05 Yiming Cui , Wanxiang Che , Ting Liu , Bing Qin , Shijin Wang , Guoping Hu