English
Related papers

Related papers: MRQA 2019 Shared Task: Evaluating Generalization i…

200 papers

Reading is integral to everyday life, and yet learning to read is a struggle for many young learners. During lessons, teachers can use comprehension questions to increase engagement, test reading skills, and improve retention. Historically…

Computation and Language · Computer Science 2022-04-07 Bilal Ghanem , Lauren Lutz Coleman , Julia Rivard Dexter , Spencer McIntosh von der Ohe , Alona Fyshe

The question answering system can answer questions from various fields and forms with deep neural networks, but it still lacks effective ways when facing multiple evidences. We introduce a new model called SRQA, which means Synthetic Reader…

Computation and Language · Computer Science 2020-09-04 Jiuniu Wang , Wenjia Xu , Xingyu Fu , Yang Wei , Li Jin , Ziyan Chen , Guangluan Xu , Yirong Wu

Answer selection and knowledge base question answering (KBQA) are two important tasks of question answering (QA) systems. Existing methods solve these two tasks separately, which requires large number of repetitive work and neglects the…

Computation and Language · Computer Science 2018-12-07 Yang Deng , Yuexiang Xie , Yaliang Li , Min Yang , Nan Du , Wei Fan , Kai Lei , Ying Shen

Machine Reading Comprehension (MRC) reveals the ability to understand a given text passage and answer questions based on it. Existing research works in MRC rely heavily on large-size models and corpus to improve the performance evaluated by…

Computation and Language · Computer Science 2022-03-08 Xiaoqiang Wang , Bang Liu , Fangli Xu , Bo Long , Siliang Tang , Lingfei Wu

Achieving human-level performance on some of the Machine Reading Comprehension (MRC) datasets is no longer challenging with the help of powerful Pre-trained Language Models (PLMs). However, the internal mechanism of these artifacts remains…

Computation and Language · Computer Science 2024-10-29 Yiming Cui , Wei-Nan Zhang , Wanxiang Che , Ting Liu , Zhigang Chen , Shijin Wang

Scientific machine reading comprehension (SMRC) aims to understand scientific texts through interactions with humans by given questions. As far as we know, there is only one dataset focused on exploring full-text scientific machine reading…

Computation and Language · Computer Science 2023-06-27 Xiao Zhang , Heqi Zheng , Yuxiang Nie , Heyan Huang , Xian-Ling Mao

This paper introduces our proposed system for the MIA Shared Task on Cross-lingual Open-retrieval Question Answering (COQA). In this challenging scenario, given an input question the system has to gather evidence documents from a…

This paper provides a thorough examination of recent developments in the field of multi-choice Machine Reading Comprehension (MRC). Focused on benchmark datasets, methodologies, challenges, and future trajectories, our goal is to offer…

Computation and Language · Computer Science 2024-08-06 Shima Foolad , Kourosh Kiani , Razieh Rastgoo

This study considers the task of machine reading at scale (MRS) wherein, given a question, a system first performs the information retrieval (IR) task of finding relevant passages in a knowledge source and then carries out the reading…

Computation and Language · Computer Science 2018-09-03 Kyosuke Nishida , Itsumi Saito , Atsushi Otsuka , Hisako Asano , Junji Tomita

The recent success of machine learning systems on various QA datasets could be interpreted as a significant improvement in models' language understanding abilities. However, using various perturbations, multiple recent works have shown that…

Computation and Language · Computer Science 2020-11-24 Krunal Shah , Nitish Gupta , Dan Roth

Understanding unstructured text is a major goal within natural language processing. Comprehension tests pose questions based on short text passages to evaluate such understanding. In this work, we investigate machine comprehension on the…

Computation and Language · Computer Science 2016-03-30 Adam Trischler , Zheng Ye , Xingdi Yuan , Jing He , Phillip Bachman , Kaheer Suleman

Motivated by recent evidence pointing out the fragility of high-performing span prediction models, we direct our attention to multiple choice reading comprehension. In particular, this work introduces a novel method for improving answer…

Computation and Language · Computer Science 2021-11-29 Aditi Chaudhary , Bhargavi Paranjape , Michiel de Jong

Recent advances in the field of language modeling have improved state-of-the-art results on many Natural Language Processing tasks. Among them, Reading Comprehension has made significant progress over the past few years. However, most…

Computation and Language · Computer Science 2020-05-26 Martin d'Hoffschmidt , Wacim Belblidia , Tom Brendlé , Quentin Heinrich , Maxime Vidal

Text summarization plays a crucial role in natural language processing by condensing large volumes of text into concise and coherent summaries. As digital content continues to grow rapidly and the demand for effective information retrieval…

Computation and Language · Computer Science 2025-03-14 Tohida Rehman , Soumabha Ghosh , Kuntal Das , Souvik Bhattacharjee , Debarshi Kumar Sanyal , Samiran Chattopadhyay

Reading comprehension (RC) is a challenging task that requires synthesis of information across sentences and multiple turns of reasoning. Using a state-of-the-art RC model, we empirically investigate the performance of single-turn and…

Computation and Language · Computer Science 2017-11-10 Yelong Shen , Xiaodong Liu , Kevin Duh , Jianfeng Gao

The ability to understand logical relationships between sentences is an important task in language understanding. To aid in progress for this task, researchers have collected datasets for machine learning and evaluation of current systems.…

Computation and Language · Computer Science 2019-06-25 Shawn Tan , Yikang Shen , Chin-wei Huang , Aaron Courville

We explore the use of long-context capabilities in large language models to create synthetic reading comprehension data from entire books. Previous efforts to construct such datasets relied on crowd-sourcing, but the emergence of…

We present a new dataset for Visual Question Answering (VQA) on document images called DocVQA. The dataset consists of 50,000 questions defined on 12,000+ document images. Detailed analysis of the dataset in comparison with similar datasets…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Minesh Mathew , Dimosthenis Karatzas , C. V. Jawahar

We present Persian Question Answering Dataset (PQuAD), a crowdsourced reading comprehension dataset on Persian Wikipedia articles. It includes 80,000 questions along with their answers, with 25% of the questions being adversarially…

Computation and Language · Computer Science 2023-02-22 Kasra Darvishi , Newsha Shahbodagh , Zahra Abbasiantaeb , Saeedeh Momtazi

Commonsense knowledge is critical in human reading comprehension. While machine comprehension has made significant progress in recent years, the ability in handling commonsense knowledge remains limited. Synonyms are one of the most widely…

Computation and Language · Computer Science 2020-10-27 Gongqi Lin , Yuan Miao , Xiaoyong Yang , Wenwu Ou , Lizhen Cui , Wei Guo , Chunyan Miao