English
Related papers

Related papers: What does BERT Learn from Multiple-Choice Reading …

200 papers

BERT and its variants have achieved state-of-the-art performance in various NLP tasks. Since then, various works have been proposed to analyze the linguistic information being captured in BERT. However, the current works do not provide an…

Computation and Language · Computer Science 2020-10-20 Sahana Ramnath , Preksha Nema , Deep Sahni , Mitesh M. Khapra

BERT (Bidirectional Encoder Representations from Transformers) and related pre-trained Transformers have provided large gains across many language understanding tasks, achieving a new state-of-the-art (SOTA). BERT is pre-trained on two…

Computation and Language · Computer Science 2020-06-22 Michael Glass , Alfio Gliozzo , Rishav Chakravarti , Anthony Ferritto , Lin Pan , G P Shrivatsa Bhargav , Dinesh Garg , Avirup Sil

Multi-hop Machine reading comprehension is a challenging task with aim of answering a question based on disjoint pieces of information across the different passages. The evaluation metrics and datasets are a vital part of multi-hop MRC…

Computation and Language · Computer Science 2022-12-09 Azade Mohammadi , Reza Ramezani , Ahmad Baraani

Recently, various neural models for multi-party conversation (MPC) have achieved impressive improvements on a variety of tasks such as addressee recognition, speaker identification and response prediction. However, these existing methods on…

Computation and Language · Computer Science 2021-06-04 Jia-Chen Gu , Chongyang Tao , Zhen-Hua Ling , Can Xu , Xiubo Geng , Daxin Jiang

Humans often have to read multiple documents to address their information needs. However, most existing reading comprehension (RC) tasks only focus on questions for which the contexts provide all the information required to answer them,…

Computation and Language · Computer Science 2020-11-17 James Ferguson , Matt Gardner , Hannaneh Hajishirzi , Tushar Khot , Pradeep Dasigi

Multi-choice Machine Reading Comprehension (MRC) as a challenge requires models to select the most appropriate answer from a set of candidates with a given passage and question. Most of the existing researches focus on the modeling of…

Computation and Language · Computer Science 2022-03-29 Yilin Zhao , Zhuosheng Zhang , Hai Zhao

To precisely evaluate a language model's capability for logical reading comprehension, we present a dataset for testing the understanding of the rationale behind critical reasoning. For questions taken from an existing multiplechoice…

Computation and Language · Computer Science 2023-12-01 Akira Kawabata , Saku Sugawara

Multilingual pre-trained models could leverage the training data from a rich source language (such as English) to improve performance on low resource languages. However, the transfer quality for multilingual Machine Reading Comprehension…

Computation and Language · Computer Science 2020-05-11 Fei Yuan , Linjun Shou , Xuanyu Bai , Ming Gong , Yaobo Liang , Nan Duan , Yan Fu , Daxin Jiang

Multiple-choice machine reading comprehension is difficult task as its required machines to select the correct option from a set of candidate or possible options using the given passage and question.Reading Comprehension with Multiple…

Computation and Language · Computer Science 2020-03-19 Vaishali Ingale , Pushpender Singh

Recent powerful pre-trained language models have achieved remarkable performance on most of the popular datasets for reading comprehension. It is time to introduce more challenging datasets to push the development of this field towards more…

Computation and Language · Computer Science 2020-08-25 Weihao Yu , Zihang Jiang , Yanfei Dong , Jiashi Feng

Large-scale pre-trained language model such as BERT has achieved great success in language understanding tasks. However, it remains an open question how to utilize BERT for language generation. In this paper, we present a novel approach,…

Computation and Language · Computer Science 2020-07-21 Yen-Chun Chen , Zhe Gan , Yu Cheng , Jingzhou Liu , Jingjing Liu

Reading comprehension (RC)---in contrast to information retrieval---requires integrating information and reasoning about events, entities, and their relations across a full document. Question answering is conventionally used to assess RC…

Computation and Language · Computer Science 2017-12-20 Tomáš Kočiský , Jonathan Schwarz , Phil Blunsom , Chris Dyer , Karl Moritz Hermann , Gábor Melis , Edward Grefenstette

We tackle Multi-party Dialogue Reading Comprehension (abbr., MDRC). MDRC stands for an extractive reading comprehension task grounded on a batch of dialogues among multiple interlocutors. It is challenging due to the requirement of…

Computation and Language · Computer Science 2023-05-23 Yanling Li , Bowei Zou , Yifan Fan , Mengxing Dong , Yu Hong

Machine Reading Comprehension (MRC) has become enormously popular recently and has attracted a lot of attention. However, the existing reading comprehension datasets are mostly in English. In this paper, we introduce a Span-Extraction…

Computation and Language · Computer Science 2019-11-05 Yiming Cui , Ting Liu , Wanxiang Che , Li Xiao , Zhipeng Chen , Wentao Ma , Shijin Wang , Guoping Hu

Recent works show that learning contextualized embeddings for words is beneficial for downstream tasks. BERT is one successful example of this approach. It learns embeddings by solving two tasks, which are masked language model (masked LM)…

Computation and Language · Computer Science 2020-11-10 Çağla Aksoy , Alper Ahmetoğlu , Tunga Güngör

Reading comprehension models have been successfully applied to extractive text answers, but it is unclear how best to generalize these models to abstractive numerical answers. We enable a BERT-based reading comprehension model to perform…

Computation and Language · Computer Science 2019-09-16 Daniel Andor , Luheng He , Kenton Lee , Emily Pitler

[Context and motivation] Incompleteness in natural-language requirements is a challenging problem. [Question/problem] A common technique for detecting incompleteness in requirements is checking the requirements against external sources.…

Software Engineering · Computer Science 2023-02-10 Dipeeka Luitel , Shabnam Hassani , Mehrdad Sabetzadeh

Achieving human-level performance on some of the Machine Reading Comprehension (MRC) datasets is no longer challenging with the help of powerful Pre-trained Language Models (PLMs). However, the internal mechanism of these artifacts remains…

Computation and Language · Computer Science 2024-10-29 Yiming Cui , Wei-Nan Zhang , Wanxiang Che , Ting Liu , Zhigang Chen , Shijin Wang

We are surprised to find that BERT's peak performance of 77% on the Argument Reasoning Comprehension Task reaches just three points below the average untrained human baseline. However, we show that this result is entirely accounted for by…

Computation and Language · Computer Science 2019-09-17 Timothy Niven , Hung-Yu Kao

Remarkable success has been achieved in the last few years on some limited machine reading comprehension (MRC) tasks. However, it is still difficult to interpret the predictions of existing MRC models. In this paper, we focus on extracting…

Computation and Language · Computer Science 2019-09-25 Hai Wang , Dian Yu , Kai Sun , Jianshu Chen , Dong Yu , David McAllester , Dan Roth