中文
相关论文

相关论文: MRQA 2019 Shared Task: Evaluating Generalization i…

200 篇论文

Reading comprehension is one of the crucial tasks for furthering research in natural language understanding. A lot of diverse reading comprehension datasets have recently been introduced to study various phenomena in natural language,…

计算与语言 · 计算机科学 2020-01-01 Dheeru Dua , Ananth Gottumukkala , Alon Talmor , Sameer Singh , Matt Gardner

This paper presents the experiments accomplished as a part of our participation in the MEDIQA challenge, an (Abacha et al., 2019) shared task. We participated in all the three tasks defined in this particular shared task. The tasks are viz.…

计算与语言 · 计算机科学 2021-07-07 Dibyanayan Bandyopadhyay , Baban Gain , Tanik Saikh , Asif Ekbal

In this paper, we introduce DRCD (Delta Reading Comprehension Dataset), an open domain traditional Chinese machine reading comprehension (MRC) dataset. This dataset aimed to be a standard Chinese machine reading comprehension dataset, which…

计算与语言 · 计算机科学 2019-05-30 Chih Chieh Shao , Trois Liu , Yuting Lai , Yiying Tseng , Sam Tsai

Machine Reading Comprehension (MRC) is a task that requires machine to understand natural language and answer questions by reading a document. It is the core of automatic response technology such as chatbots and automatized customer…

计算与语言 · 计算机科学 2019-09-18 Seungyoung Lim , Myungji Kim , Jooyoul Lee

Humans gather information by engaging in conversations involving a series of interconnected questions and answers. For machines to assist in information gathering, it is therefore essential to enable them to answer conversational questions.…

计算与语言 · 计算机科学 2019-04-02 Siva Reddy , Danqi Chen , Christopher D. Manning

Recently, reading comprehension models achieved near-human performance on large-scale datasets such as SQuAD, CoQA, MS Macro, RACE, etc. This is largely due to the release of pre-trained contextualized representations such as BERT and ELMo,…

计算与语言 · 计算机科学 2019-09-09 Momchil Hardalov , Ivan Koychev , Preslav Nakov

We introduce JobResQA, a multilingual Question Answering benchmark for evaluating Machine Reading Comprehension (MRC) capabilities of LLMs on HR-specific tasks involving r\'esum\'es and job descriptions. The dataset comprises 581 QA pairs…

计算与语言 · 计算机科学 2026-02-02 Casimiro Pio Carrino , Paula Estrella , Rabih Zbib , Carlos Escolano , José A. R. Fonollosa

We present TriviaQA, a challenging reading comprehension dataset containing over 650K question-answer-evidence triples. TriviaQA includes 95K question-answer pairs authored by trivia enthusiasts and independently gathered evidence…

计算与语言 · 计算机科学 2017-05-16 Mandar Joshi , Eunsol Choi , Daniel S. Weld , Luke Zettlemoyer

We propose a multi-task learning framework to learn a joint Machine Reading Comprehension (MRC) model that can be applied to a wide range of MRC tasks in different domains. Inspired by recent ideas of data selection in machine translation,…

计算与语言 · 计算机科学 2019-04-02 Yichong Xu , Xiaodong Liu , Yelong Shen , Jingjing Liu , Jianfeng Gao

Machine reading comprehension (MRC) of text data is one important task in Natural Language Understanding. It is a complex NLP problem with a lot of ongoing research fueled by the release of the Stanford Question Answering Dataset (SQuAD)…

计算与语言 · 计算机科学 2022-02-11 Addi Ait-Mlouk , Sadi Alawadi , Salman Toor , Andreas Hellander

This paper presents a systematic review of benchmarks and approaches for explainability in Machine Reading Comprehension (MRC). We present how the representation and inference challenges evolved and the steps which were taken to tackle…

计算与语言 · 计算机科学 2020-10-02 Mokanarangan Thayaparan , Marco Valentino , André Freitas

Reading strategies have been shown to improve comprehension levels, especially for readers lacking adequate prior knowledge. Just as the process of knowledge accumulation is time-consuming for human readers, it is resource-demanding to…

计算与语言 · 计算机科学 2019-03-26 Kai Sun , Dian Yu , Dong Yu , Claire Cardie

This paper surveys 60 English Machine Reading Comprehension datasets, with a view to providing a convenient resource for other researchers interested in this problem. We categorize the datasets according to their question and answer form…

计算与语言 · 计算机科学 2021-10-11 Daria Dzendzik , Carl Vogel , Jennifer Foster

Commonsense knowledge plays an important role when we read. The performance of BERT on SQuAD dataset shows that the accuracy of BERT can be better than human users. However, it does not mean that computers can surpass the human being in…

计算与语言 · 计算机科学 2019-09-10 Yidan Hu , Gongqi Lin , Yuan Miao , Chunyan Miao

Machine Reading Comprehension (MRC) is the task of answering a question over a paragraph of text. While neural MRC systems gain popularity and achieve noticeable performance, issues are being raised with the methodology used to establish…

计算与语言 · 计算机科学 2020-03-11 Viktor Schlegel , Marco Valentino , André Freitas , Goran Nenadic , Riza Batista-Navarro

We share the findings of the first shared task on improving robustness of Machine Translation (MT). The task provides a testbed representing challenges facing MT models deployed in the real world, and facilitates new approaches to improve…

Machine reading comprehension (MRC) has received considerable attention as a benchmark for natural language understanding. However, the conventional task design of MRC lacks explainability beyond the model interpretation, i.e., reading…

计算与语言 · 计算机科学 2021-01-27 Saku Sugawara , Pontus Stenetorp , Akiko Aizawa

We present the results of the Workshop on Multilingual Information Access (MIA) 2022 Shared Task, evaluating cross-lingual open-retrieval question answering (QA) systems in 16 typologically diverse languages. In this task, we adapted two…

计算与语言 · 计算机科学 2022-07-05 Akari Asai , Shayne Longpre , Jungo Kasai , Chia-Hsuan Lee , Rui Zhang , Junjie Hu , Ikuya Yamada , Jonathan H. Clark , Eunsol Choi

Task requirements (TRs) writing is an important question type in Key English Test and Preliminary English Test. A TR writing question may include multiple requirements and a high-quality essay must respond to each requirement thoroughly and…

计算与语言 · 计算机科学 2021-07-19 Shiting Xu , Guowei Xu , Peilei Jia , Wenbiao Ding , Zhongqin Wu , Zitao Liu

Machine Reading Comprehension (MRC) has become enormously popular recently and has attracted a lot of attention. However, existing reading comprehension datasets are mostly in English. To add diversity in reading comprehension datasets, in…

计算与语言 · 计算机科学 2018-03-16 Yiming Cui , Ting Liu , Zhipeng Chen , Wentao Ma , Shijin Wang , Guoping Hu