English
Related papers

Related papers: SciMRC: Multi-perspective Scientific Machine Readi…

200 papers

In the artificial intelligence area, one of the ultimate goals is to make computers understand human language and offer assistance. In order to achieve this ideal, researchers of computer science have put forward a lot of models and…

Computation and Language · Computer Science 2015-12-07 Mengyun Cao , Jiao Tian , Dezhi Cheng , Jin Liu , Xiaoping Sun

We introduce BIOMRC, a large-scale cloze-style biomedical MRC dataset. Care was taken to reduce noise, compared to the previous BIOREAD dataset of Pappas et al. (2018). Experiments show that simple heuristics do not perform well on the new…

Computation and Language · Computer Science 2020-05-14 Petros Stavropoulos , Dimitris Pappas , Ion Androutsopoulos , Ryan McDonald

We present Native Chinese Reader (NCR), a new machine reading comprehension (MRC) dataset with particularly long articles in both modern and classical Chinese. NCR is collected from the exam questions for the Chinese course in China's high…

Computation and Language · Computer Science 2021-12-15 Shusheng Xu , Yichen Liu , Xiaoyu Yi , Siyuan Zhou , Huizi Li , Yi Wu

Existing machine reading comprehension (MRC) models do not scale effectively to real-world applications like web-level information retrieval and question answering (QA). We argue that this stems from the nature of MRC datasets: most of…

Computation and Language · Computer Science 2020-04-17 Xingdi Yuan , Jie Fu , Marc-Alexandre Cote , Yi Tay , Christopher Pal , Adam Trischler

To provide a survey on the existing tasks and models in Machine Reading Comprehension (MRC), this report reviews: 1) the dataset collection and performance evaluation of some representative simple-reasoning and complex-reasoning MRC tasks;…

Computation and Language · Computer Science 2020-01-24 Chao Wang

Machine reading comprehension have been intensively studied in recent years, and neural network-based models have shown dominant performances. In this paper, we present a Sogou Machine Reading Comprehension (SMRC) toolkit that can be used…

Computation and Language · Computer Science 2019-04-02 Jindou Wu , Yunlun Yang , Chao Deng , Hongyi Tang , Bingning Wang , Haoze Sun , Ting Yao , Qi Zhang

Large multimodal models (LMMs) have proven flexible and generalisable across many tasks and fields. Although they have strong potential to aid scientific research, their capabilities in this domain are not well characterised. A key aspect…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Jonathan Roberts , Kai Han , Neil Houlsby , Samuel Albanie

We introduce SciQAG, a novel framework for automatically generating high-quality science question-answer pairs from a large corpus of scientific literature based on large language models (LLMs). SciQAG consists of a QA generator and a QA…

Computation and Language · Computer Science 2024-07-11 Yuwei Wan , Yixuan Liu , Aswathy Ajith , Clara Grazian , Bram Hoex , Wenjie Zhang , Chunyu Kit , Tong Xie , Ian Foster

We present a new dataset for machine comprehension in the medical domain. Our dataset uses clinical case reports with around 100,000 gap-filling queries about these cases. We apply several baselines and state-of-the-art neural readers to…

Computation and Language · Computer Science 2018-03-28 Simon Šuster , Walter Daelemans

This paper introduces DuReader, a new large-scale, open-domain Chinese ma- chine reading comprehension (MRC) dataset, designed to address real-world MRC. DuReader has three advantages over previous MRC datasets: (1) data sources: questions…

Computation and Language · Computer Science 2018-06-12 Wei He , Kai Liu , Jing Liu , Yajuan Lyu , Shiqi Zhao , Xinyan Xiao , Yuan Liu , Yizhong Wang , Hua Wu , Qiaoqiao She , Xuan Liu , Tian Wu , Haifeng Wang

This paper presents a systematic review of benchmarks and approaches for explainability in Machine Reading Comprehension (MRC). We present how the representation and inference challenges evolved and the steps which were taken to tackle…

Computation and Language · Computer Science 2020-10-02 Mokanarangan Thayaparan , Marco Valentino , André Freitas

Machine Comprehension (MC) is a challenging task in Natural Language Processing field, which aims to guide the machine to comprehend a passage and answer the given question. Many existing approaches on MC task are suffering the inefficiency…

Computation and Language · Computer Science 2017-10-10 Zheqian Chen , Rongqin Yang , Bin Cao , Zhou Zhao , Deng Cai , Xiaofei He

Multi-choice machine reading comprehension (MRC) requires models to choose the correct answer from candidate options given a passage and a question. Our research focuses dialogue-based MRC, where the passages are multi-turn dialogues. It…

Computation and Language · Computer Science 2020-09-11 Junlong Li , Zhuosheng Zhang , Hai Zhao

This paper provides a thorough examination of recent developments in the field of multi-choice Machine Reading Comprehension (MRC). Focused on benchmark datasets, methodologies, challenges, and future trajectories, our goal is to offer…

Computation and Language · Computer Science 2024-08-06 Shima Foolad , Kourosh Kiani , Razieh Rastgoo

Scientific figure interpretation is a crucial capability for AI-driven scientific assistants built on advanced Large Vision Language Models. However, current datasets and benchmarks primarily focus on simple charts or other relatively…

Understanding narratives requires reading between the lines, which in turn, requires interpreting the likely causes and effects of events, even when they are not mentioned explicitly. In this paper, we introduce Cosmos QA, a large-scale…

Computation and Language · Computer Science 2019-09-10 Lifu Huang , Ronan Le Bras , Chandra Bhagavatula , Yejin Choi

The number of Language Models (LMs) dedicated to processing scientific text is on the rise. Keeping pace with the rapid growth of scientific LMs (SciLMs) has become a daunting task for researchers. To date, no comprehensive surveys on…

Computation and Language · Computer Science 2024-02-01 Xanh Ho , Anh Khoa Duong Nguyen , An Tuan Dao , Junfeng Jiang , Yuki Chida , Kaito Sugimoto , Huy Quoc To , Florian Boudin , Akiko Aizawa

We present a large-scale dataset, ReCoRD, for machine reading comprehension requiring commonsense reasoning. Experiments on this dataset demonstrate that the performance of state-of-the-art MRC systems fall far behind human performance.…

Computation and Language · Computer Science 2018-10-31 Sheng Zhang , Xiaodong Liu , Jingjing Liu , Jianfeng Gao , Kevin Duh , Benjamin Van Durme

Machine Reading Comprehension (MRC) with multiple-choice questions requires the machine to read given passage and select the correct answer among several candidates. In this paper, we propose a novel approach called Convolutional Spatial…

Computation and Language · Computer Science 2019-11-05 Zhipeng Chen , Yiming Cui , Wentao Ma , Shijin Wang , Guoping Hu

Reading comprehension (RC)---in contrast to information retrieval---requires integrating information and reasoning about events, entities, and their relations across a full document. Question answering is conventionally used to assess RC…

Computation and Language · Computer Science 2017-12-20 Tomáš Kočiský , Jonathan Schwarz , Phil Blunsom , Chris Dyer , Karl Moritz Hermann , Gábor Melis , Edward Grefenstette