English
Related papers

Related papers: NewsQA: A Machine Comprehension Dataset

200 papers

Many recent papers address reading comprehension, where examples consist of (question, passage, answer) tuples. Presumably, a model must combine information from both questions and passages to predict corresponding answers. However, despite…

Computation and Language · Computer Science 2018-08-22 Divyansh Kaushik , Zachary C. Lipton

Existing analysis work in machine reading comprehension (MRC) is largely concerned with evaluating the capabilities of systems. However, the capabilities of datasets are not assessed for benchmarking language understanding precisely. We…

Computation and Language · Computer Science 2019-11-22 Saku Sugawara , Pontus Stenetorp , Kentaro Inui , Akiko Aizawa

Reading comprehension has been widely studied. One of the most representative reading comprehension tasks is Stanford Question Answering Dataset (SQuAD), on which machine is already comparable with human. On the other hand, accessing large…

Computation and Language · Computer Science 2018-04-03 Chia-Hsuan Li , Szu-Lin Wu , Chi-Liang Liu , Hung-yi Lee

The absence of explicitly tailored, accessible annotated datasets for educational purposes presents a notable obstacle for NLP tasks in languages with limited resources.This study initially explores the feasibility of using machine…

Computation and Language · Computer Science 2024-04-29 Hailay Teklehaymanot , Dren Fazlija , Niloy Ganguly , Gourab K. Patro , Wolfgang Nejdl

We introduce MilkQA, a question answering dataset from the dairy domain dedicated to the study of consumer questions. The dataset contains 2,657 pairs of questions and answers, written in the Portuguese language and originally collected by…

Computation and Language · Computer Science 2018-01-11 Marcelo Criscuolo , Erick Rocha Fonseca , Sandra Maria Aluísio , Ana Carolina Sperança-Criscuolo

In this paper, we introduce LiveQA, a new question answering dataset constructed from play-by-play live broadcast. It contains 117k multiple-choice questions written by human commentators for over 1,670 NBA games, which are collected from…

Computation and Language · Computer Science 2020-10-02 Qianying Liu , Sicong Jiang , Yizhong Wang , Sujian Li

While question answering (QA) with neural network, i.e. neural QA, has achieved promising results in recent years, lacking of large scale real-word QA dataset is still a challenge for developing and evaluating neural QA system. To alleviate…

Computation and Language · Computer Science 2016-09-02 Peng Li , Wei Li , Zhengyan He , Xuguang Wang , Ying Cao , Jie Zhou , Wei Xu

We introduce SciQAG, a novel framework for automatically generating high-quality science question-answer pairs from a large corpus of scientific literature based on large language models (LLMs). SciQAG consists of a QA generator and a QA…

Computation and Language · Computer Science 2024-07-11 Yuwei Wan , Yixuan Liu , Aswathy Ajith , Clara Grazian , Bram Hoex , Wenjie Zhang , Chunyu Kit , Tong Xie , Ian Foster

Commonsense reasoning is intuitive for humans but has been a long-term challenge for artificial intelligence (AI). Recent advancements in pretrained language models have shown promising results on several commonsense benchmark datasets.…

Computation and Language · Computer Science 2021-06-03 Shikhar Singh , Nuan Wen , Yu Hou , Pegah Alipoormolabashi , Te-Lin Wu , Xuezhe Ma , Nanyun Peng

A riddle is a question or statement with double or veiled meanings, followed by an unexpected answer. Solving riddle is a challenging task for both machine and human, testing the capability of understanding figurative, creative natural…

Computation and Language · Computer Science 2022-03-21 Yunxiang Zhang , Xiaojun Wan

Question answering over knowledge bases (KBQA) has become a popular approach to help users extract information from knowledge bases. Although several systems exist, choosing one suitable for a particular application scenario is difficult.…

Computation and Language · Computer Science 2022-11-16 Khiem Vinh Tran , Hao Phu Phan , Khang Nguyen Duc Quach , Ngan Luu-Thuy Nguyen , Jun Jo , Thanh Tam Nguyen

The ability of reasoning over evidence has received increasing attention in question answering (QA). Recently, natural language database (NLDB) conducts complex QA in knowledge base with textual evidences rather than structured…

Computation and Language · Computer Science 2022-10-18 Minjun Zhu , Yixuan Weng , Shizhu He , Kang Liu , Jun Zhao

Complex question answering (CQA) over raw text is a challenging task. A prominent approach to this task is based on the programmer-interpreter framework, where the programmer maps the question into a sequence of reasoning actions which is…

Computation and Language · Computer Science 2020-10-20 Xiao-Yu Guo , Yuan-Fang Li , Gholamreza Haffari

We propose a novel video understanding task by fusing knowledge-based and video question answering. First, we introduce KnowIT VQA, a video dataset with 24,282 human-generated question-answer pairs about a popular sitcom. The dataset…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Noa Garcia , Mayu Otani , Chenhui Chu , Yuta Nakashima

This paper introduces MedMCQA, a new large-scale, Multiple-Choice Question Answering (MCQA) dataset designed to address real-world medical entrance exam questions. More than 194k high-quality AIIMS \& NEET PG entrance exam MCQs covering…

Computation and Language · Computer Science 2022-03-29 Ankit Pal , Logesh Kumar Umapathi , Malaikannan Sankarasubbu

Knowledge and language understanding of models evaluated through question answering (QA) has been usually studied on static snapshots of knowledge, like Wikipedia. However, our world is dynamic, evolves over time, and our models' knowledge…

We introduce ScreenQA, a novel benchmarking dataset designed to advance screen content understanding through question answering. The existing screen datasets are focused either on low-level structural and component understanding, or on a…

Computation and Language · Computer Science 2025-02-11 Yu-Chung Hsiao , Fedir Zubach , Gilles Baechler , Srinivas Sunkara , Victor Carbune , Jason Lin , Maria Wang , Yun Zhu , Jindong Chen

Machine reading comprehension has made great progress in recent years owing to large-scale annotated datasets. In the clinical domain, however, creating such datasets is quite difficult due to the domain expertise required for annotation.…

Computation and Language · Computer Science 2020-05-05 Xiang Yue , Bernal Jimenez Gutierrez , Huan Sun

Machine Reading Comprehension (MRC) has become enormously popular recently and has attracted a lot of attention. However, the existing reading comprehension datasets are mostly in English. In this paper, we introduce a Span-Extraction…

Computation and Language · Computer Science 2019-11-05 Yiming Cui , Ting Liu , Wanxiang Che , Li Xiao , Zhipeng Chen , Wentao Ma , Shijin Wang , Guoping Hu

Given questions regarding some prototypical situation such as Name something that people usually do before they leave the house for work? a human can easily answer them via acquired experiences. There can be multiple right answers for such…

Computation and Language · Computer Science 2020-10-29 Michael Boratko , Xiang Lorraine Li , Rajarshi Das , Tim O'Gorman , Dan Le , Andrew McCallum