English
Related papers

Related papers: What do Models Learn from Question Answering Datas…

200 papers

Many intellectual endeavors require mathematical problem solving, but this skill remains beyond the capabilities of computers. To measure this ability in machine learning models, we introduce MATH, a new dataset of 12,500 challenging…

Machine Learning · Computer Science 2021-11-10 Dan Hendrycks , Collin Burns , Saurav Kadavath , Akul Arora , Steven Basart , Eric Tang , Dawn Song , Jacob Steinhardt

Recent powerful pre-trained language models have achieved remarkable performance on most of the popular datasets for reading comprehension. It is time to introduce more challenging datasets to push the development of this field towards more…

Computation and Language · Computer Science 2020-08-25 Weihao Yu , Zihang Jiang , Yanfei Dong , Jiashi Feng

The emergence of structured databases for Question Answering (QA) systems has led to developing methods, in which the problem of learning the correct answer efficiently is based on a linking task between the constituents of the question and…

Machine Learning · Computer Science 2020-03-05 Hamid Zafar , Maryam Tavakol , Jens Lehmann

Community Question-Answering websites, such as StackOverflow and Quora, expect users to follow specific guidelines in order to maintain content quality. These systems mainly rely on community reports for assessing contents, which has…

Computation and Language · Computer Science 2020-10-29 Issa Annamoradnejad , Mohammadamin Fazli , Jafar Habibi

Teaching machines to read natural language documents remains an elusive challenge. Machine reading systems can be tested on their ability to answer questions posed on the contents of documents that they have seen, but until now large scale…

Computation and Language · Computer Science 2015-11-20 Karl Moritz Hermann , Tomáš Kočiský , Edward Grefenstette , Lasse Espeholt , Will Kay , Mustafa Suleyman , Phil Blunsom

Commonsense reasoning is a critical AI capability, but it is difficult to construct challenging datasets that test common sense. Recent neural question answering systems, based on large pre-trained models of language, have already achieved…

Computation and Language · Computer Science 2019-07-29 Michael Chen , Mike D'Arcy , Alisa Liu , Jared Fernandez , Doug Downey

Question answering (QA) models for reading comprehension have been demonstrated to exploit unintended dataset biases such as question-context lexical overlap. This hinders QA models from generalizing to under-represented samples such as…

Computation and Language · Computer Science 2021-09-24 Kazutoshi Shinoda , Saku Sugawara , Akiko Aizawa

Reading comprehension models have been successfully applied to extractive text answers, but it is unclear how best to generalize these models to abstractive numerical answers. We enable a BERT-based reading comprehension model to perform…

Computation and Language · Computer Science 2019-09-16 Daniel Andor , Luheng He , Kenton Lee , Emily Pitler

Despite the rapid progress in multihop question-answering (QA), models still have trouble explaining why an answer is correct, with limited explanation training data available to learn from. To address this, we introduce three explanation…

Computation and Language · Computer Science 2020-10-08 Harsh Jhamtani , Peter Clark

Question answering (QA) models for reading comprehension have achieved human-level accuracy on in-distribution test sets. However, they have been demonstrated to lack robustness to challenge sets, whose distribution is different from that…

Computation and Language · Computer Science 2021-06-07 Kazutoshi Shinoda , Saku Sugawara , Akiko Aizawa

Machine Reading Comprehension (MRC) is an important topic in the domain of automated question answering and in natural language processing more generally. Since the release of the SQuAD 1.1 and SQuAD 2 datasets, progress in the field has…

Computation and Language · Computer Science 2019-07-05 François-Xavier Aubet , Dominic Danks , Yuchen Zhu

Reading comprehension has been widely studied. One of the most representative reading comprehension tasks is Stanford Question Answering Dataset (SQuAD), on which machine is already comparable with human. On the other hand, accessing large…

Computation and Language · Computer Science 2018-04-03 Chia-Hsuan Li , Szu-Lin Wu , Chi-Liang Liu , Hung-yi Lee

In this paper, we present the mQA model, which is able to answer questions about the content of an image. The answer can be a sentence, a phrase or a single word. Our model contains four components: a Long Short-Term Memory (LSTM) to…

Computer Vision and Pattern Recognition · Computer Science 2015-11-04 Haoyuan Gao , Junhua Mao , Jie Zhou , Zhiheng Huang , Lei Wang , Wei Xu

Deep Learning has managed to push boundaries in a wide variety of tasks. One area of interest is to tackle problems in reasoning and understanding, with an aim to emulate human intelligence. In this work, we describe a deep learning model…

Machine Learning · Computer Science 2019-04-03 Revanth Reddy , Rahul Ramesh , Ameet Deshpande , Mitesh M. Khapra

Vision-and-language (V&L) models pretrained on large-scale multimodal data have demonstrated strong performance on various tasks such as image captioning and visual question answering (VQA). The quality of such models is commonly assessed…

Computation and Language · Computer Science 2023-04-04 Aishwarya Agrawal , Ivana Kajić , Emanuele Bugliarello , Elnaz Davoodi , Anita Gergely , Phil Blunsom , Aida Nematzadeh

Visual question answering (VQA) is a task that combines both the techniques of computer vision and natural language processing. It requires models to answer a text-based question according to the information contained in a visual. In recent…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Yeyun Zou , Qiyu Xie

Humans observe and interact with the world to acquire knowledge. However, most existing machine reading comprehension (MRC) tasks miss the interactive, information-seeking component of comprehension. Such tasks present models with static…

Computation and Language · Computer Science 2019-08-30 Xingdi Yuan , Marc-Alexandre Cote , Jie Fu , Zhouhan Lin , Christopher Pal , Yoshua Bengio , Adam Trischler

Question answering (QA) in English has been widely explored, but multilingual datasets are relatively new, with several methods attempting to bridge the gap between high- and low-resourced languages using data augmentation through…

Computation and Language · Computer Science 2021-06-01 Arnab Debnath , Navid Rajabi , Fardina Fathmiul Alam , Antonios Anastasopoulos

Despite extensive research on a wide range of question answering (QA) systems, most existing work focuses on answer containment-i.e., assuming that answers can be directly extracted and/or generated from documents in the corpus. However,…

Computation and Language · Computer Science 2026-02-03 Jamshid Mozafari , Hamed Zamani , Guido Zuccon , Adam Jatowt

Language models have become nearly ubiquitous in natural language processing applications achieving state-of-the-art results in many tasks including prosody. As the model design does not define predetermined linguistic targets during…

Computation and Language · Computer Science 2023-04-26 Sofoklis Kakouros , Johannah O'Mahony