English
Related papers

Related papers: Unsupervised Question Answering by Cloze Translati…

200 papers

In this paper, we study the possibility of almost unsupervised Multiple Choices Question Answering (MCQA). Starting from very basic knowledge, MCQA model knows that some choices have higher probabilities of being correct than the others.…

Computation and Language · Computer Science 2021-11-02 Chi-Liang Liu , Hung-yi Lee

Generalization to out of distribution tasks in reinforcement learning is a challenging problem. One successful approach improves generalization by conditioning policies on task or environment descriptions that provide information about the…

Machine Learning · Computer Science 2022-05-27 Kolby Nottingham , Alekhya Pyla , Sameer Singh , Roy Fox

Neural models for question answering (QA) over documents have achieved significant performance improvements. Although effective, these models do not scale to large corpora due to their complex modeling of interactions between the document…

Computation and Language · Computer Science 2018-05-22 Sewon Min , Victor Zhong , Richard Socher , Caiming Xiong

This paper proposes a novel training method to improve the robustness of Extractive Question Answering (EQA) models. Previous research has shown that existing models, when trained on EQA datasets that include unanswerable questions,…

Computation and Language · Computer Science 2024-10-01 Son Quoc Tran , Matt Kretchmar

When pre-trained on large unsupervised textual corpora, language models are able to store and retrieve factual knowledge to some extent, making it possible to use them directly for zero-shot cloze-style question answering. However, storing…

Computation and Language · Computer Science 2020-05-12 Fabio Petroni , Patrick Lewis , Aleksandra Piktus , Tim Rocktäschel , Yuxiang Wu , Alexander H. Miller , Sebastian Riedel

Unsupervised commonsense question answering is appealing since it does not rely on any labeled task data. Among existing work, a popular solution is to use pre-trained language models to score candidate choices directly conditioned on the…

Computation and Language · Computer Science 2021-06-01 Yilin Niu , Fei Huang , Jiaming Liang , Wenkai Chen , Xiaoyan Zhu , Minlie Huang

We show that the task of question answering (QA) can significantly benefit from the transfer learning of models trained on a different large, fine-grained QA dataset. We achieve the state of the art in two well-studied QA datasets, WikiQA…

Computation and Language · Computer Science 2018-06-22 Sewon Min , Minjoon Seo , Hannaneh Hajishirzi

Given a rough, word-by-word gloss of a source language sentence, target language natives can uncover the latent, fully-fluent rendering of the translation. In this work we explore this intuition by breaking translation into a two step…

Computation and Language · Computer Science 2019-06-14 Nima Pourdamghani , Nada Aldarrab , Marjan Ghazvininejad , Kevin Knight , Jonathan May

Open-domain Question Answering (ODQA) has achieved significant results in terms of supervised learning manner. However, data annotation cannot also be irresistible for its huge demand in an open domain. Though unsupervised QA or…

Computation and Language · Computer Science 2021-09-01 Pengfei Zhu , Xiaoguang Li , Jian Li , Hai Zhao

Question answering (QA) using textual sources for purposes such as reading comprehension (RC) has attracted much attention. This study focuses on the task of explainable multi-hop QA, which requires the system to return the answer with…

Computation and Language · Computer Science 2019-05-30 Kosuke Nishida , Kyosuke Nishida , Masaaki Nagata , Atsushi Otsuka , Itsumi Saito , Hisako Asano , Junji Tomita

Extractive reading comprehension systems can often locate the correct answer to a question in a context document, but they also tend to make unreliable guesses on questions for which the correct answer is not stated in the context. Existing…

Computation and Language · Computer Science 2018-06-12 Pranav Rajpurkar , Robin Jia , Percy Liang

Paraphrase generation has benefited extensively from recent progress in the designing of training objectives and model architectures. However, previous explorations have largely focused on supervised methods, which require a large amount of…

Computation and Language · Computer Science 2021-09-14 Tong Niu , Semih Yavuz , Yingbo Zhou , Nitish Shirish Keskar , Huan Wang , Caiming Xiong

It is challenging to automatically evaluate the answer of a QA model at inference time. Although many models provide confidence scores, and simple heuristics can go a long way towards indicating answer correctness, such measures are heavily…

Computation and Language · Computer Science 2020-10-08 Lukas Muttenthaler , Isabelle Augenstein , Johannes Bjerva

We study the problem of semi-supervised question answering----utilizing unlabeled text to boost the performance of question answering models. We propose a novel training framework, the Generative Domain-Adaptive Nets. In this framework, we…

Computation and Language · Computer Science 2017-04-25 Zhilin Yang , Junjie Hu , Ruslan Salakhutdinov , William W. Cohen

We propose a pre-training objective based on question answering (QA) for learning general-purpose contextual representations, motivated by the intuition that the representation of a phrase in a passage should encode all questions that the…

Computation and Language · Computer Science 2022-03-17 Robin Jia , Mike Lewis , Luke Zettlemoyer

The problem of realistic VQA (RVQA), where a model has to reject unanswerable questions (UQs) and answer answerable ones (AQs), is studied. We first point out 2 drawbacks in current RVQA research, where (1) datasets contain too many…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Yuwei Zhang , Chih-Hui Ho , Nuno Vasconcelos

Time is one of the crucial factors in real-world question answering (QA) problems. However, language models have difficulty understanding the relationships between time specifiers, such as 'after' and 'before', and numbers, since existing…

Computation and Language · Computer Science 2023-10-20 Jungbin Son , Alice Oh

Cross-lingual representation learning transfers knowledge from resource-rich data to resource-scarce ones to improve the semantic understanding abilities of different languages. However, previous works rely on shallow unsupervised data…

Computation and Language · Computer Science 2024-06-25 Dongyang Li , Taolin Zhang , Jiali Deng , Longtao Huang , Chengyu Wang , Xiaofeng He , Hui Xue

Evidence retrieval is a critical stage of question answering (QA), necessary not only to improve performance, but also to explain the decisions of the corresponding QA method. We introduce a simple, fast, and unsupervised iterative evidence…

Computation and Language · Computer Science 2020-05-05 Vikas Yadav , Steven Bethard , Mihai Surdeanu

There have been growing concerns regarding the out-of-domain generalization ability of natural language processing (NLP) models, particularly in question-answering (QA) tasks. Current synthesized data augmentation methods for QA are…

Computation and Language · Computer Science 2023-05-19 Yingjie Niu , Linyi Yang , Ruihai Dong , Yue Zhang