English
Related papers

Related papers: Unsupervised Question Answering by Cloze Translati…

200 papers

Recently proposed long-form question answering (QA) systems, supported by large language models (LLMs), have shown promising capabilities. Yet, attributing and verifying their generated abstractive answers can be difficult, and…

Computation and Language · Computer Science 2024-07-02 Tal Schuster , Adam D. Lelkes , Haitian Sun , Jai Gupta , Jonathan Berant , William W. Cohen , Donald Metzler

We show that state-of-the-art self-supervised language models can be readily used to extract relations from a corpus without the need to train a fine-tuned extractive head. We introduce RE-Flex, a simple framework that performs constrained…

Computation and Language · Computer Science 2020-10-15 Ankur Goswami , Akshata Bhat , Hadar Ohana , Theodoros Rekatsinas

Question and answer generation is a data augmentation method that aims to improve question answering (QA) models given the limited amount of human labeled data. However, a considerable gap remains between synthetic and human-generated…

Computation and Language · Computer Science 2020-02-25 Raul Puri , Ryan Spring , Mostofa Patwary , Mohammad Shoeybi , Bryan Catanzaro

Natural language understanding involves reading between the lines with implicit background knowledge. Current systems either rely on pre-trained language models as the sole implicit source of world knowledge, or resort to external knowledge…

Computation and Language · Computer Science 2020-09-17 Vered Shwartz , Peter West , Ronan Le Bras , Chandra Bhagavatula , Yejin Choi

Supervised training of neural models to duplicate question detection in community Question Answering (cQA) requires large amounts of labeled question pairs, which are costly to obtain. To minimize this cost, recent works thus often used…

Computation and Language · Computer Science 2020-09-22 Andreas Rücklé , Nafise Sadat Moosavi , Iryna Gurevych

Recent work on training neural retrievers for open-domain question answering (OpenQA) has employed both supervised and unsupervised approaches. However, it remains unclear how unsupervised and supervised methods can be used most effectively…

Computation and Language · Computer Science 2021-06-03 Devendra Singh Sachan , Mostofa Patwary , Mohammad Shoeybi , Neel Kant , Wei Ping , William L Hamilton , Bryan Catanzaro

In this paper, we propose an unsupervised query enhanced approach for knowledge-intensive conversations, namely QKConv. There are three modules in QKConv: a query generator, an off-the-shelf knowledge selector, and a response generator.…

Computation and Language · Computer Science 2023-05-29 Mingzhu Cai , Siqi Bao , Xin Tian , Huang He , Fan Wang , Hua Wu

Existing models for extractive summarization are usually trained from scratch with a cross-entropy loss, which does not explicitly capture the global context at the document level. In this paper, we aim to improve this task by introducing…

Computation and Language · Computer Science 2019-06-12 Hong Wang , Xin Wang , Wenhan Xiong , Mo Yu , Xiaoxiao Guo , Shiyu Chang , William Yang Wang

The recent (2019-02) demonstration of the power of huge language models such as GPT-2 to memorise the answers to factoid questions raises questions about the extent to which knowledge is being embedded directly within these large models.…

Computation and Language · Computer Science 2019-11-22 Martin Andrews , Sam Witteveen

Coupled with the availability of large scale datasets, deep learning architectures have enabled rapid progress on the Question Answering task. However, most of those datasets are in English, and the performances of state-of-the-art…

Computation and Language · Computer Science 2021-10-15 Arij Riabi , Thomas Scialom , Rachel Keraron , Benoît Sagot , Djamé Seddah , Jacopo Staiano

Question answering (QA) is an important aspect of open-domain conversational agents, garnering specific research focus in the conversational QA (ConvQA) subtask. One notable limitation of recent ConvQA efforts is the response being answer…

Computation and Language · Computer Science 2020-12-18 Ashutosh Baheti , Alan Ritter , Kevin Small

We propose a novel method for applying Transformer models to extractive question answering (QA) tasks. Recently, pretrained generative sequence-to-sequence (seq2seq) models have achieved great success in question answering. Contributing to…

Computation and Language · Computer Science 2021-10-14 Peng Xu , Davis Liang , Zhiheng Huang , Bing Xiang

To steer language models towards truthful outputs on tasks which are beyond human capability, previous work has suggested training models on easy tasks to steer them on harder ones (easy-to-hard generalization), or using unsupervised…

Machine Learning · Computer Science 2026-02-25 Callum Canavan , Aditya Shrivastava , Allison Qi , Jonathan Michala , Fabien Roger

Existing literature on Question Answering (QA) mostly focuses on algorithmic novelty, data augmentation, or increasingly large pre-trained language models like XLNet and RoBERTa. Additionally, a lot of systems on the QA leaderboards do not…

Computation and Language · Computer Science 2019-09-13 Lin Pan , Rishav Chakravarti , Anthony Ferritto , Michael Glass , Alfio Gliozzo , Salim Roukos , Radu Florian , Avirup Sil

We focus on multiple-choice question answering (QA) tasks in subject areas such as science, where we require both broad background knowledge and the facts from the given subject-area reference corpus. In this work, we explore simple yet…

Computation and Language · Computer Science 2019-10-03 Xiaoman Pan , Kai Sun , Dian Yu , Jianshu Chen , Heng Ji , Claire Cardie , Dong Yu

We present TriviaQA, a challenging reading comprehension dataset containing over 650K question-answer-evidence triples. TriviaQA includes 95K question-answer pairs authored by trivia enthusiasts and independently gathered evidence…

Computation and Language · Computer Science 2017-05-16 Mandar Joshi , Eunsol Choi , Daniel S. Weld , Luke Zettlemoyer

We cast a suite of information extraction tasks into a text-to-triple translation framework. Instead of solving each task relying on task-specific datasets and models, we formalize the task as a translation between task-specific input text…

Computation and Language · Computer Science 2021-09-24 Chenguang Wang , Xiao Liu , Zui Chen , Haoyun Hong , Jie Tang , Dawn Song

We propose a simple method to generate multilingual question and answer pairs on a large scale through the use of a single generative model. These synthetic samples can be used to improve the zero-shot performance of multilingual QA models…

Computation and Language · Computer Science 2021-06-01 Siamak Shakeri , Noah Constant , Mihir Sanjay Kale , Linting Xue

This paper addresses the problem of key phrase extraction from sentences. Existing state-of-the-art supervised methods require large amounts of annotated data to achieve good performance and generalization. Collecting labeled data is,…

Computation and Language · Computer Science 2019-04-09 Jue Wang , Ke Chen , Lidan Shou , Sai Wu , Sharad Mehrotra

Synthesizing QA pairs with a question generator (QG) on the target domain has become a popular approach for domain adaptation of question answering (QA) models. Since synthetic questions are often noisy in practice, existing work adapts…

Computation and Language · Computer Science 2022-03-18 Xiang Yue , Ziyu Yao , Huan Sun