English
Related papers

Related papers: A Lightweight Method to Generate Unanswerable Ques…

200 papers

Although language models (LMs) have boosted the performance of Question Answering, they still need plenty of data. Data annotation, in contrast, is a time-consuming process. This especially applies to Question Answering, where possibly…

Computation and Language · Computer Science 2024-05-16 Maximilian Schmidt , Andrea Bartezzaghi , Ngoc Thang Vu

Question answering (QA) is an important aspect of open-domain conversational agents, garnering specific research focus in the conversational QA (ConvQA) subtask. One notable limitation of recent ConvQA efforts is the response being answer…

Computation and Language · Computer Science 2020-12-18 Ashutosh Baheti , Alan Ritter , Kevin Small

Question Answering (QA) systems require a large amount of annotated data which is costly and time-consuming to gather. Converting datasets of existing QA benchmarks are challenging due to different formats and complexities. To address these…

Computation and Language · Computer Science 2022-10-14 Saptarashmi Bandyopadhyay , Shraman Pal , Hao Zou , Abhranil Chandra , Jordan Boyd-Graber

In this paper, we focus on task-specific question answering (QA). To this end, we introduce a method for generating exhaustive and high-quality training data, which allows us to train compact (e.g., run on a mobile device), task-specific QA…

Computation and Language · Computer Science 2024-01-25 Hai X. Pham , Isma Hadji , Xinnuo Xu , Ziedune Degutyte , Jay Rainey , Evangelos Kazakos , Afsaneh Fazly , Georgios Tzimiropoulos , Brais Martinez

Neural approaches have become very popular in Question Answering (QA), however, they require a large amount of annotated data. In this work, we propose a novel approach that combines data augmentation via question-answer generation with…

Computation and Language · Computer Science 2024-09-16 Maximilian Kimmich , Andrea Bartezzaghi , Jasmina Bogojeska , Cristiano Malossi , Ngoc Thang Vu

Question Generation (QG) is the task of generating a plausible question for a given <passage, answer> pair. Template-based QG uses linguistically-informed heuristics to transform declarative sentences into interrogatives, whereas supervised…

Computation and Language · Computer Science 2021-09-17 Chenyang Lyu , Lifeng Shang , Yvette Graham , Jennifer Foster , Xin Jiang , Qun Liu

A question-answering (QA) system is to search suitable answers within a knowledge base. Current QA systems struggle with queries requiring complex reasoning or real-time knowledge integration. They are often supplemented with retrieval…

Computation and Language · Computer Science 2025-05-21 Sizhe Yuen , Ting Su , Ziyang Wang , Yali Du , Adam J. Sobey

Users frequently ask simple factoid questions for question answering (QA) systems, attenuating the impact of myriad recent works that support more complex questions. Prompting users with automatically generated suggested questions (SQs) can…

Computation and Language · Computer Science 2021-08-06 Xusen Yin , Li Zhou , Kevin Small , Jonathan May

Unsupervised commonsense question answering is appealing since it does not rely on any labeled task data. Among existing work, a popular solution is to use pre-trained language models to score candidate choices directly conditioned on the…

Computation and Language · Computer Science 2021-06-01 Yilin Niu , Fei Huang , Jiaming Liang , Wenkai Chen , Xiaoyan Zhu , Minlie Huang

There are several issues with the existing general machine translation or natural language generation evaluation metrics, and question-answering (QA) systems are indifferent in that context. To build robust QA systems, we need the ability…

Computation and Language · Computer Science 2022-07-06 Farida Mustafazade , Peter F. Ebbinghaus

We present an automatic large language model (LLM) conversion approach that produces uncertainty-aware LLMs capable of estimating uncertainty with every prediction. Our approach is model- and data-agnostic, is computationally-efficient, and…

Despite recent progress, state-of-the-art question answering models remain vulnerable to a variety of adversarial attacks. While dynamic adversarial data collection, in which a human annotator tries to write examples that fool a…

Computation and Language · Computer Science 2022-03-16 Max Bartolo , Tristan Thrush , Robin Jia , Sebastian Riedel , Pontus Stenetorp , Douwe Kiela

We study the effect of seven data augmentation (da) methods in factoid question answering, focusing on the biomedical domain, where obtaining training instances is particularly difficult. We experiment with data from the BioASQ challenge,…

Computation and Language · Computer Science 2022-04-12 Dimitris Pappas , Prodromos Malakasiotis , Ion Androutsopoulos

Recent pretrained language models "solved" many reading comprehension benchmarks, where questions are written with access to the evidence document. However, datasets containing information-seeking queries where evidence documents are…

Computation and Language · Computer Science 2021-06-08 Akari Asai , Eunsol Choi

Automatic question generation (QG) serves a wide range of purposes, such as augmenting question-answering (QA) corpora, enhancing chatbot systems, and developing educational materials. Despite its importance, most existing datasets…

Computation and Language · Computer Science 2024-10-07 Seonjeong Hwang , Yunsu Kim , Gary Geunbae Lee

We conduct a feasibility study into the applicability of answer-agnostic question generation models to textbook passages. We show that a significant portion of errors in such systems arise from asking irrelevant or uninterpretable questions…

Computation and Language · Computer Science 2022-03-30 Liam Dugan , Eleni Miltsakaki , Shriyash Upadhyay , Etan Ginsberg , Hannah Gonzalez , Dayheon Choi , Chuning Yuan , Chris Callison-Burch

We introduce a novel method of generating synthetic question answering corpora by combining models of question generation and answer extraction, and by filtering the results to ensure roundtrip consistency. By pretraining on the resulting…

Computation and Language · Computer Science 2019-06-14 Chris Alberti , Daniel Andor , Emily Pitler , Jacob Devlin , Michael Collins

Generative commonsense reasoning is the capability of a language model to generate a sentence with a given concept-set that is based on commonsense knowledge. However, generative language models still struggle to provide outputs, and the…

Computation and Language · Computer Science 2021-11-02 Jaehyung Seo , Chanjun Park , Sugyeong Eo , Hyeonseok Moon , Heuiseok Lim

Existing question answering (QA) systems owe much of their success to large, high-quality training data. Such annotation efforts are costly, and the difficulty compounds in the cross-lingual setting. Therefore, prior cross-lingual QA work…

Computation and Language · Computer Science 2023-10-18 Bryan Li , Chris Callison-Burch

Text-based Question Generation (QG) aims at generating natural and relevant questions that can be answered by a given answer in some context. Existing QG models suffer from a "semantic drift" problem, i.e., the semantics of the…

Computation and Language · Computer Science 2019-09-16 Shiyue Zhang , Mohit Bansal