English
Related papers

Related papers: Determining Question-Answer Plausibility in Crowds…

200 papers

This paper presents a new selection-based question answering dataset, SelQA. The dataset consists of questions generated through crowdsourcing and sentence length answers that are drawn from the ten most prevalent topics in the English…

Computation and Language · Computer Science 2016-10-31 Tomasz Jurczyk , Michael Zhai , Jinho D. Choi

Question-answering (QA) that comes naturally to humans is a critical component in seamless human-computer interaction. It has emerged as one of the most convenient and natural methods to interact with the web and is especially desirable in…

Computation and Language · Computer Science 2022-11-15 Deepak Gupta

We propose a novel text generation task, namely Curiosity-driven Question Generation. We start from the observation that the Question Generation task has traditionally been considered as the dual problem of Question Answering, hence…

Computation and Language · Computer Science 2019-11-11 Thomas Scialom , Jacopo Staiano

We present PeerQA, a real-world, scientific, document-level Question Answering (QA) dataset. PeerQA questions have been sourced from peer reviews, which contain questions that reviewers raised while thoroughly examining the scientific…

Computation and Language · Computer Science 2025-02-20 Tim Baumgärtner , Ted Briscoe , Iryna Gurevych

Question Answering (QA) is one of the most important natural language processing (NLP) tasks. It aims using NLP technologies to generate a corresponding answer to a given question based on the massive unstructured corpus. With the…

Computation and Language · Computer Science 2022-07-01 Zhen Wang

We present QuAC, a dataset for Question Answering in Context that contains 14K information-seeking QA dialogs (100K questions in total). The dialogs involve two crowd workers: (1) a student who poses a sequence of freeform questions to…

Computation and Language · Computer Science 2018-08-29 Eunsol Choi , He He , Mohit Iyyer , Mark Yatskar , Wen-tau Yih , Yejin Choi , Percy Liang , Luke Zettlemoyer

The usage and amount of information available on the internet increase over the past decade. This digitization leads to the need for automated answering system to extract fruitful information from redundant and transitional knowledge…

Computation and Language · Computer Science 2022-02-03 Hariom A. Pandya , Brijesh S. Bhatt

Users often fail to formulate their complex information needs in a single query. As a consequence, they may need to scan multiple result pages or reformulate their queries, which may be a frustrating experience. Alternatively, systems can…

Computation and Language · Computer Science 2019-07-16 Mohammad Aliannejadi , Hamed Zamani , Fabio Crestani , W. Bruce Croft

Recent pretrained language models "solved" many reading comprehension benchmarks, where questions are written with access to the evidence document. However, datasets containing information-seeking queries where evidence documents are…

Computation and Language · Computer Science 2021-06-08 Akari Asai , Eunsol Choi

Existing question answering (QA) datasets are no longer challenging to most powerful Large Language Models (LLMs). Traditional QA benchmarks like TriviaQA, NaturalQuestions, ELI5 and HotpotQA mainly study ``known unknowns'' with clear…

Computation and Language · Computer Science 2024-02-29 Corby Rosset , Ho-Lam Chung , Guanghui Qin , Ethan C. Chau , Zhuo Feng , Ahmed Awadallah , Jennifer Neville , Nikhil Rao

Disfluencies is an under-studied topic in NLP, even though it is ubiquitous in human conversation. This is largely due to the lack of datasets containing disfluencies. In this paper, we present a new challenge question answering dataset,…

Computation and Language · Computer Science 2021-06-09 Aditya Gupta , Jiacheng Xu , Shyam Upadhyay , Diyi Yang , Manaal Faruqui

Crowd-sourcing is a cheap and popular means of creating training and evaluation datasets for machine learning, however it poses the problem of `truth inference', as individual workers cannot be wholly trusted to provide reliable…

Machine Learning · Computer Science 2019-02-26 Yuan Li , Benjamin I. P. Rubinstein , Trevor Cohn

Recently proposed long-form question answering (QA) systems, supported by large language models (LLMs), have shown promising capabilities. Yet, attributing and verifying their generated abstractive answers can be difficult, and…

Computation and Language · Computer Science 2024-07-02 Tal Schuster , Adam D. Lelkes , Haitian Sun , Jai Gupta , Jonathan Berant , William W. Cohen , Donald Metzler

We present FoQA, a Faroese extractive question-answering (QA) dataset with 2,000 samples, created using a semi-automated approach combining Large Language Models (LLMs) and human validation. The dataset was generated from Faroese Wikipedia…

Computation and Language · Computer Science 2025-02-12 Annika Simonsen , Dan Saattrup Nielsen , Hafsteinn Einarsson

To ensure quality results from crowdsourced tasks, requesters often aggregate worker responses and use one of a plethora of strategies to infer the correct answer from the set of noisy responses. However, all current models assume prior…

Artificial Intelligence · Computer Science 2012-10-19 Christopher H. Lin , Mausam , Daniel Weld

Humans gather information by engaging in conversations involving a series of interconnected questions and answers. For machines to assist in information gathering, it is therefore essential to enable them to answer conversational questions.…

Computation and Language · Computer Science 2019-04-02 Siva Reddy , Danqi Chen , Christopher D. Manning

Without labeled question-answer pairs for necessary training, unsupervised commonsense question-answering (QA) appears to be extremely challenging due to its indispensable unique prerequisite on commonsense source like knowledge bases…

Computation and Language · Computer Science 2022-09-14 Jiawei Wang , Hai Zhao

We introduce Question-Answer Meaning Representations (QAMRs), which represent the predicate-argument structure of a sentence as a set of question-answer pairs. We also develop a crowdsourcing scheme to show that QAMRs can be labeled with…

Computation and Language · Computer Science 2017-11-17 Julian Michael , Gabriel Stanovsky , Luheng He , Ido Dagan , Luke Zettlemoyer

Widespread and rapid dissemination of false news has made fact-checking an indispensable requirement. Given its time-consuming and labor-intensive nature, the task calls for an automated support to meet the demand. In this paper, we propose…

Computation and Language · Computer Science 2021-08-10 Ipek Baris Schlicht , Erhan Sezerer , Selma Tekir , Oul Han , Zeyd Boukhers

We publicly release a new large-scale dataset, called SearchQA, for machine comprehension, or question-answering. Unlike recently released datasets, such as DeepMind CNN/DailyMail and SQuAD, the proposed SearchQA was constructed to reflect…

Computation and Language · Computer Science 2017-06-13 Matthew Dunn , Levent Sagun , Mike Higgins , V. Ugur Guney , Volkan Cirik , Kyunghyun Cho