English
Related papers

Related papers: Determining Question-Answer Plausibility in Crowds…

200 papers

Question Answering (QA) datasets are crucial in assessing reading comprehension skills for both machines and humans. While numerous datasets have been developed in English for this purpose, a noticeable void exists in less-resourced…

Computation and Language · Computer Science 2025-06-10 Bernardo Leite , Tomás Freitas Osório , Henrique Lopes Cardoso

Despite their importance in training artificial intelligence systems, large datasets remain challenging to acquire. For example, the ImageNet dataset required fourteen million labels of basic human knowledge, such as whether an image…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Jihyeon Lee , Sho Arora

Existing works for truth discovery in categorical data usually assume that claimed values are mutually exclusive and only one among them is correct. However, many claimed values are not mutually exclusive even for functional predicates due…

Databases · Computer Science 2019-04-24 Woohwan Jung , Younghoon Kim , Kyuseok Shim

Formulating selective information needs results in queries that implicitly specify set operations, such as intersection, union, and difference. For instance, one might search for "shorebirds that are not sandpipers" or "science-fiction…

Computation and Language · Computer Science 2023-06-01 Chaitanya Malaviya , Peter Shaw , Ming-Wei Chang , Kenton Lee , Kristina Toutanova

We present the Stanford Question Answering Dataset (SQuAD), a new reading comprehension dataset consisting of 100,000+ questions posed by crowdworkers on a set of Wikipedia articles, where the answer to each question is a segment of text…

Computation and Language · Computer Science 2016-10-12 Pranav Rajpurkar , Jian Zhang , Konstantin Lopyrev , Percy Liang

Recently, a simple combination of passage retrieval using off-the-shelf IR techniques and a BERT reader was found to be very effective for question answering directly on Wikipedia, yielding a large improvement over the previous state of the…

Computation and Language · Computer Science 2019-04-16 Wei Yang , Yuqing Xie , Luchen Tan , Kun Xiong , Ming Li , Jimmy Lin

While there has been substantial progress in developing systems to automate fact-checking, they still lack credibility in the eyes of the users. Thus, an interesting approach has emerged: to perform automatic fact-checking by verifying…

Computation and Language · Computer Science 2022-10-11 Momchil Hardalov , Anton Chernyavskiy , Ivan Koychev , Dmitry Ilvovsky , Preslav Nakov

Estimating question difficulty is a critical component in evaluating and improving large language models (LLMs) for question answering (QA). Existing approaches often rely on readability formulas, retrieval-based signals, or popularity…

Computation and Language · Computer Science 2026-05-13 Jamshid Mozafari , Bhawna Piryani , Adam Jatowt

Discourse relations describe how two propositions relate to one another, and identifying them automatically is an integral part of natural language understanding. However, annotating discourse relations typically requires expert annotators.…

Computation and Language · Computer Science 2020-10-07 Valentina Pyatkin , Ayal Klein , Reut Tsarfaty , Ido Dagan

The exponential growth of AI in science necessitates efficient and scalable solutions for retrieving and preserving research information. Here, we present a tool for the development of a customized question-answer (QA) dataset, called…

Information Retrieval · Computer Science 2025-02-25 Qiming Liu , Zhongzheng Niu , Siting Liu , Mao Tian

We introduce the task of acoustic question answering (AQA) in the area of acoustic reasoning. In this task an agent learns to answer questions on the basis of acoustic context. In order to promote research in this area, we propose a data…

Computation and Language · Computer Science 2018-11-27 Jerome Abdelnour , Giampiero Salvi , Jean Rouat

Due to the concise and structured nature of tables, the knowledge contained therein may be incomplete or missing, posing a significant challenge for table question answering (TableQA) and data analysis systems. Most existing datasets either…

Computation and Language · Computer Science 2024-05-15 Mengkang Hu , Haoyu Dong , Ping Luo , Shi Han , Dongmei Zhang

This paper introduces QAConv, a new question answering (QA) dataset that uses conversations as a knowledge source. We focus on informative conversations, including business emails, panel discussions, and work channels. Unlike open-domain…

Computation and Language · Computer Science 2022-04-18 Chien-Sheng Wu , Andrea Madotto , Wenhao Liu , Pascale Fung , Caiming Xiong

Generative AI models face the challenge of hallucinations that can undermine users' trust in such systems. We approach the problem of conversational information seeking as a two-step process, where relevant passages in a corpus are…

Information Retrieval · Computer Science 2024-01-23 Weronika Łajewska , Krisztian Balog

Users frequently ask simple factoid questions for question answering (QA) systems, attenuating the impact of myriad recent works that support more complex questions. Prompting users with automatically generated suggested questions (SQs) can…

Computation and Language · Computer Science 2021-08-06 Xusen Yin , Li Zhou , Kevin Small , Jonathan May

Event forecasting is a challenging, yet important task, as humans seek to constantly plan for the future. Existing automated forecasting studies rely mostly on structured data, such as time-series or event-based knowledge graphs, to help…

Machine Learning · Computer Science 2021-06-09 Woojeong Jin , Rahul Khanna , Suji Kim , Dong-Ho Lee , Fred Morstatter , Aram Galstyan , Xiang Ren

Question Answering (QA) systems require a large amount of annotated data which is costly and time-consuming to gather. Converting datasets of existing QA benchmarks are challenging due to different formats and complexities. To address these…

Computation and Language · Computer Science 2022-10-14 Saptarashmi Bandyopadhyay , Shraman Pal , Hao Zou , Abhranil Chandra , Jordan Boyd-Graber

Open domain conversational agents can answer a broad range of targeted queries. However, the sequential nature of interaction with these systems makes knowledge exploration a lengthy task which burdens the user with asking a chain of well…

Computation and Language · Computer Science 2023-02-23 Christopher Richardson , Sudipta Kar , Anjishnu Kumar , Anand Ramachandran , Omar Zia Khan , Zeynab Raeesy , Abhinav Sethy

Even for domain experts, it is a non-trivial task to verify a scientific claim by providing supporting or refuting evidence rationales. The situation worsens as misinformation is proliferated on social media or news websites, manually or…

Computation and Language · Computer Science 2025-05-19 Xiangci Li , Gully Burns , Nanyun Peng

Readers of academic research papers often read with the goal of answering specific questions. Question Answering systems that can answer those questions can make consumption of the content much more efficient. However, building such tools…

Computation and Language · Computer Science 2021-05-10 Pradeep Dasigi , Kyle Lo , Iz Beltagy , Arman Cohan , Noah A. Smith , Matt Gardner