English
Related papers

Related papers: ProtoQA: A Question Answering Dataset for Prototyp…

200 papers

While diverse question answering (QA) datasets have been proposed and contributed significantly to the development of deep learning models for QA tasks, the existing datasets fall short in two aspects. First, we lack QA datasets covering…

Computation and Language · Computer Science 2021-10-15 Qiyuan Zhang , Lei Wang , Sicheng Yu , Shuohang Wang , Yang Wang , Jing Jiang , Ee-Peng Lim

The recent work of Clark et al. introduces the AI2 Reasoning Challenge (ARC) and the associated ARC dataset that partitions open domain, complex science questions into an Easy Set and a Challenge Set. That paper includes an analysis of 100…

The problem of replicating the flexibility of human common-sense reasoning has captured the imagination of computer scientists since the early days of Alan Turing's foundational work on computation and the philosophy of artificial…

Artificial Intelligence · Computer Science 2015-11-24 Cameron E. Freer , Daniel M. Roy , Joshua B. Tenenbaum

Asking effective questions is a powerful social skill. In this paper we seek to build computational models that learn to discriminate effective questions from ineffective ones. Armed with such a capability, future advanced systems can…

Computation and Language · Computer Science 2018-05-29 Kristjan Arumae , Guo-Jun Qi , Fei Liu

Commonsense reasoning, aiming at endowing machines with a human-like ability to make situational presumptions, is extremely challenging to generalize. For someone who barely knows about "meditation," while is knowledgeable about "singing,"…

Computation and Language · Computer Science 2023-05-11 Weiqi Wang , Tianqing Fang , Baixuan Xu , Chun Yi Louis Bo , Yangqiu Song , Lei Chen

Question answering (QA) is a fundamental means to facilitate assessment and training of narrative comprehension skills for both machines and young children, yet there is scarcity of high-quality QA datasets carefully designed to serve this…

Why do thinking language models like DeepSeek R1 outperform their base counterparts? Despite consistent performance gains, it remains unclear to what extent thinking models learn entirely new reasoning capabilities or repurpose pre-existing…

Artificial Intelligence · Computer Science 2025-10-23 Constantin Venhoff , Iván Arcuschin , Philip Torr , Arthur Conmy , Neel Nanda

Question Answering (QA) datasets are crucial in assessing reading comprehension skills for both machines and humans. While numerous datasets have been developed in English for this purpose, a noticeable void exists in less-resourced…

Computation and Language · Computer Science 2025-06-10 Bernardo Leite , Tomás Freitas Osório , Henrique Lopes Cardoso

Every day, thousands of customers post questions on Amazon product pages. After some time, if they are fortunate, a knowledgeable customer might answer their question. Observing that many questions can be answered based upon the available…

Computation and Language · Computer Science 2019-08-22 Mansi Gupta , Nitish Kulkarni , Raghuveer Chanda , Anirudha Rayasam , Zachary C Lipton

Generative AI models face the challenge of hallucinations that can undermine users' trust in such systems. We approach the problem of conversational information seeking as a two-step process, where relevant passages in a corpus are…

Information Retrieval · Computer Science 2024-01-23 Weronika Łajewska , Krisztian Balog

We present HEAD-QA, a multi-choice question answering testbed to encourage research on complex reasoning. The questions come from exams to access a specialized position in the Spanish healthcare system, and are challenging even for highly…

Computation and Language · Computer Science 2019-06-12 David Vilares , Carlos Gómez-Rodríguez

Question Answering (QA) is one of the most important natural language processing (NLP) tasks. It aims using NLP technologies to generate a corresponding answer to a given question based on the massive unstructured corpus. With the…

Computation and Language · Computer Science 2022-07-01 Zhen Wang

Reminder systems commonly rely on fixed schedules, location triggers, or simple rules, limiting their ability to leverage the rich sensing capabilities of modern smart homes. A key challenge lies in enabling users to specify context-aware…

Human-Computer Interaction · Computer Science 2026-05-25 Reina Szeyi Chan , Sujendra Jayant Gharat , Maya Lampi , Yueran Jia , Avi K Srinivasan , Xiang Zhi Tan

We present a system for answering questions based on the full text of books (BookQA), which first selects book passages given a question at hand, and then uses a memory network to reason and predict an answer. To improve generalization, we…

Computation and Language · Computer Science 2019-10-03 Stefanos Angelidis , Lea Frermann , Diego Marcheggiani , Roi Blanco , Lluís Màrquez

Recently several datasets have been proposed to encourage research in Question Answering domains where commonsense knowledge is expected to play an important role. Recent language models such as ROBERTA, BERT and GPT that have been…

Computation and Language · Computer Science 2020-04-20 Arindam Mitra , Pratyay Banerjee , Kuntal Kumar Pal , Swaroop Mishra , Chitta Baral

Humans have the capacity to draw common-sense inferences from natural language: various things that are likely but not certain to hold based on established discourse, and are rarely stated explicitly. We propose an evaluation of automated…

Computation and Language · Computer Science 2017-06-05 Sheng Zhang , Rachel Rudinger , Kevin Duh , Benjamin Van Durme

We propose cognitive prompting as a novel approach to guide problem-solving in large language models (LLMs) through structured, human-like cognitive operations, such as goal clarification, decomposition, filtering, abstraction, and pattern…

Computation and Language · Computer Science 2024-12-03 Oliver Kramer , Jill Baumann

Large pre-trained language models (LMs) have been shown to perform surprisingly well when fine-tuned on tasks that require commonsense and world knowledge. However, in end-to-end architectures, it is difficult to explain what is the…

Computation and Language · Computer Science 2020-04-14 Veronica Latcinnik , Jonathan Berant

We present ATOMIC, an atlas of everyday commonsense reasoning, organized through 877k textual descriptions of inferential knowledge. Compared to existing resources that center around taxonomic knowledge, ATOMIC focuses on inferential…

Computation and Language · Computer Science 2019-02-11 Maarten Sap , Ronan LeBras , Emily Allaway , Chandra Bhagavatula , Nicholas Lourie , Hannah Rashkin , Brendan Roof , Noah A. Smith , Yejin Choi

Stories generated with neural language models have shown promise in grammatical and stylistic consistency. However, the generated stories are still lacking in common sense reasoning, e.g., they often contain sentences deprived of world…

Machine Learning · Computer Science 2020-03-02 Huanru Henry Mao , Bodhisattwa Prasad Majumder , Julian McAuley , Garrison W. Cottrell