English
Related papers

Related papers: Commonsense knowledge adversarial dataset that cha…

200 papers

Commonsense reasoning is a difficult task for a computer, but a critical skill for an artificial intelligence (AI). It can enhance the explainability of AI models by enabling them to provide intuitive and human-like explanations for their…

Artificial Intelligence · Computer Science 2024-07-08 Stefanie Krause , Frieder Stolzenburg

Commonsense reasoning aims to empower machines with the human ability to make presumptions about ordinary situations in our daily life. In this paper, we propose a textual inference framework for answering commonsense questions, which…

Computation and Language · Computer Science 2019-09-06 Bill Yuchen Lin , Xinyue Chen , Jamin Chen , Xiang Ren

Extractive reading comprehension systems can often locate the correct answer to a question in a context document, but they also tend to make unreliable guesses on questions for which the correct answer is not stated in the context. Existing…

Computation and Language · Computer Science 2018-06-12 Pranav Rajpurkar , Robin Jia , Percy Liang

Reading comprehension has been widely studied. One of the most representative reading comprehension tasks is Stanford Question Answering Dataset (SQuAD), on which machine is already comparable with human. On the other hand, accessing large…

Computation and Language · Computer Science 2018-04-03 Chia-Hsuan Li , Szu-Lin Wu , Chi-Liang Liu , Hung-yi Lee

Pretrained language models have excelled at many NLP tasks recently; however, their social intelligence is still unsatisfactory. To enable this, machines need to have a more general understanding of our complicated world and develop the…

Computation and Language · Computer Science 2021-05-13 Ting-Yun Chang , Yang Liu , Karthik Gopalakrishnan , Behnam Hedayatnia , Pei Zhou , Dilek Hakkani-Tur

Question answering (QA) systems achieve impressive performance on standard benchmarks like SQuAD, but remain vulnerable to adversarial examples. This project investigates the adversarial robustness of transformer models on the AddSent…

Computation and Language · Computer Science 2026-01-07 Agniv Roy Choudhury , Vignesh Ponselvan Rajasingh

Recently, pretrained language models (e.g., BERT) have achieved great success on many downstream natural language understanding tasks and exhibit a certain level of commonsense reasoning ability. However, their performance on commonsense…

Artificial Intelligence · Computer Science 2023-02-17 Shiyang Li , Jianshu Chen , Dian Yu

Commonsense reasoning is a long-standing challenge for deep learning. For example, it is difficult to use neural networks to tackle the Winograd Schema dataset (Levesque et al., 2011). In this paper, we present a simple method for…

Artificial Intelligence · Computer Science 2019-09-30 Trieu H. Trinh , Quoc V. Le

Smooth and effective communication requires the ability to perform latent or explicit commonsense inference. Prior commonsense reasoning benchmarks (such as SocialIQA and CommonsenseQA) mainly focus on the discriminative task of choosing…

Computation and Language · Computer Science 2021-09-23 Pei Zhou , Karthik Gopalakrishnan , Behnam Hedayatnia , Seokhwan Kim , Jay Pujara , Xiang Ren , Yang Liu , Dilek Hakkani-Tur

Without labeled question-answer pairs for necessary training, unsupervised commonsense question-answering (QA) appears to be extremely challenging due to its indispensable unique prerequisite on commonsense source like knowledge bases…

Computation and Language · Computer Science 2022-09-14 Jiawei Wang , Hai Zhao

We present a large-scale dataset, ReCoRD, for machine reading comprehension requiring commonsense reasoning. Experiments on this dataset demonstrate that the performance of state-of-the-art MRC systems fall far behind human performance.…

Computation and Language · Computer Science 2018-10-31 Sheng Zhang , Xiaodong Liu , Jingjing Liu , Jianfeng Gao , Kevin Duh , Benjamin Van Durme

The recently introduced BERT model exhibits strong performance on several language understanding benchmarks. In this paper, we describe a simple re-implementation of BERT for commonsense reasoning. We show that the attentions produced by…

Computation and Language · Computer Science 2019-06-03 Tassilo Klein , Moin Nabi

In this paper, we aim to extract commonsense knowledge to improve machine reading comprehension. We propose to represent relations implicitly by situating structured knowledge in a context instead of relying on a pre-defined set of…

Computation and Language · Computer Science 2020-10-20 Kai Sun , Dian Yu , Jianshu Chen , Dong Yu , Claire Cardie

Progress in text understanding has been driven by large datasets that test particular capabilities, like recent datasets for reading comprehension (Hermann et al., 2015). We focus here on the LAMBADA dataset (Paperno et al., 2016), a word…

Computation and Language · Computer Science 2017-02-20 Zewei Chu , Hai Wang , Kevin Gimpel , David McAllester

Knowledge Editing (KE) aims to adjust a Large Language Model's (LLM) internal representations and parameters to correct inaccuracies and improve output consistency without incurring the computational expense of re-training the entire model.…

Computation and Language · Computer Science 2025-05-29 Liyu Zhang , Weiqi Wang , Tianqing Fang , Yangqiu Song

Recently several datasets have been proposed to encourage research in Question Answering domains where commonsense knowledge is expected to play an important role. Recent language models such as ROBERTA, BERT and GPT that have been…

Computation and Language · Computer Science 2020-04-20 Arindam Mitra , Pratyay Banerjee , Kuntal Kumar Pal , Swaroop Mishra , Chitta Baral

The rise of Large Language Models (LLMs) has redefined the AI landscape, particularly due to their ability to encode factual and commonsense knowledge, and their outstanding performance in tasks requiring reasoning. Despite these advances,…

Computation and Language · Computer Science 2025-04-22 Armin Toroghi , Willis Guo , Scott Sanner

Commonsense reasoning deals with the implicit knowledge that is well understood by humans and typically acquired via interactions with the world. In recent times, commonsense reasoning and understanding of various LLMs have been evaluated…

Computation and Language · Computer Science 2025-04-15 Abhinav Joshi , Areeb Ahmad , Divyaksh Shukla , Ashutosh Modi

Embedding commonsense knowledge is crucial for end-to-end models to generalize inference beyond training corpora. However, existing word analogy datasets have tended to be handcrafted, involving permutations of hundreds of words with only…

Computation and Language · Computer Science 2020-06-01 Peng-Hsuan Li , Tsan-Yu Yang , Wei-Yun Ma

Commonsense knowledge, a major constituent of artificial intelligence (AI), is primarily evaluated in practice by human-prescribed ground-truth labels. An important, albeit implicit, assumption of these labels is that they accurately…

Artificial Intelligence · Computer Science 2026-01-23 Tuan Dung Nguyen , Duncan J. Watts , Mark E. Whiting