English
Related papers

Related papers: Every Answer Matters: Evaluating Commonsense with …

200 papers

Language enables humans to share knowledge, reason about the world, and pass on strategies for survival and innovation across generations. At the heart of this process is not just the ability to communicate but also the remarkable…

Computation and Language · Computer Science 2026-02-25 Jan Philip Wahle

Visual understanding goes well beyond object recognition. With one glance at an image, we can effortlessly imagine the world beyond the pixels: for instance, we can infer people's actions, goals, and mental states. While this task is easy…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Rowan Zellers , Yonatan Bisk , Ali Farhadi , Yejin Choi

Causal inference (CI) in observational studies has received a lot of attention in healthcare, education, ad attribution, policy evaluation, etc. Confounding is a typical hazard, where the context affects both, the treatment assignment and…

Methodology · Statistics 2021-08-17 Ankit Sharma , Garima Gupta , Ranjitha Prasad , Arnab Chatterjee , Lovekesh Vig , Gautam Shroff

Experiments in research on memory, language, and in other areas of cognitive science are increasingly being analyzed using Bayesian methods. This has been facilitated by the development of probabilistic programming languages such as Stan,…

Methodology · Statistics 2020-03-02 Daniel J. Schad , Michael Betancourt , Shravan Vasishth

Large language models (LLMs) achieve strong average performance yet remain unreliable at the instance level, with frequent hallucinations, brittle failures, and poorly calibrated confidence. We study reliability through the lens of…

Artificial Intelligence · Computer Science 2026-01-13 Pranav Kallem

Contextualized or discourse aware commonsense inference is the task of generating coherent commonsense assertions (i.e., facts) from a given story, and a particular sentence from that story. Some problems with the task are: lack of…

Computation and Language · Computer Science 2023-02-13 Pedro Colon-Hernandez , Henry Lieberman , Yida Xin , Claire Yin , Cynthia Breazeal , Peter Chin

Machine learning algorithms in socially sensitive domains (e.g., credit decisions) often focus on equalizing predictive outcomes. However, satisfying these metrics does not guarantee that models use the same reasoning for different groups.…

Machine Learning · Computer Science 2026-05-14 Gideon Popoola , John Sheppard

Inspired by e-participation systems, in this paper we propose a new model to represent human debates and methods to obtain collective conclusions from them. This model overcomes drawbacks of existing approaches by allowing users to…

Artificial Intelligence · Computer Science 2020-07-15 Jordi Ganzer , Natalia Criado , Maite Lopez-Sanchez , Simon Parsons , Juan A. Rodriguez-Aguilar

Given a partial description like "she opened the hood of the car," humans can reason about the situation and anticipate what might come next ("then, she examined the engine"). In this paper, we introduce the task of grounded commonsense…

Computation and Language · Computer Science 2018-08-17 Rowan Zellers , Yonatan Bisk , Roy Schwartz , Yejin Choi

Deep learning models perform poorly on tasks that require commonsense reasoning, which often necessitates some form of world-knowledge or reasoning over information not immediately present in the input. We collect human explanations for…

Computation and Language · Computer Science 2019-06-07 Nazneen Fatema Rajani , Bryan McCann , Caiming Xiong , Richard Socher

Collaborative filtering is an important technique for recommendation. Whereas it has been repeatedly shown to be effective in previous work, its performance remains unsatisfactory in many real-world applications, especially those where the…

Information Retrieval · Computer Science 2018-08-15 Zhiyu Min , Dahua Lin

Existing commonsense reasoning datasets for AI and NLP tasks fail to address an important aspect of human life: cultural differences. We introduce an approach that extends prior work on crowdsourcing commonsense knowledge by incorporating…

Artificial Intelligence · Computer Science 2020-12-22 Anurag Acharya , Kartik Talamadupula , Mark A Finlayson

This study proposes the Cognitive Pairwise Comparison Classification Model Selection (CPC-CMS) framework for document-level sentiment analysis. The CPC, based on expert knowledge judgment, is used to calculate the weights of evaluation…

Computation and Language · Computer Science 2025-07-21 Jianfei Li , Kevin Kam Fung Yuen

Commonsense reasoning is one of the key problems in natural language processing, but the relative scarcity of labeled data holds back the progress for languages other than English. Pretrained cross-lingual models are a source of powerful…

Computation and Language · Computer Science 2021-12-02 Alexey Tikhonov , Max Ryabinin

A common retrieve-and-rerank paradigm involves retrieving relevant candidates from a broad set using a fast bi-encoder (BE), followed by applying expensive but accurate cross-encoders (CE) to a limited candidate set. However, relying on…

Computation and Language · Computer Science 2024-10-28 Jonghyun Song , Cheyon Jin , Wenlong Zhao , Andrew McCallum , Jay-Yoon Lee

Open-domain dialogue systems need to grasp social commonsense to understand and respond effectively to human users. Commonsense-augmented dialogue models have been proposed that aim to infer commonsense knowledge from dialogue contexts in…

Computation and Language · Computer Science 2025-01-22 Sarah E. Finch , Jinho D. Choi

Commonsense fact verification, as a challenging branch of commonsense question-answering (QA), aims to verify through facts whether a given commonsense claim is correct or not. Answering commonsense questions necessitates a combination of…

Computation and Language · Computer Science 2023-05-30 Anni Zou , Zhuosheng Zhang , Hai Zhao

Recent approaches to empathetic response generation try to incorporate commonsense knowledge or reasoning about the causes of emotions to better understand the user's experiences and feelings. However, these approaches mainly focus on…

Computation and Language · Computer Science 2023-09-06 Yahui Fu , Koji Inoue , Chenhui Chu , Tatsuya Kawahara

Independent from the still ongoing research in measuring individual intelligence, we anticipate and provide a framework for measuring collective intelligence. Collective intelligence refers to the idea that several individuals can…

Artificial Intelligence · Computer Science 2013-07-01 Michel Halmes

Unsupervised commonsense question answering requires mining effective commonsense knowledge without the rely on the labeled task data. Previous methods typically retrieved from traditional knowledge bases or used pre-trained language models…

Computation and Language · Computer Science 2022-11-28 Yueqing Sun , Yu Zhang , Le Qi , Qi Shi