English
Related papers

Related papers: Every Answer Matters: Evaluating Commonsense with …

200 papers

In the deployment of large language models (LLMs), accurate confidence estimation is critical for assessing the credibility of model predictions. However, existing methods often fail to overcome the issue of overconfidence on incorrect…

Computation and Language · Computer Science 2024-02-20 Pei Wang , Yejie Wang , Muxi Diao , Keqing He , Guanting Dong , Weiran Xu

Generative commonsense reasoning requires machines to generate sentences describing an everyday scenario given several concepts, which has attracted much attention recently. However, existing models cannot perform as well as humans, since…

Computation and Language · Computer Science 2021-12-16 Xin Liu , Dayiheng Liu , Baosong Yang , Haibo Zhang , Junwei Ding , Wenqing Yao , Weihua Luo , Haiying Zhang , Jinsong Su

Majority voting is considered an effective method to enhance chain-of-thought reasoning, as it selects the answer with the highest "self-consistency" among different reasoning paths (Wang et al., 2023). However, previous chain-of-thought…

Computation and Language · Computer Science 2025-05-19 Weiqin Wang , Yile Wang , Hui Huang

Machine learning model bias can arise from dataset composition: correlated sensitive features can distort the downstream classification model's decision boundary and lead to performance differences along these features. Existing de-biasing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Miao Zhang , Zee fryer , Ben Colman , Ali Shahriyari , Gaurav Bharaj

As machine learning models evolve, maintaining transparency demands more human-centric explainable AI techniques. Counterfactual explanations, with roots in human reasoning, identify the minimal input changes needed to obtain a given output…

Artificial Intelligence · Computer Science 2025-04-23 Marharyta Domnich , Julius Välja , Rasmus Moorits Veski , Giacomo Magnifico , Kadi Tulver , Eduard Barbu , Raul Vicente

Extracting meaning from uncertain, noisy data is a fundamental problem across time series analysis, pattern recognition, and language modeling. This survey presents a unified mathematical framework that connects classical estimation theory,…

Machine Learning · Computer Science 2025-08-22 Mohammed Elmusrati

Large, transformer-based pretrained language models like BERT, GPT, and T5 have demonstrated a deep understanding of contextual semantics and language syntax. Their success has enabled significant advances in conversational AI, including…

Computation and Language · Computer Science 2023-02-17 Christopher Richardson , Larry Heck

Recently, commonsense reasoning in text generation has attracted much attention. Generative commonsense reasoning is the task that requires machines, given a group of keywords, to compose a single coherent sentence with commonsense…

Computation and Language · Computer Science 2023-10-31 Yunxiang Zhang , Xiaojun Wan

Living organisms survive and multiply even though they have uncertain and incomplete information about their environment and imperfect models to predict the consequences of their actions. Bayesian models have been proposed to face this…

Emerging Technologies · Computer Science 2015-11-13 Jacques Droulez , David Colliaux , Audrey Houillon , Pierre Bessière

We present here an introduction to Brainstorming approach, that was recently proposed as a consensus meta-learning technique, and used in several practical applications in bioinformatics and chemoinformatics. The consensus learning denotes…

Machine Learning · Statistics 2016-09-08 Dariusz Plewczynski

It is very challenging to curate a dataset for language-specific knowledge and common sense in order to evaluate natural language understanding capabilities of language models. Due to the limitation in the availability of annotators, most…

Computation and Language · Computer Science 2024-06-07 Yusuke Sakai , Hidetaka Kamigaito , Taro Watanabe

Concept embeddings offer a practical and efficient mechanism for injecting commonsense knowledge into downstream tasks. Their core purpose is often not to predict the commonsense properties of concepts themselves, but rather to identify…

Artificial Intelligence · Computer Science 2024-06-06 Hanane Kteich , Na Li , Usashi Chatterjee , Zied Bouraoui , Steven Schockaert

Structured knowledge is important for many AI applications. Commonsense knowledge, which is crucial for robust human-centric AI, is covered by a small number of structured knowledge projects. However, they lack knowledge about human traits…

Computation and Language · Computer Science 2023-05-11 Tuan-Phong Nguyen , Simon Razniewski , Aparna Varde , Gerhard Weikum

We propose a probabilistic model to aggregate the answers of respondents answering multiple-choice questions. The model does not assume that everyone has access to the same information, and so does not assume that the consensus answer is…

Machine Learning · Statistics 2017-03-16 John McCoy , Drazen Prelec

In this paper, we propose to leverage the unique characteristics of dialogues sharing commonsense knowledge across participants, to resolve the difficulties in summarizing them. We present SICK, a framework that uses commonsense inferences…

Computation and Language · Computer Science 2022-09-05 Seungone Kim , Se June Joo , Hyungjoo Chae , Chaehyeong Kim , Seung-won Hwang , Jinyoung Yeo

We describe a detailed analysis of a sample of large benchmark of commonsense reasoning problems that has been automatically obtained from WordNet, SUMO and their mapping. The objective is to provide a better assessment of the quality of…

Artificial Intelligence · Computer Science 2019-09-09 Javier Álvez , Itziar Gonzalez-Dios , German Rigau

To be responsive to dynamically changing real-world environments, an intelligent agent needs to perform complex sequential decision-making tasks that are often guided by commonsense knowledge. The previous work on this line of research led…

Artificial Intelligence · Computer Science 2019-08-01 Yi Wang , Shiqi Zhang , Joohyung Lee

Detecting what emotions are expressed in text is a well-studied problem in natural language processing. However, research on finer grained emotion analysis such as what causes an emotion is still in its infancy. We present solutions that…

Computation and Language · Computer Science 2021-06-21 Elsbeth Turcan , Shuai Wang , Rishita Anubhai , Kasturi Bhattacharjee , Yaser Al-Onaizan , Smaranda Muresan

We introduce an ensemble learning post-processing methodology for probabilistic hydrological modelling. This methodology generates numerous point predictions by applying a single hydrological model, yet with different parameter values drawn…

Methodology · Statistics 2020-01-07 Georgia Papacharalampous , Demetris Koutsoyiannis , Alberto Montanari

This review explores recent advances in commonsense reasoning and intent detection, two key challenges in natural language understanding. We analyze 28 papers from ACL, EMNLP, and CHI (2020-2025), organizing them by methodology and…

Computation and Language · Computer Science 2025-06-18 Md Nazmus Sakib