English
Related papers

Related papers: Iterative Distillation for Better Uncertainty Esti…

200 papers

Knowledge distillation has emerged as a powerful technique for model compression, enabling the transfer of knowledge from large teacher networks to compact student models. However, traditional knowledge distillation methods treat all…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Aakash Gore , Anoushka Dey , Aryan Mishra

Deep ensembles (DE) have emerged as a powerful approach for quantifying predictive uncertainty and distinguishing its aleatoric and epistemic components, thereby enhancing model robustness and reliability. However, their high computational…

Machine Learning · Computer Science 2025-11-19 Kaizheng Wang , Fabio Cuzzolin , David Moens , Hans Hallez

Decoding emotional states from human brain activity plays an important role in brain-computer interfaces. Existing emotion decoding methods still have two main limitations: one is only decoding a single emotion category from a brain…

Signal Processing · Electrical Eng. & Systems 2022-11-07 Kaicheng Fu , Changde Du , Shengpei Wang , Huiguang He

Human multimodal emotion recognition (MER) aims to perceive human emotions via language, visual and acoustic modalities. Despite the impressive performance of previous MER approaches, the inherent multimodal heterogeneities still haunt and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yong Li , Yuanzhi Wang , Zhen Cui

Despite the remarkable progress in generative modelling, current diffusion models lack a quantitative approach to assess image quality. To address this limitation, we propose to estimate the pixel-wise aleatoric uncertainty during the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Michele De Vita , Vasileios Belagiannis

Knowledge distillation transfers behavior from a teacher to a student model, but the process is inherently stochastic: teacher outputs, student training, and student inference can all be random. Collapsing these uncertainties to a single…

Machine Learning · Computer Science 2026-01-28 Ziyao Cui , Jian Pei

Deep ensembles excel in large-scale image classification tasks both in terms of prediction accuracy and calibration. Despite being simple to train, the computation and memory cost of deep ensembles limits their practicability. While some…

Machine Learning · Computer Science 2021-10-28 Giung Nam , Jongmin Yoon , Yoonho Lee , Juho Lee

In this work, we introduce our submission to the 2nd Affective Behavior Analysis in-the-wild (ABAW) 2021 competition. We train a unified deep learning model on multi-databases to perform two tasks: seven basic facial expressions prediction…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Manh Tu Vu , Marie Beurton-Aimar

Technological and computational advances continuously drive forward the broad field of deep learning. In recent years, the derivation of quantities describing theuncertainty in the prediction - which naturally accompanies the modeling…

Machine Learning · Computer Science 2022-05-31 Christoph Koller , Göran Kauermann , Xiao Xiang Zhu

As large language models (LLMs) are increasingly used for factual question-answering, it becomes more important for LLMs to have the capability to communicate the likelihood that their answer is correct. For these verbalized expressions of…

Computation and Language · Computer Science 2025-12-15 Sophia Hager , David Mueller , Kevin Duh , Nicholas Andrews

This paper explores targeted distillation methods for sentiment analysis, aiming to build compact and practical models that preserve strong and generalizable sentiment analysis capabilities. To this end, we conceptually decouple the…

Computation and Language · Computer Science 2025-11-04 Yice Zhang , Guangyu Xie , Jingjie Lin , Jianzhu Bao , Qianlong Wang , Xi Zeng , Ruifeng Xu

In emotion recognition, it is difficult to recognize human's emotional states using just a single modality. Besides, the annotation of physiological emotional data is particularly expensive. These two aspects make the building of effective…

Artificial Intelligence · Computer Science 2017-04-26 Changde Du , Changying Du , Jinpeng Li , Wei-long Zheng , Bao-liang Lu , Huiguang He

The widespread adoption of automatic sentiment and emotion classifiers makes it important to ensure that these tools perform reliably across different populations. Yet their reliability is typically assessed using benchmarks that rely on…

Computation and Language · Computer Science 2026-01-09 Ivan Smirnov , Segun T. Aroyehun , Paul Plener , David Garcia

Automatic emotion recognition is an active research topic with wide range of applications. Due to the high manual annotation cost and inevitable label ambiguity, the development of emotion recognition dataset is limited in both scale and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-08 Jingjun Liang , Ruichen Li , Qin Jin

Ensembles of neural networks have been shown to give better performance than single networks, both in terms of predictions and uncertainty estimation. Additionally, ensembles allow the uncertainty to be decomposed into aleatoric (data) and…

Machine Learning · Statistics 2021-01-11 Jakob Lindqvist , Amanda Olmin , Fredrik Lindsten , Lennart Svensson

Many research explore how well computers are able to examine emotions displayed by humans and use that data to perform different tasks. However, there have been very few research which evaluate the computers ability to generate emotion…

Artificial Intelligence · Computer Science 2023-09-06 Balaram Panda

Uncertainty quantification for deep learning is a challenging open problem. Bayesian statistics offer a mathematically grounded framework to reason about uncertainties; however, approximate posteriors for modern neural networks still…

Machine Learning · Statistics 2020-01-23 Nicolas Brosse , Carlos Riquelme , Alice Martin , Sylvain Gelly , Éric Moulines

Emotion recognition is inherently ambiguous, with uncertainty arising both from rater disagreement and from discrepancies across modalities such as speech and text. There is growing interest in modeling rater ambiguity using label…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-27 Jingyao Wu , Grace Lin , Yinuo Song , Rosalind Picard

Emotion recognition in multi-speaker conversations faces significant challenges due to speaker ambiguity and severe class imbalance. We propose a novel framework that addresses these issues through three key innovations: (1) a speaker…

Sound · Computer Science 2025-11-19 Xiao Li , Kotaro Funakoshi , Manabu Okumura

In this paper, we present empirical analysis on basic and depression specific multi-emotion mining in Tweets with the help of state of the art multi-label classifiers. We choose our basic emotions from a hybrid emotion model consisting of…

Machine Learning · Computer Science 2021-06-22 Nawshad Farruque , Chenyang Huang , Osmar Zaiane , Randy Goebel