English
Related papers

Related papers: An Uncertainty-aware Loss Function for Training Ne…

200 papers

This paper introduces Fast Calibrated Explanations, a method designed for generating rapid, uncertainty-aware explanations for machine learning models. By incorporating perturbation techniques from ConformaSight - a global explanation…

Machine Learning · Computer Science 2024-10-29 Tuwe Löfström , Fatima Rabia Yapicioglu , Alessandra Stramiglio , Helena Löfström , Fabio Vitali

Deep Learning-based image super-resolution (SR) has been gaining traction with the aid of Generative Adversarial Networks. Models like SRGAN and ESRGAN are constantly ranked between the best image SR tools. However, they lack principled…

Image and Video Processing · Electrical Eng. & Systems 2024-12-23 Maniraj Sai Adapa , Marco Zullich , Matias Valdenegro-Toro

Calibration is crucial in deep learning applications, especially in fields like healthcare and autonomous driving, where accurate confidence estimates are vital for decision-making. However, deep neural networks often suffer from…

Machine Learning · Computer Science 2024-10-17 Linwei Tao , Haolan Guo , Minjing Dong , Chang Xu

For many applications it is critical to know the uncertainty of a neural network's predictions. While a variety of neural network parameter estimation methods have been proposed for uncertainty estimation, they have not been rigorously…

Machine Learning · Computer Science 2019-12-05 Nabeel Seedat , Christopher Kanan

Medical images are increasingly used as input to deep neural networks to produce quantitative values that aid researchers and clinicians. However, standard deep neural networks do not provide a reliable measure of uncertainty in those…

Image and Video Processing · Electrical Eng. & Systems 2020-02-19 Jacob C. Reinhold , Yufan He , Shizhong Han , Yunqiang Chen , Dashan Gao , Junghoon Lee , Jerry L. Prince , Aaron Carass

High statistical precision is critical for Monte Carlo (MC) samples in high energy physics and is degraded by negatively weighted events. This paper investigates a procedure to learn the relationship between the negative and positive weight…

High Energy Physics - Experiment · Physics 2026-01-15 Christopher Palmer , Braden Kronheim

This paper studies the problem of post-hoc calibration of machine learning classifiers. We introduce the following desiderata for uncertainty calibration: (a) accuracy-preserving, (b) data-efficient, and (c) high expressive power. We show…

Machine Learning · Computer Science 2020-07-01 Jize Zhang , Bhavya Kailkhura , T. Yong-Jin Han

Each year a growing number of wind farms are being added to power grids to generate electricity. The power curve of a wind turbine, which exhibits the relationship between generated power and wind speed, plays a major role in assessing the…

Neural and Evolutionary Computing · Computer Science 2021-06-10 Farzad Karami , Nasser Kehtarnavaz , Mario Rotea

Neural networks are often overconfident about their predictions, which undermines their reliability and trustworthiness. In this work, we present a novel technique, named Error-Driven Uncertainty Aware Training (EUAT), which aims to enhance…

Machine Learning · Computer Science 2024-09-12 Pedro Mendes , Paolo Romano , David Garlan

Deep learning has shown tremendous progress in a wide range of digital pathology and medical image classification tasks. Its integration into safe clinical decision-making support requires robust and reliable models. However, real-world…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Abdur R. Fayjie , Jutika Borah , Florencia Carbone , Jan Tack , Patrick Vandewalle

Recent years have seen a surge of interest in the algorithmic estimation of stochastic entropy production (EP) from trajectory data via machine learning. A crucial element of such algorithms is the identification of a loss function whose…

Statistical Mechanics · Physics 2024-01-22 Euijoon Kwon , Yongjoo Baek

Deep neural networks are increasingly being used for the analysis of medical images. However, most works neglect the uncertainty in the model's prediction. We propose an uncertainty-aware deep kernel learning model which permits the…

Machine Learning · Computer Science 2021-06-11 Zhiliang Wu , Yinchong Yang , Jindong Gu , Volker Tresp

Current deep learning solutions are well known for not informing whether they can reliably classify an example during inference. One of the most effective ways to build more reliable deep learning solutions is to improve their performance…

Machine Learning · Computer Science 2022-08-09 David Macêdo

We present a new loss function that addresses the out-of-distribution (OOD) calibration problem. While many objective functions have been proposed to effectively calibrate models in-distribution, our findings show that they do not always…

Machine Learning · Computer Science 2024-03-12 Dexter Neo , Stefan Winkler , Tsuhan Chen

Accurate quantification of uncertainty is crucial for real-world applications of machine learning. However, modern deep neural networks still produce unreliable predictive uncertainty, often yielding over-confident predictions. In this…

Machine Learning · Computer Science 2020-10-29 Peng Cui , Wenbo Hu , Jun Zhu

Semi-supervised learning has emerged as an appealing strategy to train deep models with limited supervision. Most prior literature under this learning paradigm resorts to dual-based architectures, typically composed of a teacher-student…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Martin Van Waerebeke , Gregory Lodygensky , Jose Dolz

Neural networks predictions are unreliable when the input sample is out of the training distribution or corrupted by noise. Being able to detect such failures automatically is fundamental to integrate deep learning algorithms into robotics.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Antonio Loquercio , Mattia Segù , Davide Scaramuzza

Research on Knowledge Tracing (KT) models traditionally focuses on improving predictive accuracy. However, responsible real-world deployment requires models to know when to defer uncertain predictions to a human teacher. We introduce an…

Machine Learning · Computer Science 2026-05-04 Joshua Mitton , Prarthana Bhattacharyya , Ralph Abboud , Simon Woodhead

There has been a recent emergence of sampling-based techniques for estimating epistemic uncertainty in deep neural networks. While these methods can be applied to classification or semantic segmentation tasks by simply averaging samples,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-08 Dimity Miller , Feras Dayoub , Michael Milford , Niko Sünderhauf

Uncertainty quantification is a central challenge in reliable and trustworthy machine learning. Naive measures such as last-layer scores are well-known to yield overconfident estimates in the context of overparametrized neural networks.…

Machine Learning · Computer Science 2023-05-24 Lucas Clarté , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová