English
Related papers

Related papers: Parameterized Temperature Scaling for Boosting the…

200 papers

Continual Learning (CL) is recently gaining increasing attention for its ability to enable a single model to learn incrementally from a sequence of new classes. In this scenario, it is important to keep consistent predictive performance…

Machine Learning · Computer Science 2025-09-26 Giuseppe Serra , Florian Buettner

In this paper, we present results on improving out-of-domain weather prediction and uncertainty estimation as part of the \texttt{Shifts Challenge on Robustness and Uncertainty under Real-World Distributional Shift} challenge. We find that…

Machine Learning · Computer Science 2024-01-10 Sankalp Gilda , Neel Bhandari , Wendy Mak , Andrea Panizza

Accurate uncertainty quantification in graph neural networks (GNNs) is essential, especially in high-stakes domains where GNNs are frequently employed. Conformal prediction (CP) offers a promising framework for quantifying uncertainty by…

Machine Learning · Computer Science 2023-12-06 Seohyeon Cha , Honggu Kang , Joonhyuk Kang

The calibration for deep neural networks is currently receiving widespread attention and research. Miscalibration usually leads to overconfidence of the model. While, under the condition of long-tailed distribution of data, the problem of…

Machine Learning · Computer Science 2023-08-17 Jialin Guo , Zhenyu Wu , Zhiqiang Zhan , Yang Ji

Seasonal forecasting is a crucial task when it comes to detecting the extreme heat and colds that occur due to climate change. Confidence in the predictions should be reliable since a small increase in the temperatures in a year has a big…

Machine Learning · Computer Science 2024-04-05 Busra Asan , Abdullah Akgül , Alper Unal , Melih Kandemir , Gozde Unal

Uncertainty quantification is a central challenge in reliable and trustworthy machine learning. Naive measures such as last-layer scores are well-known to yield overconfident estimates in the context of overparametrized neural networks.…

Machine Learning · Computer Science 2023-05-24 Lucas Clarté , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

Since state-of-the-art uncertainty estimation methods are often computationally demanding, we investigate whether incorporating prior information can improve uncertainty estimates in conventional deep neural networks. Our focus is on…

Machine Learning · Computer Science 2025-03-21 Fabian Denoodt , José Oramas

Calibration error is commonly adopted for evaluating the quality of uncertainty estimators in deep neural networks. In this paper, we argue that such a metric is highly beneficial for training predictive models, even when we do not…

Machine Learning · Statistics 2019-11-01 Jayaraman J. Thiagarajan , Bindya Venkatesh , Deepta Rajan

Calibration ensures that predicted uncertainties align with observed uncertainties. While there is an extensive literature on recalibration methods for univariate probabilistic forecasts, work on calibration for multivariate forecasts is…

Methodology · Statistics 2026-04-02 Lucas Kock , G. S. Rodrigues , Scott A. Sisson , Nadja Klein , David J. Nott

This paper investigates the post-hoc calibration of confidence for "exploratory" machine learning classification problems. The difficulty in these problems stems from the continuing desire to push the boundaries of which categories have…

Stochastic parametrisations are used in weather and climate models to improve the representation of unpredictable unresolved processes. When compared to a deterministic model, a stochastic model represents `model uncertainty', i.e., sources…

Atmospheric and Oceanic Physics · Physics 2020-04-22 Hannah M. Christensen

Multi-class classification methods that produce sets of probabilistic classifiers, such as ensemble learning methods, are able to model aleatoric and epistemic uncertainty. Aleatoric uncertainty is then typically quantified via the Bayes…

Machine Learning · Statistics 2023-04-20 Thomas Mortier , Viktor Bengs , Eyke Hüllermeier , Stijn Luca , Willem Waegeman

Gaussian processes are notorious for scaling cubically with the size of the training set, preventing application to very large regression problems. Computation-aware Gaussian processes (CAGPs) tackle this scaling issue by exploiting…

Machine Learning · Statistics 2025-03-24 Disha Hegde , Mohamed Adil , Jon Cockayne

Estimating how well a machine learning model performs during inference is critical in a variety of scenarios (for example, to quantify uncertainty, or to choose from a library of available models). However, the standard accuracy estimate of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Xuechen Zhang , Samet Oymak , Jiasi Chen

We propose a neural network approach to produce probabilistic weather forecasts from a deterministic numerical weather prediction. Our approach is applied to operational surface temperature outputs from the Global Deterministic Prediction…

Atmospheric and Oceanic Physics · Physics 2025-04-07 David Landry , Anastase Charantonis , Claire Monteleoni

For many applications it is critical to know the uncertainty of a neural network's predictions. While a variety of neural network parameter estimation methods have been proposed for uncertainty estimation, they have not been rigorously…

Machine Learning · Computer Science 2019-12-05 Nabeel Seedat , Christopher Kanan

It is often observed that the probabilistic predictions given by a machine learning model can disagree with averaged actual outcomes on specific subsets of data, which is also known as the issue of miscalibration. It is responsible for the…

Machine Learning · Computer Science 2020-01-28 Feiyang Pan , Xiang Ao , Pingzhong Tang , Min Lu , Dapeng Liu , Lei Xiao , Qing He

We are concerned with obtaining well-calibrated output distributions from regression models. Such distributions allow us to quantify the uncertainty that the model has regarding the predicted target value. We introduce the novel concept of…

Machine Learning · Statistics 2019-05-16 Hao Song , Tom Diethe , Meelis Kull , Peter Flach

We introduce the notion of heterogeneous calibration that applies a post-hoc model-agnostic transformation to model outputs for improving AUC performance on binary classification tasks. We consider overconfident models, whose performance is…

Machine Learning · Statistics 2022-02-11 David Durfee , Aman Gupta , Kinjal Basu

Thermal errors in machine tools significantly impact machining precision and productivity. Traditional thermal error correction/compensation methods rely on measured temperature-deformation fields or on transfer functions. Most existing…

Machine Learning · Computer Science 2025-10-07 C. Coelho , M. Hohmann , D. Fernández , L. Penter , S. Ihlenfeldt , O. Niggemann