English
Related papers

Related papers: Bin-wise Temperature Scaling (BTS): Improvement in…

200 papers

Deep Neural Networks (DNNs) have achieved state-of-the-art accuracy performance in many tasks. However, recent works have pointed out that the outputs provided by these models are not well-calibrated, seriously limiting their use in…

Machine Learning · Computer Science 2020-07-16 Juan Maroñas , Roberto Paredes , Daniel Ramos

Deep Neural Networks have shown promising classification performance when predicting certain biomarkers from Whole Slide Images in digital pathology. However, the calibration of the networks' output probabilities is often not evaluated.…

Image and Video Processing · Electrical Eng. & Systems 2023-12-18 Alexander Kurz , Hendrik A. Mehrtens , Tabea-Clara Bucher , Titus J. Brinker

Experimental calibration of dynamic thermal models is required for model predictive control and characterization of building energy performance. In these applications, the uncertainty assessment of the parameter estimates is decisive; this…

Applications · Statistics 2019-04-25 L. Raillon , Christian Ghiaus

Confidence calibration of classification models is a technique to estimate the true posterior probability of the predicted class, which is critical for ensuring reliable decision-making in practical applications. Existing confidence…

Methodology · Statistics 2025-02-19 Jinzong Dong , Zhaohui Jiang , Dong Pan , Haoyang Yu

Although Gaussian processes (GPs) with deep kernels have been successfully used for meta-learning in regression tasks, its uncertainty estimation performance can be poor. We propose a meta-learning method for calibrating deep kernel GPs for…

Machine Learning · Statistics 2023-12-14 Tomoharu Iwata , Atsutoshi Kumagai

Air temperature (Ta) is an essential climatological component that controls and influences various earth surface processes. In this study, we make the first attempt to employ deep learning for Ta mapping mainly based on space remote sensing…

Atmospheric and Oceanic Physics · Physics 2020-01-15 Huanfeng Shen , Yun Jiang , Tongwen Li , Qing Cheng , Chao Zeng , Liangpei Zhang

Recent work has uncovered promising ways to extract well-calibrated confidence estimates from language models (LMs), where the model's confidence score reflects how likely it is to be correct. However, while LMs may appear well-calibrated…

Computation and Language · Computer Science 2024-03-28 Xiang Lisa Li , Urvashi Khandelwal , Kelvin Guu

Accurate calibration of probabilistic predictive models learned is critical for many practical prediction and decision-making tasks. There are two main categories of methods for building calibrated classifiers. One approach is to develop…

Machine Learning · Statistics 2014-01-16 Mahdi Pakdaman Naeini , Gregory F. Cooper , Milos Hauskrecht

The melting temperature is important for materials design because of its relationship with thermal stability, synthesis, and processing conditions. Current empirical and computational melting point estimation techniques are limited in…

In an increasing number of applications designers have access to multiple computer models which typically have different levels of fidelity and cost. Traditionally, designers calibrate these models one at a time against some high-fidelity…

Machine Learning · Computer Science 2025-06-02 Jonathan Tammer Eweis-Labolle , Tyler Johnson , Xiangyu Sun , Ramin Bostanabad

Multi-sample aggregation strategies, such as majority voting and best-of-N sampling, are widely used in contemporary large language models (LLMs) to enhance predictive accuracy across various tasks. A key challenge in this process is…

Machine Learning · Computer Science 2025-06-17 Weihua Du , Yiming Yang , Sean Welleck

Output uncertainty indicates whether the probabilistic properties reflect objective characteristics of the model output. Unlike most loss functions and metrics in machine learning, uncertainty pertains to individual samples, but validating…

Machine Learning · Computer Science 2024-12-23 Siyuan Zhang , Linbo Xie

The use of mathematical models to make predictions about tumor growth and response to treatment has become increasingly more prevalent in the clinical setting. The level of complexity within these models ranges broadly, and the calibration…

Quantitative Methods · Quantitative Biology 2021-12-28 Allison L. Lewis , Kathleen M. Storey , Heyrim Cho , Anna C. Zittle

Calibration error is commonly adopted for evaluating the quality of uncertainty estimators in deep neural networks. In this paper, we argue that such a metric is highly beneficial for training predictive models, even when we do not…

Machine Learning · Statistics 2019-11-01 Jayaraman J. Thiagarajan , Bindya Venkatesh , Deepta Rajan

Simulated tempering (ST) has attracted a great deal of attention in the last years, due to its capability to allow systems with complex dynamics to escape from regions separated by large entropic barriers. However its performance is…

Statistical Mechanics · Physics 2015-08-11 A. Valentim , Cláudio J. daSilva , Carlos E. Fiore

Knowledge Distillation (KD) aims at transferring the knowledge of a well-performed neural network (the {\it teacher}) to a weaker one (the {\it student}). A peculiar phenomenon is that a more accurate model doesn't necessarily teach better,…

Machine Learning · Computer Science 2022-10-14 Xin-Chun Li , Wen-Shu Fan , Shaoming Song , Yinchuan Li , Bingshuai Li , Yunfeng Shao , De-Chuan Zhan

Calibrating neural networks is of utmost importance when employing them in safety-critical applications where the downstream decision making depends on the predicted probabilities. Measuring calibration error amounts to comparing two…

Machine Learning · Computer Science 2021-12-30 Kartik Gupta , Amir Rahimi , Thalaiyasingam Ajanthan , Thomas Mensink , Cristian Sminchisescu , Richard Hartley

Convolutional neural networks (CNNs) are commonly used for image classification. Saliency methods are examples of approaches that can be used to interpret CNNs post hoc, identifying the most relevant pixels for a prediction following the…

Machine Learning · Computer Science 2020-10-01 Nicholas Halliwell , Freddy Lecue

With the advancement of deep learning technology, neural networks have demonstrated their excellent ability to provide accurate predictions in many tasks. However, a lack of consideration for neural network calibration will not gain trust…

Machine Learning · Computer Science 2022-11-30 Lei Hsiung , Yung-Chen Tang , Pin-Yu Chen , Tsung-Yi Ho

In statistical physics, the efficiency of tempering approaches strongly depends on ingredients such as the number of replicas $R$, reliable determination of weight factors and the set of used temperatures, ${\mathcal T}_R = \{T_1, T_2,…

Statistical Mechanics · Physics 2014-09-01 A. Valentim , M. G. E. da Luz , Carlos E. Fiore