English
Related papers

Related papers: Calibrated Reliable Regression using Maximum Mean …

200 papers

The mean field variational Bayes (VB) algorithm implemented in Stan is relatively fast and efficient, making it feasible to produce model-estimated official statistics on a rapid timeline. Yet, while consistent point estimates of parameters…

Methodology · Statistics 2024-07-08 Terrance D. Savitsky , Julie Gershunskaya

Deep Learning is a consolidated, state-of-the-art Machine Learning tool to fit a function when provided with large data sets of examples. However, in regression tasks, the straightforward application of Deep Learning models provides a point…

Machine Learning · Computer Science 2018-07-25 Axel Brando , Jose A. Rodríguez-Serrano , Mauricio Ciprian , Roberto Maestre , Jordi Vitrià

In many machine learning applications, it is important for the model to provide confidence scores that accurately capture its prediction uncertainty. Although modern learning methods have achieved great success in predictive accuracy,…

Machine Learning · Computer Science 2022-07-12 Linjun Zhang , Zhun Deng , Kenji Kawaguchi , James Zou

The recent decade has seen an enormous rise in the popularity of deep learning and neural networks. These algorithms have broken many previous records and achieved remarkable results. Their outstanding performance has significantly sped up…

Probability predictions from binary regressions or machine learning methods ought to be calibrated: If an event is predicted to occur with probability $x$, it should materialize with approximately that frequency, which means that the…

Statistics Theory · Mathematics 2023-01-11 Timo Dimitriadis , Lutz Duembgen , Alexander Henzi , Marius Puke , Johanna Ziegel

While deep neural networks are highly performant and successful in a wide range of real-world problems, estimating their predictive uncertainty remains a challenging task. To address this challenge, we propose and implement a loss function…

Machine Learning · Computer Science 2022-10-14 Tony Tohme , Kevin Vanslette , Kamal Youcef-Toumi

We present a novel distributionally robust framework for dynamic programming that uses kernel methods to design feedback control policies. Specifically, we leverage kernel mean embedding to map the transition probabilities governing the…

Systems and Control · Electrical Eng. & Systems 2023-12-20 Licio Romao , Ashish R. Hota , Alessandro Abate

Mislabeled data is a pervasive issue that undermines the performance of machine learning systems in real-world applications. An effective approach to mitigate this problem is to detect mislabeled instances and subject them to special…

Machine Learning · Computer Science 2025-11-05 Ilies Chibane , Thomas George , Pierre Nodet , Vincent Lemaire

Calibration$\unicode{x2014}$the problem of ensuring that predicted probabilities align with observed class frequencies$\unicode{x2014}$is a basic desideratum for reliable prediction with machine learning systems. Calibration error is…

Machine Learning · Statistics 2026-03-02 Eugène Berta , Sacha Braun , David Holzmüller , Francis Bach , Michael I. Jordan

This paper introduces Fast Calibrated Explanations, a method designed for generating rapid, uncertainty-aware explanations for machine learning models. By incorporating perturbation techniques from ConformaSight - a global explanation…

Machine Learning · Computer Science 2024-10-29 Tuwe Löfström , Fatima Rabia Yapicioglu , Alessandra Stramiglio , Helena Löfström , Fabio Vitali

While widely used as a general method for uncertainty quantification, the bootstrap method encounters difficulties that raise concerns about its validity in practical applications. This paper introduces a new resampling-based method, termed…

Methodology · Statistics 2024-08-30 Yiran Jiang , Chuanhai Liu , Heping Zhang

Deep clustering has exhibited remarkable performance; however, the over confidence problem, i.e., the estimated confidence for a sample belonging to a particular cluster greatly exceeds its actual prediction accuracy, has been over looked…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yuheng Jia , Jianhong Cheng , Hui Liu , Junhui Hou

Bayesian Neural Networks (BNNs) are trained to optimize an entire distribution over their weights instead of a single set, having significant advantages in terms of, e.g., interpretability, multi-task learning, and calibration. Because of…

Machine Learning · Computer Science 2022-10-07 Jary Pomponi , Simone Scardapane , Aurelio Uncini

In machine learning, accurately predicting the probability that a specific input is correct is crucial for risk management. This process, known as uncertainty (or confidence) estimation, is particularly important in mission-critical…

Machine Learning · Computer Science 2023-01-12 Gabriella Chouraqui , Liron Cohen , Gil Einziger , Liel Leman

We develop a novel approach to tackle the common but challenging problem of conformal inference for missing data in machine learning, focusing on Missing at Random (MAR) data. We propose a new procedure Conformal prediction for Missing data…

Methodology · Statistics 2025-10-22 Wenlu Tang , Hongni Wang , Xingcai Zhou , Bei Jiang , Linglong Kong

Machine learning classifiers are probabilistic in nature, and thus inevitably involve uncertainty. Predicting the probability of a specific input to be correct is called uncertainty (or confidence) estimation and is crucial for risk…

Machine Learning · Computer Science 2023-01-11 Gabriella Chouraqui , Liron Cohen , Gil Einziger , Liel Leman

Artificial neural networks (ANNs) are highly flexible predictive models. However, reliably quantifying uncertainty for their predictions is a continuing challenge. There has been much recent work on "recalibration" of predictive…

Methodology · Statistics 2024-03-12 R. Torres , D. J. Nott , S. A. Sisson , T. Rodrigues , J. G. Reis , G. S. Rodrigues

Calibration is a fundamental property of a good predictive model: it requires that the model predicts correctly in proportion to its confidence. Modern neural networks, however, provide no strong guarantees on their calibration -- and can…

Machine Learning · Computer Science 2022-10-07 A. Michael Carrell , Neil Mallinar , James Lucas , Preetum Nakkiran

Calibration of neural networks is a topical problem that is becoming more and more important as neural networks increasingly underpin real-world applications. The problem is especially noticeable when using modern neural networks, for which…

Machine Learning · Computer Science 2023-08-29 Ondrej Bohdal , Yongxin Yang , Timothy Hospedales

Calibration is a common experimental physics problem, whose goal is to infer the value and uncertainty of an unobservable quantity Z given a measured quantity X. Additionally, one would like to quantify the extent to which X and Z are…

High Energy Physics - Phenomenology · Physics 2023-09-26 Rikab Gambhir , Benjamin Nachman , Jesse Thaler