English
Related papers

Related papers: Self-Calibrating Conformal Prediction

200 papers

Recommender systems utilize users' historical data to learn and predict their future interests, providing them with suggestions tailored to their tastes. Calibration ensures that the distribution of recommended item categories is consistent…

Information Retrieval · Computer Science 2022-08-23 Mohammadmehdi Naghiaei , Hossein A. Rahmani , Mohammad Aliannejadi , Nasim Sonboli

In many safety-critical applications such as autonomous driving and surgical robots, it is desirable to obtain prediction uncertainties from object detection modules to help support safe decision-making. Specifically, such modules need to…

Machine Learning · Computer Science 2018-11-29 Buu Phan , Rick Salay , Krzysztof Czarnecki , Vahdat Abdelzad , Taylor Denouden , Sachin Vernekar

The task of calibration is to retrospectively adjust the outputs from a machine learning model to provide better probability estimates on the target variable. While calibration has been investigated thoroughly in classification, it has not…

Machine Learning · Statistics 2018-06-21 Hao Song , Meelis Kull , Peter Flach

Conformal prediction can yield statistically valid prediction intervals for any regression model, with no model modifications and small computational costs. To assess its practical value, we apply conformal methods to quantify uncertainty…

Atmospheric and Oceanic Physics · Physics 2026-03-31 Miriam Simm , Corinna Hoose , Tom Beucler

The black box nature of deep learning models complicate their usage in critical applications such as remote sensing. Conformal prediction is a method to ensure trust in such scenarios. Subject to data exchangeability, conformal prediction…

Machine Learning · Computer Science 2024-05-07 Protim Bhattacharjee , Peter Jung

Overconfidence and underconfidence in machine learning classifiers is measured by calibration: the degree to which the probabilities predicted for each class match the accuracy of the classifier on that prediction. How one measures…

Machine Learning · Computer Science 2020-08-11 Jeremy Nixon , Mike Dusenberry , Ghassen Jerfel , Timothy Nguyen , Jeremiah Liu , Linchuan Zhang , Dustin Tran

Contextual optimization, also known as predict-then-optimize or prescriptive analytics, considers an optimization problem with the presence of covariates (context or side information). The goal is to learn a prediction model (from the…

Optimization and Control · Mathematics 2024-05-13 Chunlin Sun , Linyu Liu , Xiaocheng Li

In many machine learning applications, it is important for the model to provide confidence scores that accurately capture its prediction uncertainty. Although modern learning methods have achieved great success in predictive accuracy,…

Machine Learning · Computer Science 2022-07-12 Linjun Zhang , Zhun Deng , Kenji Kawaguchi , James Zou

Before delegating a task to an autonomous system, a human operator may want a guarantee about the behavior of the system. This paper extends previous work on conformal prediction for functional data and conformalized quantile regression to…

Machine Learning · Computer Science 2022-06-23 Thomas G. Dietterich , Jesse Hostetler

Quantifying the data uncertainty in learning tasks is often done by learning a prediction interval or prediction set of the label given the input. Two commonly desired properties for learned prediction sets are \emph{valid coverage} and…

Machine Learning · Computer Science 2022-05-31 Yu Bai , Song Mei , Huan Wang , Yingbo Zhou , Caiming Xiong

Accurate estimation of predictive uncertainty (model calibration) is essential for the safe application of neural networks. Many instances of miscalibration in modern neural networks have been reported, suggesting a trend that newer, more…

Machine Learning · Computer Science 2021-10-27 Matthias Minderer , Josip Djolonga , Rob Romijnders , Frances Hubis , Xiaohua Zhai , Neil Houlsby , Dustin Tran , Mario Lucic

Reliable confidence estimates are important for safely deploying vision-based controllers in autonomous racing, where safety predictions must be derived from camera images, yet modern predictors become dangerously overconfident under…

Robotics · Computer Science 2026-05-21 Zhenjiang Mao , Jiawen Wu , Gabriel Wagner , Zhongzheng Zhang , Ivan Ruchkin

Reliable long-horizon value prediction is difficult in offline reinforcement learning because fitted value methods combine bootstrapping, function approximation, and distribution shift, while standard guarantees often require Bellman…

Machine Learning · Statistics 2026-05-11 Lars van der Laan , Nathan Kallus

Forecasts for uncertain future events should be probabilistic. Probabilistic forecasts are commonly issued as prediction intervals, which provide a measure of uncertainty in the unknown outcome whilst being easier to understand and…

Methodology · Statistics 2025-08-26 Sam Allen , Julia Burnello , Johanna Ziegel

We show how to achieve the notion of "multicalibration" from H\'ebert-Johnson et al. [2018] not just for means, but also for variances and other higher moments. Informally, it means that we can find regression functions which, given a data…

Machine Learning · Computer Science 2020-08-19 Christopher Jung , Changhwa Lee , Mallesh M. Pai , Aaron Roth , Rakesh Vohra

Conformal Prediction (CP) is a popular method for uncertainty quantification with machine learning models. While conformal prediction provides probabilistic guarantees regarding the coverage of the true label, these guarantees are agnostic…

Machine Learning · Computer Science 2025-10-21 Aditya T. Vadlamani , Anutam Srinivasan , Pranav Maneriker , Ali Payani , Srinivasan Parthasarathy

Conformal prediction constructs prediction sets with finite-sample coverage guarantees, but its calibration stage is structurally constrained to a scalar score function and a single threshold variable - forcing shapes of prediction sets to…

Machine Learning · Statistics 2026-05-13 Laura Lützow , Simone Garatti , Marco C. Campi , Lars Lindemann , Matthias Althoff

Machine learning (ML) is transforming healthcare, but safe clinical decisions demand reliable uncertainty estimates that standard ML models fail to provide. Conformal prediction (CP) is a popular tool that allows users to turn heuristic…

Machine Learning · Computer Science 2025-12-18 Klaus-Rudolf Kladny , Bernhard Schölkopf , Lisa Koch , Christian F. Baumgartner , Michael Muehlebach

Confidence calibration -- the problem of predicting probability estimates representative of the true correctness likelihood -- is important for classification models in many applications. We discover that modern neural networks, unlike…

Machine Learning · Computer Science 2017-08-04 Chuan Guo , Geoff Pleiss , Yu Sun , Kilian Q. Weinberger

In this research we propose a new method for training predictive machine learning models for prescriptive applications. This approach, which we refer to as coupled validation, is based on tweaking the validation step in the standard…

Machine Learning · Computer Science 2021-10-25 Ebrahim Mortaz , Alexander Vinel