English
Related papers

Related papers: A novel Deep Learning approach for one-step Confor…

200 papers

This work presents a novel loss function for learning nonlinear Model Predictive Control policies via Imitation Learning. Standard approaches to Imitation Learning neglect information about the expert and generally adopt a loss function…

Machine Learning · Computer Science 2023-04-05 Andrea Ghezzi , Jasper Hoffman , Jonathan Frey , Joschka Boedecker , Moritz Diehl

Conformal Prediction (CP) algorithms estimate the uncertainty of a prediction model by calibrating its outputs on labeled data. The same calibration scheme usually applies to any model and data without modifications. The obtained prediction…

Machine Learning · Computer Science 2024-06-27 Nicolo Colombo

Conformal predictors are an important class of algorithms that allow predictions to be made with a user-defined confidence level. They are able to do this by outputting prediction sets, rather than simple point predictions. The conformal…

Machine Learning · Computer Science 2021-05-25 Anthony Bellotti

When one observes a sequence of variables $(x_1, y_1), \ldots, (x_n, y_n)$, Conformal Prediction (CP) is a methodology that allows to estimate a confidence set for $y_{n+1}$ given $x_{n+1}$ by merely assuming that the distribution of the…

Machine Learning · Statistics 2022-12-08 Eugene Ndiaye

The conformalClassification package implements Transductive Conformal Prediction (TCP) and Inductive Conformal Prediction (ICP) for classification problems. Conformal Prediction (CP) is a framework that complements the predictions of…

Machine Learning · Statistics 2018-04-17 Niharika Gauraha , Ola Spjuth

Conformal Prediction (CP) has recently received a tremendous amount of interest, leading to a wide range of new theoretical and methodological results for predictive inference with formal theoretical guarantees. However, the vast majority…

Statistics Theory · Mathematics 2025-08-22 Manit Paul , Arun Kumar Kuchibhotla , Eric J. Tchetgen Tchetgen

Based on the framework of Conformal Prediction (CP), we study the online construction of confidence sets given a black-box machine learning model. By converting the target confidence levels into quantile levels, the problem can be reduced…

Machine Learning · Statistics 2025-05-23 Zhiyu Zhang , Zhou Lu , Heng Yang

This tutorial focuses on efficient methods to predictive monitoring (PM), the problem of detecting at runtime future violations of a given requirement from the current state of a system. While performing model checking at runtime would…

Artificial Intelligence · Computer Science 2023-12-05 Francesca Cairoli , Luca Bortolussi , Nicola Paoletti

Conventional frequentist learning is known to yield poorly calibrated models that fail to reliably quantify the uncertainty of their decisions. Bayesian learning can improve calibration, but formal guarantees apply only under restrictive…

Machine Learning · Statistics 2022-10-07 Sangwoo Park , Kfir M. Cohen , Osvaldo Simeone

Conformal Prediction (CP) has emerged as a powerful statistical framework for high-stakes classification applications. Instead of predicting a single class, CP generates a prediction set, guaranteed to include the true label with a…

Machine Learning · Computer Science 2025-11-25 Ariel Fargion , Lahav Dabah , Tom Tirer

Conformal Prediction (CP) is a popular method for uncertainty quantification with machine learning models. While conformal prediction provides probabilistic guarantees regarding the coverage of the true label, these guarantees are agnostic…

Machine Learning · Computer Science 2025-10-21 Aditya T. Vadlamani , Anutam Srinivasan , Pranav Maneriker , Ali Payani , Srinivasan Parthasarathy

Conformal prediction (CP) has emerged as a powerful tool in robotics and control, thanks to its ability to calibrate complex, data-driven models with formal guarantees. However, in robot navigation tasks, existing CP-based methods often…

Robotics · Computer Science 2025-04-02 Jaeuk Shin , Jungjin Lee , Insoon Yang

We develop a novel approach to conformal prediction when the target task has limited data available for training. Conformal prediction identifies a small set of promising output candidates in place of a single prediction, with guarantees…

Machine Learning · Computer Science 2021-07-21 Adam Fisch , Tal Schuster , Tommi Jaakkola , Regina Barzilay

We present Distribution-aware Conformal Prediction (DCP), a unified framework integrating probabilistic predictors like Monte Carlo dropout, deep ensembles, and quantile regression with score-agnostic conformal calibration to produce valid…

Machine Learning · Computer Science 2026-05-27 Daniel Schweizer , Peter Kuhn , Jayant Sharma , Shivali Dubey , Malte von Ramin , Christoph Brockt-Haßauer

Conformal prediction (CP) provides sets of candidate classes with a guaranteed probability of containing the true class. However, it typically relies on a calibration set with clean labels. We address privacy-sensitive scenarios where the…

Machine Learning · Computer Science 2025-12-08 Coby Penso , Bar Mahpud , Jacob Goldberger , Or Sheffet

Quantifying the data uncertainty in learning tasks is often done by learning a prediction interval or prediction set of the label given the input. Two commonly desired properties for learned prediction sets are \emph{valid coverage} and…

Machine Learning · Computer Science 2022-05-31 Yu Bai , Song Mei , Huan Wang , Yingbo Zhou , Caiming Xiong

Conformal prediction (CP) provides finite-sample, distribution-free marginal coverage, but standard conformal regression intervals can be inefficient under heteroscedasticity and skewness. In particular, popular constructions such as…

Machine Learning · Statistics 2026-03-03 Xiaoyi Su , Zhixin Zhou , Rui Luo

Signal Temporal Logic (STL) inference seeks to extract human-interpretable rules from time-series data, but existing methods lack formal confidence guarantees for the inferred rules. Conformal prediction (CP) is a technique that can provide…

Machine Learning · Computer Science 2025-10-23 Danyang Li , Yixuan Wang , Matthew Cleaveland , Mingyu Cai , Roberto Tron

Post-hoc calibration of pre-trained models is critical for ensuring reliable inference, especially in safety-critical domains such as healthcare. Conformal Prediction (CP) offers a robust post-hoc calibration framework, providing…

Machine Learning · Computer Science 2025-05-22 Haifeng Wen , Hong Xing , Osvaldo Simeone

Conformal prediction is a distribution-free technique for establishing valid prediction intervals. Although conventionally people conduct conformal prediction in the output space, this is not the only possibility. In this paper, we propose…

Machine Learning · Computer Science 2023-04-11 Jiaye Teng , Chuan Wen , Dinghuai Zhang , Yoshua Bengio , Yang Gao , Yang Yuan