中文
相关论文

相关论文: Reliable Prediction Intervals with Directly Optimi…

200 篇论文

Modern deep learning based classifiers show very high accuracy on test data but this does not provide sufficient guarantees for safe deployment, especially in high-stake AI applications such as medical diagnosis. Usually, predictions are…

机器学习 · 计算机科学 2022-05-09 David Stutz , Krishnamurthy , Dvijotham , Ali Taylan Cemgil , Arnaud Doucet

The deployment of safe and trustworthy machine learning systems, and particularly complex black box neural networks, in real-world applications requires reliable and certified guarantees on their performance. The conformal prediction…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Paul Melki , Lionel Bombrun , Boubacar Diallo , Jérôme Dias , Jean-Pierre da Costa

Conformal Predictors (CP) are wrappers around ML models, providing error guarantees under weak assumptions on the data distribution. They are suitable for a wide range of problems, from classification and regression to anomaly detection.…

机器学习 · 计算机科学 2021-10-06 Giovanni Cherubin , Konstantinos Chatzikokolakis , Martin Jaggi

We develop a method to generate prediction sets with a guaranteed coverage rate that is robust to corruptions in the training data, such as missing or noisy variables. Our approach builds on conformal prediction, a powerful framework to…

机器学习 · 计算机科学 2025-01-10 Shai Feldman , Yaniv Romano

Predictive models make mistakes. Hence, there is a need to quantify the uncertainty associated with their predictions. Conformal inference has emerged as a powerful tool to create statistically valid prediction regions around point…

机器学习 · 统计学 2024-02-14 Luben M. C. Cabezas , Mateus P. Otto , Rafael Izbicki , Rafael B. Stern

In high-stakes scenarios, such as medical imaging applications, it is critical to equip the predictions of a regression model with reliable confidence intervals. Recently, Conformal Prediction (CP) has emerged as a powerful statistical…

机器学习 · 计算机科学 2025-09-19 Yahav Cohen , Jacob Goldberger , Tom Tirer

Successful application of machine learning models to real-world prediction problems, e.g. financial forecasting and personalized medicine, has proved to be challenging, because such settings require limiting and quantifying the uncertainty…

机器学习 · 计算机科学 2020-09-15 Yao Zhang , William Zame , Mihaela van der Schaar

We propose a simple and efficient approach to generate a prediction intervals (PI) for approximated and forecasted trends. Our method leverages a weighted asymmetric loss function to estimate the lower and upper bounds of the PI, with the…

机器学习 · 统计学 2023-07-20 Milo Grillo , Yunpeng Han , Agnieszka Werpachowska

Reliable uncertainty quantification is crucial for the trustworthiness of machine learning applications. Inductive Conformal Prediction (ICP) offers a distribution-free framework for generating prediction sets or intervals with…

机器学习 · 计算机科学 2025-06-25 A. A. Balinsky , A. D. Balinsky

Conformal Prediction is a framework that produces prediction intervals based on the output from a machine learning algorithm. In this paper we explore the case when training data is made up of multiple parts available in different sources…

机器学习 · 统计学 2019-08-16 Ola Spjuth , Robin Carrión Brännström , Lars Carlsson , Niharika Gauraha

Cross-sectional prediction is common in many domains such as healthcare, including forecasting tasks using electronic health records, where different patients form a cross-section. We focus on the task of constructing valid prediction…

机器学习 · 统计学 2022-10-04 Zhen Lin , Shubhendu Trivedi , Jimeng Sun

Quantifying the data uncertainty in learning tasks is often done by learning a prediction interval or prediction set of the label given the input. Two commonly desired properties for learned prediction sets are \emph{valid coverage} and…

机器学习 · 计算机科学 2022-05-31 Yu Bai , Song Mei , Huan Wang , Yingbo Zhou , Caiming Xiong

This paper introduces Conformal Thresholded Intervals (CTI), a novel conformal regression method that aims to produce the smallest possible prediction set with guaranteed coverage. Unlike existing methods that rely on nested conformal…

机器学习 · 计算机科学 2025-01-03 Rui Luo , Zhixin Zhou

This paper proposes an extension to conventional regression Neural Networks (NNs) for replacing the point predictions they produce with prediction intervals that satisfy a required level of confidence. Our approach follows a novel machine…

机器学习 · 计算机科学 2023-12-18 Harris Papadopoulos , Haris Haralambous

Conformal prediction is a statistical tool for producing prediction regions of machine learning models that are valid with high probability. However, applying conformal prediction to time series data leads to conservative prediction…

系统与控制 · 电气工程与系统科学 2024-01-10 Matthew Cleaveland , Insup Lee , George J. Pappas , Lars Lindemann

Conformal predictors are machine learning algorithms that output prediction sets that have a guarantee of marginal validity for finite samples with minimal distributional assumptions. This is a property that makes conformal predictors…

机器学习 · 计算机科学 2021-03-03 Anthony Bellotti

We present a new distribution-free conformal prediction algorithm for sequential data (e.g., time series), called the \textit{sequential predictive conformal inference} (\texttt{SPCI}). We specifically account for the nature that time…

机器学习 · 统计学 2023-05-31 Chen Xu , Yao Xie

Uncertainty estimation is critical in high-stakes machine learning applications. One effective way to estimate uncertainty is conformal prediction, which can provide predictive inference with statistical coverage guarantees. We present a…

机器学习 · 计算机科学 2023-11-03 Nathaniel Diamant , Ehsan Hajiramezanali , Tommaso Biancalani , Gabriele Scalia

Modern machine learning algorithms are capable of providing remarkably accurate point-predictions; however, questions remain about their statistical reliability. Unlike conventional machine learning methods, conformal prediction algorithms…

In regression problems where there is no known true underlying model, conformal prediction methods enable prediction intervals to be constructed without any assumptions on the distribution of the underlying data, except that the training…

统计方法学 · 统计学 2023-01-31 Wenyu Chen , Kelli-Jean Chun , Rina Foygel Barber