中文
相关论文

相关论文: Nested conformal prediction and quantile out-of-ba…

200 篇论文

Conformal prediction (CP) provides model-agnostic uncertainty quantification with guaranteed coverage, but conventional methods often produce overly conservative uncertainty sets, especially in multi-dimensional settings. This limitation…

机器学习 · 计算机科学 2025-02-12 Minxing Zheng , Shixiang Zhu

Conformal prediction has emerged as an effective strategy for uncertainty quantification by modifying a model to output sets of labels instead of a single label. These prediction sets come with the guarantee that they contain the true label…

机器学习 · 计算机科学 2025-05-28 Haosen Ge , Hamsa Bastani , Osbert Bastani

We develop a general framework for distribution-free predictive inference in regression, using conformal inference. The proposed methodology allows for the construction of a prediction band for the response variable using any estimator of…

统计方法学 · 统计学 2017-03-09 Jing Lei , Max G'Sell , Alessandro Rinaldo , Ryan J. Tibshirani , Larry Wasserman

The importance of accurately quantifying forecast uncertainty has motivated much recent research on probabilistic forecasting. In particular, a variety of deep learning approaches has been proposed, with forecast distributions obtained as…

机器学习 · 统计学 2024-11-11 Benedikt Schulz , Lutz Köhler , Sebastian Lerch

Current instance segmentation models achieve high performance on average predictions, but lack principled uncertainty quantification: their outputs are not calibrated, and there is no guarantee that a predicted mask is close to the ground…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Kerri Lu , Dan M. Kluger , Stephen Bates , Sherrie Wang

Machine learning classification tasks often benefit from predicting a set of possible labels with confidence scores to capture uncertainty. However, existing methods struggle with the high-dimensional nature of the data and the lack of…

机器学习 · 计算机科学 2024-07-08 Rui Luo , Zhixin Zhou

We develop a new approach to multi-label conformal prediction in which we aim to output a precise set of promising prediction candidates with a bounded number of incorrect answers. Standard conformal prediction provides the ability to adapt…

机器学习 · 计算机科学 2022-02-16 Adam Fisch , Tal Schuster , Tommi Jaakkola , Regina Barzilay

Conformal prediction methods provide statistically rigorous marginal coverage guarantees for machine learning models, but such guarantees fail to account for algorithmic biases, thereby undermining fairness and trust. This paper introduces…

机器学习 · 计算机科学 2026-05-13 Senrong Xu , Yanke Zhou , Yuhao Tan , Zenan Li , Yuan Yao , Taolue Chen , Feng Xu , Xiaoxing Ma

Conformal inference, cross-validation+, and the jackknife+ are hold-out methods that can be combined with virtually any machine learning algorithm to construct prediction sets with guaranteed marginal coverage. In this paper, we develop…

统计方法学 · 统计学 2021-02-24 Yaniv Romano , Matteo Sesia , Emmanuel J. Candès

Conformal prediction is a distribution-free technique for establishing valid prediction intervals. Although conventionally people conduct conformal prediction in the output space, this is not the only possibility. In this paper, we propose…

机器学习 · 计算机科学 2023-04-11 Jiaye Teng , Chuan Wen , Dinghuai Zhang , Yoshua Bengio , Yang Gao , Yang Yuan

Conformal prediction is a learning framework controlling prediction coverage of prediction sets, which can be built on any learning algorithm for point prediction. This work proposes a learning framework named conformal loss-controlling…

机器学习 · 计算机科学 2024-01-24 Di Wang , Ping Wang , Zhong Ji , Xiaojun Yang , Hongyue Li

This paper introduces a framework for uncertainty quantification in regression models defined in metric spaces. Leveraging a newly defined notion of homoscedasticity, we develop a conformal prediction algorithm that offers finite-sample…

机器学习 · 统计学 2025-07-22 Gábor Lugosi , Marcos Matabuena

Over the last few decades, various methods have been proposed for estimating prediction intervals in regression settings, including Bayesian methods, ensemble methods, direct interval estimation methods and conformal prediction methods. An…

机器学习 · 统计学 2024-04-02 Nicolas Dewolf , Bernard De Baets , Willem Waegeman

Given that machine learning algorithms are increasingly being deployed to aid in high stakes decision-making, uncertainty quantification methods that wrap around these black box models such as conformal prediction have received much…

机器学习 · 统计学 2026-02-09 Kayla E. Scharfstein , Arun Kumar Kuchibhotla

Sampling from the equilibrium distribution has always been a major problem in molecular simulations due to the very high dimensionality of conformational space. Over several decades, many approaches have been used to overcome the problem.…

计算物理 · 物理学 2020-03-02 Adrià Pérez , Pablo Herrera-Nieto , Stefan Doerr , Gianni De Fabritiis

Conventional frequentist learning is known to yield poorly calibrated models that fail to reliably quantify the uncertainty of their decisions. Bayesian learning can improve calibration, but formal guarantees apply only under restrictive…

机器学习 · 统计学 2022-10-07 Sangwoo Park , Kfir M. Cohen , Osvaldo Simeone

Conformal prediction has emerged as a cutting-edge methodology in statistics and machine learning, providing prediction intervals with finite-sample frequentist coverage guarantees. Yet, its interplay with Bayesian statistics, often…

统计方法学 · 统计学 2026-03-27 Nina Deliu , Brunero Liseo

Conformalized quantile regression is a procedure that inherits the advantages of conformal prediction and quantile regression. That is, we use quantile regression to estimate the true conditional quantile and then apply a conformal step on…

机器学习 · 统计学 2023-11-02 Martim Sousa , Ana Maria Tomé , José Moreira

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

统计方法学 · 统计学 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

This paper introduces a conformal inference method to evaluate uncertainty in classification by generating prediction sets with valid coverage conditional on adaptively chosen features. These features are carefully selected to reflect…

机器学习 · 统计学 2024-10-31 Yanfei Zhou , Matteo Sesia