English
Related papers

Related papers: Conformal uncertainty quantification using kernel …

200 papers

Machine learning methods are increasingly widely used in high-risk settings such as healthcare, transportation, and finance. In these settings, it is important that a model produces calibrated uncertainty to reflect its own confidence and…

Artificial Intelligence · Computer Science 2022-09-09 Sophia Sun

Interest has been growing in decision-focused machine learning methods which train models to account for how their predictions are used in downstream optimization problems. Doing so can often improve performance on subsequent decision…

Machine Learning · Computer Science 2025-03-03 Santiago Cortes-Gomez , Carlos Patiño , Yewon Byun , Steven Wu , Eric Horvitz , Bryan Wilder

Background and objective: Uncertainty quantification is a pivotal field that contributes to realizing reliable and robust systems. It becomes instrumental in fortifying safe decisions by providing complementary information, particularly…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Jamil Fayyad , Shadi Alijani , Homayoun Najjaran

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury

General predictive models do not provide a measure of confidence in predictions without Bayesian assumptions. A way to circumvent potential restrictions is to use conformal methods for constructing non-parametric confidence regions, that…

Machine Learning · Statistics 2016-09-21 Evgeny Burnaev , Ivan Nazarov

These notes provide a self-contained introduction to kernel methods and their geometric foundations in machine learning. Starting from the construction of Hilbert spaces, we develop the theory of positive definite kernels, reproducing…

Conformal Prediction methods have finite-sample distribution-free marginal coverage guarantees. However, they generally do not offer conditional coverage guarantees, which can be important for high-stakes decisions. In this paper, we…

Machine Learning · Statistics 2024-09-27 Ruijiang Gao , Mingzhang Yin , James McInerney , Nathan Kallus

Conformal prediction is a simple and powerful tool that can quantify uncertainty without any distributional assumptions. Many existing methods only address the average coverage guarantee, which is not ideal compared to the stronger…

Machine Learning · Statistics 2023-02-21 Xing Han , Ziyang Tang , Joydeep Ghosh , Qiang Liu

Causal inference is central to statistics and scientific discovery, enabling researchers to identify cause-and-effect relationships beyond associations. While traditionally studied within Euclidean spaces, contemporary applications…

Methodology · Statistics 2025-07-01 Satarupa Bhattacharjee , Bing Li , Xiao Wu , Lingzhou Xue

Conformal prediction is a distribution-free and model-agnostic uncertainty-quantification method that provides finite-sample prediction intervals with guaranteed coverage. In this work, for the first time, we apply conformal-prediction to…

Nuclear Theory · Physics 2026-02-02 Habib Yousefi Dezdarani , Ryan Curry , Alexandros Gezerlis

Predictive models make mistakes. Hence, there is a need to quantify the uncertainty associated with their predictions. Conformal inference has emerged as a powerful tool to create statistically valid prediction regions around point…

Machine Learning · Statistics 2024-02-14 Luben M. C. Cabezas , Mateus P. Otto , Rafael Izbicki , Rafael B. Stern

Conformal Prediction provides distribution-free prediction intervals with guaranteed coverage, but its reliance on a single global calibration threshold obscures the sources of uncertainty at the instance level. In particular, it conflates…

In finite mixture models, apart from underlying mixing measure, true kernel density function of each subpopulation in the data is, in many scenarios, unknown. Perhaps the most popular approach is to choose some kernel functions that we…

Statistics Theory · Mathematics 2017-09-26 Nhat Ho , XuanLong Nguyen , Ya'acov Ritov

We propose a computationally efficient method to construct nonparametric, heteroscedastic prediction bands for uncertainty quantification, with or without any user-specified predictive model. Our approach provides an alternative to the…

Machine Learning · Statistics 2023-01-18 Tengyuan Liang

The reproducing kernel Hilbert space (RKHS) embedding method is a recently introduced estimation approach that seeks to identify the unknown or uncertain function in the governing equations of a nonlinear set of ordinary differential…

Optimization and Control · Mathematics 2020-07-14 Jia Guo , Sai Tej Paruchuri , Andrew J. Kurdila

Conformal prediction methodologies have significantly advanced the quantification of uncertainties in predictive models. Yet, the construction of confidence regions for model parameters presents a notable challenge, often necessitating…

Machine Learning · Statistics 2024-05-30 Charles Guille-Escuret , Eugene Ndiaye

The ever-growing size of the datasets renders well-studied learning techniques, such as Kernel Ridge Regression, inapplicable, posing a serious computational challenge. Divide-and-conquer is a common remedy, suggesting to split the dataset…

Machine Learning · Statistics 2021-05-25 Valeriy Avanesov

A Hilbert space embedding of a distribution---in short, a kernel mean embedding---has recently emerged as a powerful tool for machine learning and inference. The basic idea behind this framework is to map distributions into a reproducing…

Machine Learning · Statistics 2020-12-15 Krikamol Muandet , Kenji Fukumizu , Bharath Sriperumbudur , Bernhard Schölkopf

Precise estimation of predictive uncertainty in deep neural networks is a critical requirement for reliable decision-making in machine learning and statistical modeling, particularly in the context of medical AI. Conformal Prediction (CP)…

Machine Learning · Computer Science 2024-01-05 Hamed Karimi , Reza Samavi

Modern datasets across many disciplines increasingly consist of time-evolving, potentially infinite-dimensional random objects, such as dynamic functional data, which are naturally modeled in Hilbert spaces. In these settings,…

Machine Learning · Statistics 2026-05-08 Daniel López-Montero , Antonio Álvarez-López , Marcos Matabuena