English
Related papers

Related papers: Highest Probability Density Conformal Regions

200 papers

We propose a robust inferential procedure for assessing uncertainties of parameter estimation in high-dimensional linear models, where the dimension $p$ can grow exponentially fast with the sample size $n$. Our method combines the…

Machine Learning · Statistics 2015-03-19 Tianqi Zhao , Mladen Kolar , Han Liu

Large-scale optimization problems are ubiquitous in the physical sciences; yet, high-fidelity models can often be complex and computationally prohibitive for optimization. A practical alternative is to use a low-fidelity model to facilitate…

Numerical Analysis · Mathematics 2026-04-03 Madhusudan Madhavan , Joseph Hart , Bart van Bloemen Waanders

Online conformal prediction has demonstrated its capability to construct a prediction set for each incoming data point that covers the true label with a predetermined probability. To cope with potential distribution shift, multi-model…

Machine Learning · Computer Science 2025-10-14 Erfan Hajihashemi , Yanning Shen

Conformal prediction is a popular uncertainty quantification method that augments a base predictor to return sets of predictions with statistically valid coverage guarantees. However, current methods are often computationally expensive and…

Machine Learning · Computer Science 2026-03-05 Laura Lützow , Michael Eichelbeck , Mykel J. Kochenderfer , Matthias Althoff

Decision-making under uncertainty is hugely important for any decisions sensitive to perturbations in observed data. One method of incorporating uncertainty into making optimal decisions is through robust optimization, which minimizes the…

Methodology · Statistics 2021-09-06 Chancellor Johnstone , Bruce Cox

Robust optimization (RO) provides a principled framework for decision-making under uncertainty, but its performance critically depends on the choice of the uncertainty set. While large sets ensure reliability, they often lead to overly…

Machine Learning · Computer Science 2026-05-15 Shuyi Chen , Wenbin Zhou , Shixiang Zhu

We study the high-dimensional linear regression problem with categorical predictors that have many levels. We propose a new estimation approach, which performs model compression via two mechanisms by simultaneously encouraging (a)…

Methodology · Statistics 2026-03-30 Kayhan Behdin , Riade Benbaki , Peter Radchenko , Rahul Mazumder

Methods to quantify uncertainty in predictions from arbitrary models are in demand in high-stakes domains like medicine and finance. Conformal prediction has emerged as a popular method for producing a set of predictions with specified…

Machine Learning · Computer Science 2025-03-19 Jessica Hullman , Yifan Wu , Dawei Xie , Ziyang Guo , Andrew Gelman

Density estimation in high-dimensional settings is an important and challenging statistical problem.Traditional methods based on kernel smoothing are inefficient in high dimensions due to the difficulties in specifying appropriate…

Machine Learning · Statistics 2026-05-14 Ruitong Zhang , Ke Deng

We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the…

Machine Learning · Statistics 2016-06-03 Jinghui Chen , Quanquan Gu

For exponentially distributed lifetimes, we consider the prediction of future order statistics based on having observed the first $m$ order statistics. We focus on the previously less explored aspects of predicting: (i) an arbitrary pair of…

Statistics Theory · Mathematics 2024-03-12 Akbar Asgharzadeh , Éric Marchand , Ali Saadati Nik

We formulate an optimization problem to estimate probability densities in the context of multidimensional problems that are sampled with uneven probability. It considers detector sensitivity as an heterogeneous density and takes advantage…

Machine Learning · Computer Science 2025-06-04 Aleix Boquet-Pujadas , Pol del Aguila Pla , Michael Unser

Conformal prediction has emerged as a popular technique for facilitating valid predictive inference across a spectrum of machine learning models, under minimal assumption of exchangeability. Recently, Hoff (2023) showed that full conformal…

Statistics Theory · Mathematics 2025-11-24 Pankaj Bhagwat , Linglong Kong , Bei Jiang

Conformal prediction quantifies the uncertainty of machine learning models by augmenting point predictions with valid prediction sets. For complex scenarios involving multiple trials, models, or data sources, conformal prediction sets can…

Machine Learning · Computer Science 2025-12-25 Gina Wong , Drew Prinster , Suchi Saria , Rama Chellappa , Anqi Liu

Conformal prediction (CP) is a powerful framework for quantifying uncertainty in machine learning models, offering reliable predictions with finite-sample coverage guarantees. When applied to classification, CP produces a prediction set of…

Machine Learning · Computer Science 2025-08-20 Floris den Hengst , Inès Blin , Majid Mohammadi , Syed Ihtesham Hussain Shah , Taraneh Younesian

This paper presents a general framework for estimating high-dimensional conditional latent factor models via constrained nuclear norm regularization. We establish large sample properties of the estimators and provide efficient algorithms…

Econometrics · Economics 2025-12-09 Qihui Chen

Multivariate linear regression models often face the problem of heteroscedasticity caused by multiple explanatory variables. The weighted least squares estimation with univariate-dependent weights has limitations in constructing weight…

Methodology · Statistics 2026-01-16 Lei Huang , Chengyue Liu , Li Wang

In real-world settings involving consequential decision-making, the deployment of machine learning systems generally requires both reliable uncertainty quantification and protection of individuals' privacy. We present a framework that…

Machine Learning · Computer Science 2024-03-05 Anastasios N. Angelopoulos , Stephen Bates , Tijana Zrnic , Michael I. Jordan

We introduce a neural network conformal prediction method for time series that enhances adaptivity in non-stationary environments. Our approach acts as a neural controller designed to achieve desired target coverage, leveraging auxiliary…

Machine Learning · Computer Science 2024-12-25 Ruipu Li , Alexander Rodríguez

We investigate and extend the conformal prediction method due to Vovk,Gammerman and Shafer (2005) to construct nonparametric prediction regions. These regions have guaranteed distribution free, finite sample coverage, without any…

Statistics Theory · Mathematics 2011-11-08 Jing Lei , James Robins , Larry Wasserman