English
Related papers

Related papers: Efficiency of conformalized ridge regression

200 papers

Conformal prediction is a general distribution-free approach for constructing prediction sets combined with any machine learning algorithm that achieve valid marginal or conditional coverage in finite samples. Ordinal classification is…

Methodology · Statistics 2024-11-05 Subhrasish Chakraborty , Chhavi Tyagi , Haiyan Qiao , Wenge Guo

We propose an adaptive confidence interval procedure (CIP) for the coefficients in the normal linear regression model. This procedure has a frequentist coverage rate that is constant as a function of the model parameters, yet provides…

Methodology · Statistics 2017-07-10 Peter D. Hoff , Chaoyu Yu

Random feature (RF) has been widely used for node consistency in decentralized kernel ridge regression (KRR). Currently, the consistency is guaranteed by imposing constraints on coefficients of features, necessitating that the random…

Machine Learning · Computer Science 2024-09-23 Ruikai Yang , Fan He , Mingzhen He , Jie Yang , Xiaolin Huang

This paper applies conformal prediction techniques to compute simultaneous prediction bands and clustering trees for functional data. These tools can be used to detect outliers and clusters. Both our prediction bands and clustering trees…

Machine Learning · Statistics 2013-02-27 Jing Lei , Alessandro Rinaldo , Larry Wasserman

Focusing on a high dimensional linear model $y = X\beta + \epsilon$ with dependent, non-stationary, and heteroskedastic errors, this paper applies the debiased and threshold ridge regression method that gives a consistent estimator for…

Statistics Theory · Mathematics 2021-10-27 Yunyi Zhang , Dimitris N. Politis

Predictive inference under a general regression setting is gaining more interest in the big-data era. In terms of going beyond point prediction to develop prediction intervals, two main threads of development are conformal prediction and…

Statistics Theory · Mathematics 2025-05-19 Yiren Wang , Dimitris N. Politis

Automated decision support systems promise to help human experts solve multiclass classification tasks more efficiently and accurately. However, existing systems typically require experts to understand when to cede agency to the system or…

Machine Learning · Computer Science 2023-07-03 Eleni Straitouri , Lequn Wang , Nastaran Okati , Manuel Gomez Rodriguez

Standard conformal prediction methods provide a marginal coverage guarantee, which means that for a random test point, the conformal prediction set contains the true label with a user-specified probability. In many classification problems,…

Conformal prediction is a statistical framework that generates prediction sets containing ground-truth labels with a desired coverage guarantee. The predicted probabilities produced by machine learning models are generally miscalibrated,…

Machine Learning · Computer Science 2024-06-07 Jianguo Huang , Huajun Xi , Linjun Zhang , Huaxiu Yao , Yue Qiu , Hongxin Wei

Conformal prediction provides a principled framework for uncertainty quantification with finite-sample coverage guarantees. While recent work has extended conformal prediction to online and sequential settings, existing methods typically…

Machine Learning · Statistics 2026-05-14 Eduardo Ochoa Rivera , Ambuj Tewari

Conformal prediction is an emerging technique for uncertainty quantification that constructs prediction sets guaranteed to contain the true label with a predefined probability. Previous works often employ temperature scaling to calibrate…

Machine Learning · Computer Science 2024-12-24 Huajun Xi , Jianguo Huang , Kangdao Liu , Lei Feng , Hongxin Wei

Classical Bayesian persuasion assumes that senders fully understand how receivers form beliefs and make decisions--an assumption that rarely holds when receivers possess private information or exhibit non-Bayesian behavior. In this paper,…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Heeseung Bang , Andreas A. Malikopoulos

In this work, we investigate Gaussian process regression used to recover a function based on noisy observations. We derive upper and lower error bounds for Gaussian process regression with possibly misspecified correlation functions. The…

Statistics Theory · Mathematics 2022-07-20 Wenjia Wang , Bing-Yi Jing

Conformal prediction provides a pivotal and flexible technique for uncertainty quantification by constructing prediction sets with a predefined coverage rate. Many online conformal prediction methods have been developed to address data…

Machine Learning · Statistics 2026-02-25 Dongjian Hu , Junxi Wu , Shu-Tao Xia , Changliang Zou

We present a new method for generating confidence sets within the split conformal prediction framework. Our method performs a trainable transformation of any given conformity score to improve conditional coverage while ensuring exact…

Conformal prediction provides model-agnostic and distribution-free uncertainty quantification through prediction sets that are guaranteed to include the ground truth with any user-specified probability. Yet, conformal prediction is not…

Machine Learning · Computer Science 2025-03-18 Yan Scholten , Stephan Günnemann

Conformal prediction, which makes no distributional assumptions about the data, has emerged as a powerful and reliable approach to uncertainty quantification in practical applications. The nonconformity measure used in conformal prediction…

Machine Learning · Computer Science 2024-10-15 Yuko Kato , David M. J. Tax , Marco Loog

We propose conformal hyperrectangular prediction regions for multi-target regression. We propose split conformal prediction algorithms for both point and quantile regression to form hyperrectangular prediction regions, which allow for easy…

Methodology · Statistics 2024-06-10 Max Sampson , Kung-Sik Chan

Uncertainty is critical to reliable decision-making with machine learning. Conformal prediction (CP) handles uncertainty by predicting a set on a test input, hoping the set to cover the true label with at least $(1-\alpha)$ confidence. This…

Machine Learning · Computer Science 2024-03-25 Rui Xu , Yue Sun , Chao Chen , Parv Venkitasubramaniam , Sihong Xie

While shrinkage is essential in high-dimensional settings, its use for low-dimensional regression-based prediction has been debated. It reduces variance, often leading to improved prediction accuracy. However, it also inevitably introduces…