English
Related papers

Related papers: Split Conformal Prediction and Non-Exchangeable Da…

200 papers

Distributed algorithms and theories are called for in this era of big data. Under weaker local signal-to-noise ratios, we improve upon the celebrated one-round distributed principal component analysis (PCA) algorithm designed in the spirit…

Methodology · Statistics 2025-07-01 ZeYu Li , Xinsheng Zhang , Wang Zhou

Conformal prediction is a statistically rigorous method for quantifying uncertainty in models by having them output sets of predictions, with larger sets indicating more uncertainty. However, prediction sets are not inherently actionable;…

Machine Learning · Computer Science 2025-02-17 Jesse C. Cresswell , Bhargava Kumar , Yi Sui , Mouloud Belbahri

In drug discovery, it is vital to confirm the predictions of pharmaceutical properties from computational models using costly wet-lab experiments. Hence, obtaining reliable uncertainty estimates is crucial for prioritizing drug molecules…

Machine Learning · Computer Science 2023-10-19 Siddhartha Laghuvarapu , Zhen Lin , Jimeng Sun

Background and objective: Uncertainty quantification is a pivotal field that contributes to realizing reliable and robust systems. It becomes instrumental in fortifying safe decisions by providing complementary information, particularly…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Jamil Fayyad , Shadi Alijani , Homayoun Najjaran

We develop a new method for generating prediction sets that combines the flexibility of conformal methods with an estimate of the conditional distribution $P_{Y \mid X}$. Existing methods, such as conformalized quantile regression and…

Machine Learning · Statistics 2024-10-10 Vincent Plassier , Alexander Fishkov , Mohsen Guizani , Maxim Panov , Eric Moulines

Conformal prediction, which makes no distributional assumptions about the data, has emerged as a powerful and reliable approach to uncertainty quantification in practical applications. The nonconformity measure used in conformal prediction…

Machine Learning · Computer Science 2024-10-15 Yuko Kato , David M. J. Tax , Marco Loog

Data-driven surrogate models offer quick approximations to complex numerical and experimental systems but typically lack uncertainty quantification, limiting their reliability in safety-critical applications. While Bayesian methods provide…

Conformal prediction (CP) can convert any model's output into prediction sets guaranteed to include the true label with any user-specified probability. However, same as the model itself, CP is vulnerable to adversarial test examples…

Machine Learning · Computer Science 2024-07-15 Soroush H. Zargarbashi , Mohammad Sadegh Akhondzadeh , Aleksandar Bojchevski

In clinical applications, the utility of segmentation models is often based on the accuracy of derived downstream metrics such as organ size, rather than by the pixel-level accuracy of the segmentation masks themselves. Thus, uncertainty…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Matt Y. Cheung , Ashok Veeraraghavan , Guha Balakrishnan

In this work, we consider the problem of building distribution-free prediction intervals with finite-sample conditional coverage guarantees. Conformal prediction (CP) is an increasingly popular framework for building such intervals with…

Methodology · Statistics 2024-10-29 Rohan Hore , Rina Foygel Barber

Conformal Predictors (CP) are wrappers around ML models, providing error guarantees under weak assumptions on the data distribution. They are suitable for a wide range of problems, from classification and regression to anomaly detection.…

Machine Learning · Computer Science 2021-10-06 Giovanni Cherubin , Konstantinos Chatzikokolakis , Martin Jaggi

Numerous studies have focused on learning and understanding the dynamics of physical systems from video data, such as spatial intelligence. Artificial intelligence requires quantitative assessments of the uncertainty of the model to ensure…

Machine Learning · Computer Science 2024-12-18 Aoming Liang , Qi Liu , Lei Xu , Fahad Sohrab , Weicheng Cui , Changhui Song , Moncef Gabbouj

Conformal Prediction (CP) is a popular framework for constructing prediction bands with valid coverage in finite samples, while being free of any distributional assumption. A well-known limitation of conformal prediction is the lack of…

Machine Learning · Computer Science 2025-05-28 Louis Allain , Sébastien da Veiga , Brian Staber

Conformal prediction can be used to construct prediction sets that cover the true outcome with a desired probability, but can sometimes lead to large prediction sets that are costly in practice. The most useful outcome is a singleton…

Machine Learning · Statistics 2026-02-05 Tao Wang , Yan Sun , Edgar Dobriban

Traditional Statistical Process Control (SPC) is essential for quality management but is limited by its reliance on often violated statistical assumptions, leading to unreliable monitoring in modern, complex manufacturing environments. This…

Machine Learning · Computer Science 2025-12-30 Christopher Burger

Conformal prediction is a distribution-free technique for establishing valid prediction intervals. Although conventionally people conduct conformal prediction in the output space, this is not the only possibility. In this paper, we propose…

Machine Learning · Computer Science 2023-04-11 Jiaye Teng , Chuan Wen , Dinghuai Zhang , Yoshua Bengio , Yang Gao , Yang Yuan

Conformal prediction provides rigorous distribution-free finite-sample guarantees for marginal coverage under the assumption of exchangeability, but may exhibit systematic undercoverage or overcoverage for specific subpopulations. Assessing…

Methodology · Statistics 2026-04-24 Zheng Zhou , Xiangfei Zhang , Chongguang Tao , Yuhong Yang

Spectral Clustering(SC) is a prominent data clustering technique of recent times which has attracted much attention from researchers. It is a highly data-driven method and makes no strict assumptions on the structure of the data to be…

Machine Learning · Computer Science 2019-09-18 Lalith Srikanth Chintalapati , Raghunatha Sarma Rachakonda

Conformal prediction is a distribution-free framework for uncertainty quantification that replaces point predictions with sets, offering marginal coverage guarantees (i.e., ensuring that the prediction sets contain the true label with a…

Machine Learning · Computer Science 2025-02-25 Margarida M. Campos , João Calém , Sophia Sklaviadis , Mário A. T. Figueiredo , André F. T. Martins

Online Conformal Prediction (CP) struggles to balance temporal adaptability and structural stability. Feedback-driven methods (e.g., Adaptive Conformal Inference (ACI)) suffer from systemic marginal under-coverage and high interval variance…

Machine Learning · Computer Science 2026-05-04 Yu-Hsueh Fang , Chia-Yen Lee