English
Related papers

Related papers: Improving Uncertainty Quantification of Deep Class…

200 papers

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

Conformal prediction is a framework that provides valid uncertainty quantification for general models with exchangeable data. However, in the online learning and time-series settings, exchangeability is not satisfied. Existing online…

Machine Learning · Computer Science 2026-05-11 Yuheng Lai , Garvesh Raskutti

In high-stakes scenarios, such as medical imaging applications, it is critical to equip the predictions of a regression model with reliable confidence intervals. Recently, Conformal Prediction (CP) has emerged as a powerful statistical…

Machine Learning · Computer Science 2025-09-19 Yahav Cohen , Jacob Goldberger , Tom Tirer

Conformal prediction (CP) quantifies the uncertainty of machine learning models by constructing sets of plausible outputs. These sets are constructed by leveraging a so-called conformity score, a quantity computed using the input point of…

Machine Learning · Statistics 2025-02-07 Michal Klein , Louis Bethune , Eugene Ndiaye , Marco Cuturi

Conformal prediction (CP) provides finite-sample, distribution-free marginal coverage, but standard conformal regression intervals can be inefficient under heteroscedasticity and skewness. In particular, popular constructions such as…

Machine Learning · Statistics 2026-03-03 Xiaoyi Su , Zhixin Zhou , Rui Luo

A reliable representation of uncertainty is essential for the application of modern machine learning methods in safety-critical settings. In this regard, the use of credal sets (i.e., convex sets of probability distributions) has recently…

Machine Learning · Computer Science 2026-03-10 Paul Hofman , Timo Löhr , Maximilian Muschalik , Yusuf Sale , Eyke Hüllermeier

Hyperspectral image (HSI) classification involves assigning unique labels to each pixel to identify various land cover categories. While deep classifiers have achieved high predictive accuracy in this field, they lack the ability to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Kangdao Liu , Tianhao Sun , Hao Zeng , Yongshan Zhang , Chi-Man Pun , Chi-Man Vong

A typical desideratum for quantifying the uncertainty from a classification model as a prediction set is class-conditional singleton set calibration. That is, such sets should map to the output of well-calibrated selective classifiers,…

Machine Learning · Computer Science 2022-12-02 Allen Schmaltz , Danielle Rasooly

The proliferation of Deep Neural Networks has resulted in machine learning systems becoming increasingly more present in various real-world applications. Consequently, there is a growing demand for highly reliable models in many domains,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Pedro Conde , Rui L. Lopes , Cristiano Premebida

Deploying trustworthy AI systems requires principled uncertainty quantification. Conformal prediction (CP) is a widely used framework for constructing prediction sets with distribution-free coverage guarantees. In many practical settings,…

Machine Learning · Computer Science 2026-03-18 Haifeng Wen , Osvaldo Simeone , Hong Xing

Conformal prediction (CP) provides a framework for constructing prediction sets with guaranteed coverage, assuming exchangeable data. However, real-world scenarios often involve distribution shifts that violate exchangeability, leading to…

Machine Learning · Computer Science 2025-05-27 Shadi Alijani , Homayoun Najjaran

The use of Deep Neural Network (DNN) models in risk-based decision-making has attracted extensive attention with broad applications in medical, finance, manufacturing, and quality control. To mitigate prediction-related risks in decision…

Machine Learning · Statistics 2023-10-11 Maryam Kheirandish , Shengfan Zhang , Donald G. Catanzaro , Valeriu Crudu

Accurate drug-target interaction (DTI) prediction with machine learning models is essential for drug discovery. Such models should also provide a credible representation of their uncertainty, but applying classical marginal conformal…

Machine Learning · Computer Science 2025-05-27 Morteza Rakhshaninejad , Mira Jurgens , Nicolas Dewolf , Willem Waegeman

Conformal prediction (CP) has been a popular method for uncertainty quantification because it is distribution-free, model-agnostic, and theoretically sound. For forecasting problems in supervised learning, most CP methods focus on building…

Machine Learning · Statistics 2024-05-24 Chen Xu , Hanyang Jiang , Yao Xie

As we move away from the data, the predictive uncertainty should increase, since a great variety of explanations are consistent with the little available information. We introduce Distance-Aware Prior (DAP) calibration, a method to correct…

Machine Learning · Statistics 2022-07-19 Gianluca Detommaso , Alberto Gasparin , Andrew Wilson , Cedric Archambeau

The wide adoption of Convolutional Neural Networks (CNNs) in applications where decision-making under uncertainty is fundamental, has brought a great deal of attention to the ability of these models to accurately quantify the uncertainty in…

Machine Learning · Statistics 2018-05-29 Gia-Lac Tran , Edwin V. Bonilla , John P. Cunningham , Pietro Michiardi , Maurizio Filippone

Deep neural network (DNN) classifiers are often overconfident, producing miscalibrated class probabilities. In high-risk applications like healthcare, practitioners require $\textit{fully calibrated}$ probability predictions for…

Machine Learning · Statistics 2022-12-09 Zhen Lin , Shubhendu Trivedi , Jimeng Sun

The modern pervasiveness of large-scale deep neural networks (NNs) is driven by their extraordinary performance on complex problems but is also plagued by their sudden, unexpected, and often catastrophic failures, particularly on…

Machine Learning · Computer Science 2023-08-02 Sadhana Lolla , Iaroslav Elistratov , Alejandro Perez , Elaheh Ahmadi , Daniela Rus , Alexander Amini

Conformal prediction (CP) converts any model's output to prediction sets with a guarantee to cover the true label with (adjustable) high probability. Robust CP extends this guarantee to worst-case (adversarial) inputs. Existing baselines…

Machine Learning · Computer Science 2025-03-10 Soroush H. Zargarbashi , Aleksandar Bojchevski

Modern software-defined networks, such as Open Radio Access Network (O-RAN) systems, rely on artificial intelligence (AI)-powered applications running on controllers interfaced with the radio access network. To ensure that these AI…

Signal Processing · Electrical Eng. & Systems 2025-02-06 Seonghoon Yoo , Sangwoo Park , Petar Popovski , Joonhyuk Kang , Osvaldo Simeone