English
Related papers

Related papers: Kpop: A kernel balancing approach for reducing spe…

200 papers

When facing uncertainty, decision-makers want predictions they can trust. A machine learning provider can convey confidence to decision-makers by guaranteeing their predictions are distribution calibrated -- amongst the inputs that receive…

Machine Learning · Statistics 2021-07-14 Shengjia Zhao , Michael P. Kim , Roshni Sahoo , Tengyu Ma , Stefano Ermon

Calibrated probabilistic classifiers are models whose predicted probabilities can directly be interpreted as uncertainty estimates. It has been shown recently that deep neural networks are poorly calibrated and tend to output overconfident…

Machine Learning · Statistics 2022-10-17 Teodora Popordanoska , Raphael Sayer , Matthew B. Blaschko

Conventional vision algorithms adopt a single type of feature or a simple concatenation of multiple features, which is always represented in a high-dimensional space. In this paper, we propose a novel unsupervised spectral embedding…

Computer Vision and Pattern Recognition · Computer Science 2015-08-05 Mengyang Yu , Li Liu , Ling Shao

Trustworthy classifiers are essential to the adoption of machine learning predictions in many real-world settings. The predicted probability of possible outcomes can inform high-stakes decision making, particularly when assessing the…

Machine Learning · Computer Science 2023-02-22 Kiri L. Wagstaff , Thomas G. Dietterich

Well-calibrated predictions of user preferences are essential for many applications. Since recommender systems typically select the top-N items for users, calibration for those top-N items, rather than for all items, is important. We show…

Information Retrieval · Computer Science 2024-08-22 Masahiro Sato

Kernel balancing weights provide confidence intervals for average treatment effects, based on the idea of balancing covariates for the treated group and untreated group in feature space, often with ridge regularization. Previous works on…

Machine Learning · Statistics 2024-07-08 Rahul Singh

In real supervised learning scenarios, it is not uncommon that the training and test sample follow different probability distributions, thus rendering the necessity to correct the sampling bias. Focusing on a particular covariate shift…

Machine Learning · Computer Science 2012-06-22 Yaoliang Yu , Csaba Szepesvari

Quantum machine learning seeks to leverage quantum computers to improve upon classical machine learning algorithms. Currently, robust uncertainty quantification methods remain underdeveloped in the quantum domain, despite the critical need…

Machine Learning · Computer Science 2026-05-18 Douglas Spencer , Samual Nicholls , Michele Caprio

We present simple, user-friendly bounds for the expected operator norm of a random kernel matrix under general conditions on the kernel function $k(\cdot,\cdot)$. Our approach uses decoupling results for U-statistics and the non-commutative…

Machine Learning · Statistics 2025-11-07 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

Accurate quantification of uncertainty is crucial for real-world applications of machine learning. However, modern deep neural networks still produce unreliable predictive uncertainty, often yielding over-confident predictions. In this…

Machine Learning · Computer Science 2020-10-29 Peng Cui , Wenbo Hu , Jun Zhu

Conformal prediction (CP) is a distribution-free method to construct reliable prediction intervals that has gained significant attention in recent years. Despite its success and various proposed extensions, a significant practical feature…

Statistics Theory · Mathematics 2026-02-02 Louis Allain , Sébastien Da Veiga , Brian Staber

In safety-critical applications a probabilistic model is usually required to be calibrated, i.e., to capture the uncertainty of its predictions accurately. In multi-class classification, calibration of the most confident predictions only is…

Machine Learning · Statistics 2022-09-30 David Widmann , Fredrik Lindsten , Dave Zachariah

Incorporating the auxiliary information into the survey estimation is a fundamental problem in survey sampling. Calibration weighting is a popular tool for incorporating the auxiliary information. The calibration weighting method of Deville…

Methodology · Statistics 2025-05-13 Yonghyun Kwon , Jae Kwang Kim , Yumou Qiu

The use of mathematical models to make predictions about tumor growth and response to treatment has become increasingly more prevalent in the clinical setting. The level of complexity within these models ranges broadly, and the calibration…

Quantitative Methods · Quantitative Biology 2021-12-28 Allison L. Lewis , Kathleen M. Storey , Heyrim Cho , Anna C. Zittle

Averaging provides an alternative to bandwidth selection for density kernel estimation. We propose a procedure to combine linearly several kernel estimators of a density obtained from different, possibly data-driven, bandwidths. The method…

Statistics Theory · Mathematics 2019-11-05 O. Chernova , F. Lavancier , P. Rochet

Calibration is a well-studied property of predictors which guarantees meaningful uncertainty estimates. Multicalibration is a related notion -- originating in algorithmic fairness -- which requires predictors to be simultaneously calibrated…

Machine Learning · Computer Science 2024-11-06 Dutch Hansen , Siddartha Devic , Preetum Nakkiran , Vatsal Sharan

Bayesian predictive inference analyzes a dataset to make predictions about new observations. When a model does not match the data, predictive accuracy suffers. We develop population empirical Bayes (POP-EB), a hierarchical framework that…

Machine Learning · Statistics 2015-06-10 Alp Kucukelbir , David M. Blei

Modern software-defined networks, such as Open Radio Access Network (O-RAN) systems, rely on artificial intelligence (AI)-powered applications running on controllers interfaced with the radio access network. To ensure that these AI…

Signal Processing · Electrical Eng. & Systems 2025-02-06 Seonghoon Yoo , Sangwoo Park , Petar Popovski , Joonhyuk Kang , Osvaldo Simeone

Calibration$\unicode{x2014}$the problem of ensuring that predicted probabilities align with observed class frequencies$\unicode{x2014}$is a basic desideratum for reliable prediction with machine learning systems. Calibration error is…

Machine Learning · Statistics 2026-03-02 Eugène Berta , Sacha Braun , David Holzmüller , Francis Bach , Michael I. Jordan

A suitable scalar metric can help measure multi-calibration, defined as follows. When the expected values of observed responses are equal to corresponding predicted probabilities, the probabilistic predictions are known as "perfectly…

Methodology · Statistics 2026-04-17 Ido Guy , Daniel Haimovich , Fridolin Linder , Nastaran Okati , Lorenzo Perini , Niek Tax , Mark Tygert