English
Related papers

Related papers: On the Distance from Calibration in Sequential Pre…

200 papers

We give a randomized online algorithm that guarantees near-optimal $\widetilde O(\sqrt T)$ expected swap regret against any sequence of $T$ adaptively chosen Lipschitz convex losses on the unit interval. This improves the previous best…

Machine Learning · Computer Science 2026-02-10 Lunjia Hu , Jon Schneider , Yifan Wu

A recent line of work has shown a surprising connection between multicalibration, a multi-group fairness notion, and omniprediction, a learning paradigm that provides simultaneous loss minimization guarantees for a large family of loss…

Machine Learning · Computer Science 2023-07-19 Sumegha Garg , Christopher Jung , Omer Reingold , Aaron Roth

A long noted difficulty when assessing the reliability (or calibration) of forecasting systems is that reliability, in general, is a hypothesis not about a finite dimensional parameter but about an entire functional relationship. A…

Data Analysis, Statistics and Probability · Physics 2020-12-09 Jochen Bröcker

Confidence calibration of classification models is a technique to estimate the true posterior probability of the predicted class, which is critical for ensuring reliable decision-making in practical applications. Existing confidence…

Methodology · Statistics 2025-02-19 Jinzong Dong , Zhaohui Jiang , Dong Pan , Haoyang Yu

We make two contributions to the problem of estimating the $L_1$ calibration error of a binary classifier from a finite dataset. First, we provide an upper bound for any classifier where the calibration function has bounded variation.…

We study calibeating, the problem of post-processing external forecasts online to minimize cumulative losses and match an informativeness-based benchmark. Unlike prior work, which analyzed calibeating for specific losses with specific…

Machine Learning · Computer Science 2026-03-24 Yurong Chen , Zhiyi Huang , Michael I. Jordan , Haipeng Luo

We initiate the study of the truthfulness of calibration measures in sequential prediction. A calibration measure is said to be truthful if the forecaster (approximately) minimizes the expected penalty by predicting the conditional…

Machine Learning · Computer Science 2024-11-22 Nika Haghtalab , Mingda Qiao , Kunhe Yang , Eric Zhao

We consider the problem of online multiclass U-calibration, where a forecaster aims to make sequential distributional predictions over $K$ classes with low U-calibration error, that is, low regret with respect to all bounded proper losses…

Machine Learning · Statistics 2024-05-31 Haipeng Luo , Spandan Senapati , Vatsal Sharan

Calibration has emerged as a foundational goal in ``trustworthy machine learning'', in part because of its strong decision theoretic semantics. Independent of the underlying distribution, and independent of the decision maker's utility…

Machine Learning · Statistics 2025-10-28 Shayan Kiyani , Hamed Hassani , George Pappas , Aaron Roth

Contextual optimization, also known as predict-then-optimize or prescriptive analytics, considers an optimization problem with the presence of covariates (context or side information). The goal is to learn a prediction model (from the…

Optimization and Control · Mathematics 2024-05-13 Chunlin Sun , Linyu Liu , Xiaocheng Li

Machine learning applications often require calibrated predictions, e.g. a 90\% credible interval should contain the true outcome 90\% of the times. However, typical definitions of calibration only require this to hold on average, and offer…

Machine Learning · Statistics 2020-09-10 Shengjia Zhao , Tengyu Ma , Stefano Ermon

Calibration measures quantify how much a forecaster's predictions violates calibration, which requires that forecasts are unbiased conditioning on the forecasted probabilities. Two important desiderata for a calibration measure are its…

Machine Learning · Computer Science 2025-03-05 Mingda Qiao , Eric Zhao

A machine learning model is calibrated if its predicted probability for an outcome matches the observed frequency for that outcome conditional on the model prediction. This property has become increasingly important as the impact of machine…

Machine Learning · Computer Science 2025-02-25 Muthu Chidambaram , Rong Ge

We prove tight lower bounds for online multicalibration, establishing an information-theoretic separation from marginal calibration. In the general setting where group functions can depend on both context and the learner's predictions, we…

Machine Learning · Computer Science 2026-04-27 Natalie Collina , Jiuyao Lu , Georgy Noarov , Aaron Roth

Reliable long-horizon value prediction is difficult in offline reinforcement learning because fitted value methods combine bootstrapping, function approximation, and distribution shift, while standard guarantees often require Bellman…

Machine Learning · Statistics 2026-05-11 Lars van der Laan , Nathan Kallus

In next-generation communications and networks, machine learning (ML) models are expected to deliver not only accurate predictions but also well-calibrated confidence scores that reflect the true likelihood of correct decisions. This paper…

Machine Learning · Statistics 2025-11-21 Rashika Raina , Nidhi Simmons , David E. Simmons , Michel Daoud Yacoub , Trung Q. Duong

Calibration requires that predictions are conditionally unbiased and, therefore, reliably interpretable as probabilities. A calibration measure quantifies how far a predictor is from perfect calibration. As introduced by Haghtalab et al.…

Machine Learning · Computer Science 2026-05-06 Jason Hartline , Lunjia Hu , Yifan Wu

Survival prediction often involves estimating the time-to-event distribution from censored datasets. Previous approaches have focused on enhancing discrimination and marginal calibration. In this paper, we highlight the significance of…

Machine Learning · Computer Science 2025-03-25 Shi-ang Qi , Yakun Yu , Russell Greiner

We study unconstrained Online Linear Optimization with Lipschitz losses. Motivated by the pursuit of instance optimality, we propose a new algorithm that simultaneously achieves ($i$) the AdaGrad-style second order gradient adaptivity; and…

Machine Learning · Computer Science 2024-02-23 Zhiyu Zhang , Heng Yang , Ashok Cutkosky , Ioannis Ch. Paschalidis

In online (sequential) calibration, a forecaster predicts probability distributions over a finite outcome space $[d]$ over a sequence of $T$ days, with the goal of being calibrated. While asymptotically calibrated strategies are known to…

Machine Learning · Computer Science 2025-04-15 Binghui Peng