English
Related papers

Related papers: Stronger Calibration Lower Bounds via Sidestepping

200 papers

In the subspace sketch problem one is given an $n\times d$ matrix $A$ with $O(\log(nd))$ bit entries, and would like to compress it in an arbitrary way to build a small space data structure $Q_p$, so that for any given $x \in \mathbb{R}^d$,…

Data Structures and Algorithms · Computer Science 2019-10-15 Yi Li , Ruosong Wang , David P. Woodruff

In next-generation communications and networks, machine learning (ML) models are expected to deliver not only accurate predictions but also well-calibrated confidence scores that reflect the true likelihood of correct decisions. This paper…

Machine Learning · Statistics 2025-11-21 Rashika Raina , Nidhi Simmons , David E. Simmons , Michel Daoud Yacoub , Trung Q. Duong

ML-based predictions are used to inform consequential decisions about individuals. How should we use predictions (e.g., risk of heart attack) to inform downstream binary classification decisions (e.g., undergoing a medical procedure)? When…

Machine Learning · Computer Science 2022-03-21 Guy N. Rothblum , Gal Yona

Research has shown that deep networks tend to be overly optimistic about their predictions, leading to an underestimation of prediction errors. Due to the limited nature of data, existing studies have proposed various methods based on model…

Machine Learning · Computer Science 2023-10-24 Jia-Qi Yang , De-Chuan Zhan , Le Gan

In the model of online caching with machine learned advice, introduced by Lykouris and Vassilvitskii, the goal is to solve the caching problem with an online algorithm that has access to next-arrival predictions: when each input element…

Data Structures and Algorithms · Computer Science 2019-10-31 Dhruv Rohatgi

A decision-theoretic characterization of perfect calibration is that an agent seeking to minimize a proper loss in expectation cannot improve their outcome by post-processing a perfectly calibrated predictor. Hu and Wu (FOCS'24) use this to…

Machine Learning · Computer Science 2025-11-18 Parikshit Gopalan , Konstantinos Stavropoulos , Kunal Talwar , Pranay Tankala

We propose a novel method for selective classification (SC), a problem which allows a classifier to abstain from predicting some instances, thus trading off accuracy against coverage (the fraction of instances predicted). In contrast to…

Machine Learning · Computer Science 2021-10-26 Aditya Gangrade , Anil Kag , Venkatesh Saligrama

Conformal prediction has emerged as an effective strategy for uncertainty quantification by modifying a model to output sets of labels instead of a single label. These prediction sets come with the guarantee that they contain the true label…

Machine Learning · Computer Science 2025-05-28 Haosen Ge , Hamsa Bastani , Osbert Bastani

AI generated predictions increasingly inform decision making in critical tasks, and therefore must be trustworthy. One widely used measure of trustworthiness is calibration, which requires that the predictions match the true frequencies and…

Machine Learning · Computer Science 2026-05-19 Konstantina Bairaktari , Lunjia Hu , Huy L. Nguyen , Jonathan Ullman

A fundamental tool in network information theory is the covering lemma, which lower bounds the probability that there exists a pair of random variables, among a give number of independently generated candidates, falling within a given set.…

Information Theory · Computer Science 2019-04-18 Jingbo Liu , Mohammad H. Yassaee , Sergio Verdú

We present a more general analysis of $H$-calibration for adversarially robust classification. By adopting a finer definition of calibration, we can cover settings beyond the restricted hypothesis sets studied in previous work. In…

Machine Learning · Computer Science 2021-05-07 Pranjal Awasthi , Anqi Mao , Mehryar Mohri , Yutao Zhong

In many sequential decision making applications, the change of decision would bring an additional cost, such as the wear-and-tear cost associated with changing server status. To control the switching cost, we introduce the problem of online…

Machine Learning · Computer Science 2021-03-23 Guanghui Wang , Yuanyu Wan , Tianbao Yang , Lijun Zhang

We study sequential prediction of real-valued, arbitrary and unknown sequences under the squared error loss as well as the best parametric predictor out of a large, continuous class of predictors. Inspired by recent results from…

Machine Learning · Computer Science 2014-01-24 N. Denizcan Vanli , Suleyman S. Kozat

Reliable long-horizon value prediction is difficult in offline reinforcement learning because fitted value methods combine bootstrapping, function approximation, and distribution shift, while standard guarantees often require Bellman…

Machine Learning · Statistics 2026-05-11 Lars van der Laan , Nathan Kallus

We give a randomized online algorithm that guarantees near-optimal $\widetilde O(\sqrt T)$ expected swap regret against any sequence of $T$ adaptively chosen Lipschitz convex losses on the unit interval. This improves the previous best…

Machine Learning · Computer Science 2026-02-10 Lunjia Hu , Jon Schneider , Yifan Wu

While the accuracy of modern deep learning models has significantly improved in recent years, the ability of these models to generate uncertainty estimates has not progressed to the same degree. Uncertainty methods are designed to provide…

Machine Learning · Statistics 2020-06-17 Adam M. Oberman , Chris Finlay , Alexander Iannantuono , Tiago Salvador

Many studies have observed that modern neural networks achieve high accuracy while producing poorly calibrated probabilities, making calibration a critical practical issue. In this work, we propose probability bounding (PB), a novel…

Machine Learning · Statistics 2026-02-24 Kyohei Atarashi , Satoshi Oyama , Hiromi Arai , Hisashi Kashima

The field of algorithms with predictions incorporates machine learning advice in the design of online algorithms to improve real-world performance. A central consideration is the extent to which predictions can be trusted -- while existing…

Machine Learning · Statistics 2026-03-26 Judy Hanwen Shen , Ellen Vitercik , Anders Wikum

In two-player zero-sum games, the learning dynamic based on optimistic Hedge achieves one of the best-known regret upper bounds among strongly-uncoupled learning dynamics. With an appropriately chosen learning rate, the social and…

Machine Learning · Computer Science 2025-10-14 Taira Tsuchiya

We consider non-convex stochastic optimization using first-order algorithms for which the gradient estimates may have heavy tails. We show that a combination of gradient clipping, momentum, and normalized gradient descent yields convergence…

Machine Learning · Computer Science 2021-11-10 Ashok Cutkosky , Harsh Mehta