English
Related papers

Related papers: When Does Optimizing a Proper Loss Yield Calibrati…

200 papers

We consider the problem of evaluating forecasts of binary events whose predictions are consumed by rational agents who take an action in response to a prediction, but whose utility is unknown to the forecaster. We show that optimizing…

Machine Learning · Computer Science 2023-07-04 Robert Kleinberg , Renato Paes Leme , Jon Schneider , Yifeng Teng

Efficient global optimization is the problem of minimizing an unknown function f, using as few evaluations f(x) as possible. It can be considered as a continuum-armed bandit problem, with noiseless data and simple regret. Expected…

Machine Learning · Statistics 2013-02-19 Adam D. Bull

The study of a machine learning problem is in many ways is difficult to separate from the study of the loss function being used. One avenue of inquiry has been to look at these loss functions in terms of their properties as scoring rules…

Machine Learning · Computer Science 2022-09-02 Zac Cranko , Robert C. Williamson , Richard Nock

Given a prediction task, understanding when one can and cannot design a consistent convex surrogate loss, particularly a low-dimensional one, is an important and active area of machine learning research. The prediction task may be given as…

Machine Learning · Computer Science 2021-02-17 Jessie Finocchiaro , Rafael Frongillo , Bo Waggoner

To design algorithms that reduce communication cost or meet rate constraints and are robust to communication noise, we study convex distributed optimization problems where a set of agents are interested in solving a separable optimization…

Optimization and Control · Mathematics 2023-05-02 Hadi Reisizadeh , Anand Gokhale , Behrouz Touri , Soheil Mohajer

While the performance of machine learning systems has experienced significant improvement in recent years, relatively little attention has been paid to the fundamental question: to what extent can we improve our models? This paper provides…

Machine Learning · Computer Science 2026-05-13 Ryota Ushio , Takashi Ishida , Masashi Sugiyama

The regret bound of an optimization algorithms is one of the basic criteria for evaluating the performance of the given algorithm. By inspecting the differences between the regret bounds of traditional algorithms and adaptive one, we…

Machine Learning · Statistics 2017-07-07 HyoungSeok Kim , JiHoon Kang , WooMyoung Park , SukHyun Ko , YoonHo Cho , DaeSung Yu , YoungSook Song , JungWon Choi

Calibration means that forecasts and average realized frequencies are close. We develop the concept of forecast hedging, which consists of choosing the forecasts so as to guarantee that the expected track record can only improve. This…

Theoretical Economics · Economics 2022-10-14 Dean P. Foster , Sergiu Hart

In many machine learning applications, it is important for the model to provide confidence scores that accurately capture its prediction uncertainty. Although modern learning methods have achieved great success in predictive accuracy,…

Machine Learning · Computer Science 2022-07-12 Linjun Zhang , Zhun Deng , Kenji Kawaguchi , James Zou

Methods for reasoning under uncertainty are a key building block of accurate and reliable machine learning systems. Bayesian methods provide a general framework to quantify uncertainty. However, because of model misspecification and the use…

Machine Learning · Computer Science 2018-07-03 Volodymyr Kuleshov , Nathan Fenner , Stefano Ermon

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban

The question of what can be computed, and how efficiently, are at the core of computer science. Not surprisingly, in distributed systems and networking research, an equally fundamental question is what can be computed in a…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-01 Fabian Kuhn , Thomas Moscibroda , Roger Wattenhofer

We study problem-dependent rates, i.e., generalization errors that scale near-optimally with the variance, the effective loss, or the gradient norms evaluated at the "best hypothesis." We introduce a principled framework dubbed "uniform…

Machine Learning · Statistics 2020-12-25 Yunbei Xu , Assaf Zeevi

In safety-critical applications a probabilistic model is usually required to be calibrated, i.e., to capture the uncertainty of its predictions accurately. In multi-class classification, calibration of the most confident predictions only is…

Machine Learning · Statistics 2022-09-30 David Widmann , Fredrik Lindsten , Dave Zachariah

A statistical model is said to be calibrated if the resulting mean estimates perfectly match the true means of the underlying responses. Aiming for calibration is often not achievable in practice as one has to deal with finite samples of…

Statistics Theory · Mathematics 2026-01-13 Łukasz Delong , Selim Gatti , Mario V. Wüthrich

Being cautious is crucial for enhancing the trustworthiness of machine learning systems integrated into decision-making pipelines. Although calibrated probabilities help in optimal decision-making, perfect calibration remains unattainable,…

Machine Learning · Computer Science 2024-08-12 Mari-Liis Allikivi , Joonas Järve , Meelis Kull

In recent papers it has been noted that the local potential approximation of the Legendre and Wilson-Polchinski flow equations give, within numerical error, identical results for a range of exponents and Wilson-Fisher fixed points in three…

High Energy Physics - Theory · Physics 2009-11-11 Tim R. Morris

Batch policy optimization considers leveraging existing data for policy construction before interacting with an environment. Although interest in this problem has grown significantly in recent years, its theoretical foundations remain…

Machine Learning · Computer Science 2021-04-07 Chenjun Xiao , Yifan Wu , Tor Lattimore , Bo Dai , Jincheng Mei , Lihong Li , Csaba Szepesvari , Dale Schuurmans

Deep neural networks (DNN) are prone to miscalibrated predictions, often exhibiting a mismatch between the predicted output and the associated confidence scores. Contemporary model calibration techniques mitigate the problem of…

Machine Learning · Computer Science 2022-12-21 Ramya Hebbalaguppe , Rishabh Patra , Tirtharaj Dash , Gautam Shroff , Lovekesh Vig

Pre-trained Transformers are now ubiquitous in natural language processing, but despite their high end-task performance, little is known empirically about whether they are calibrated. Specifically, do these models' posterior probabilities…

Computation and Language · Computer Science 2020-10-16 Shrey Desai , Greg Durrett