English
Related papers

Related papers: A Geometric Proof of Calibration

200 papers

Using the game-theoretic framework for probability, Vovk and Shafer. have shown that it is always possible, using randomization, to make sequential probability forecasts that pass any countable set of well-behaved statistical tests. This…

Machine Learning · Computer Science 2008-10-21 Vladimir V. V'yugin

The classical Reifenberg's theorem says that a set which is sufficiently well approximated by planes uniformly at all scales is a topological H\"older manifold. Remarkably, this generalizes to metric spaces, where the approximation by…

Metric Geometry · Mathematics 2024-06-21 Nicola Gigli , Ivan Yuri Violo

Calibrations are a possible tool to validate the minimality of a certain candidate. They have been introduced in the context of minimal surfaces and adapted to the case of Steiner problem in several variants. Our goal is to compare the…

Optimization and Control · Mathematics 2019-04-12 Marcello Carioni , Alessandra Pluda

We study a sequential binary prediction setting where the forecaster is evaluated in terms of the calibration distance, which is defined as the $L_1$ distance between the predicted values and the set of predictions that are perfectly…

Machine Learning · Computer Science 2024-05-28 Mingda Qiao , Letian Zheng

With rapid adoption of deep learning in critical applications, the question of when and how much to trust these models often arises, which drives the need to quantify the inherent uncertainties. While identifying all sources that account…

Machine Learning · Statistics 2019-11-22 Jayaraman J. Thiagarajan , Bindya Venkatesh , Prasanna Sattigeri , Peer-Timo Bremer

We propose a classification of measurement apparatuses based on their reliability and accessibility. Our notion of reliability parameterises the possibility of getting unexpected wrong results when using the apparatus in a given time…

Quantum Physics · Physics 2024-07-26 Nicola Pranzini , Paola Verrucchi

We present algorithms to compute approximations of invariant measures and its attractors for IFS and GIFS, using the deterministic algorithm in a tractable way, with code optimization strategies and use of data structures and search…

Dynamical Systems · Mathematics 2022-11-23 Rudnei D. da Cunha , Elismar R. Oliveira

In machine learning, model calibration and predictive inference are essential for producing reliable predictions and quantifying uncertainty to support decision-making. Recognizing the complementary roles of point and interval predictions,…

Machine Learning · Statistics 2024-11-01 Lars van der Laan , Ahmed M. Alaa

We revisit a fundamental result in real-time verification, namely that the binary reachability relation between configurations of a given timed automaton is definable in linear arithmetic over the integers and reals. In this paper we give a…

Logic in Computer Science · Computer Science 2017-04-20 Karin Quaas , Mahsa Shirmohammadi , James Worrell

In this article, we generalize some frequently used metrical notions such as: completeness, closedness, continuity, g-continuity and compatibility to relation-theoretic setting and utilize these relatively weaker notions to prove results on…

Functional Analysis · Mathematics 2021-09-03 Aftab Alam , Mohammad Imdad

Agentic theorem provers combine a reasoning model, retrieval, search, and a proof assistant verifier, yet it remains unclear which components actually improve finite-budget proof success and why they help on real mathematical workloads. We…

Machine Learning · Statistics 2026-05-26 Sho Sonoda , Shunta Akiyama , Yuya Uezato

This note proves a weak type of the sharpness principle as conjectured by Gneiting, Balabdaoui, and Raftery in 2007 in connection with probabilistic forecasting subject to calibration constraints. A strong version of such a principle still…

Statistics Theory · Mathematics 2009-02-03 Soumik Pal

We provide a quantitative formulation of the equivalence between hyperlinearity and soficity for amenable groups, effectively showing how every hyperlinear approximation to such a group is simulated by a suitable sofic approximation. The…

Group Theory · Mathematics 2024-01-12 Peter Burton , Maksym Chaudkhari , Kate Juschenko , Kyrylo Muliarchyk

Conformal predictors are machine learning algorithms that output prediction sets that have a guarantee of marginal validity for finite samples with minimal distributional assumptions. This is a property that makes conformal predictors…

Machine Learning · Computer Science 2021-03-03 Anthony Bellotti

Markov decision processes model systems subject to nondeterministic and probabilistic uncertainty. A plethora of verification techniques addresses variations of reachability properties, such as: Is there a scheduler resolving the…

Logic in Computer Science · Computer Science 2025-05-26 Lina Gerlach , Tobias Winkler , Erika Ábrahám , Borzoo Bonakdarpour , Sebastian Junges

Correctness proofs for floating point programs are difficult to verify. To simplify the task, a similar, but less complex system, known as logarithmic arithmetic can be used. The Boyer-Moore Theorem Prover, NQTHM, mechanically verified the…

Logic in Computer Science · Computer Science 2024-11-21 Mark G. Arnold , Thomas A. Bailey , John R. Cowles

Calibration requires predictor outputs to be consistent with their Bayesian posteriors. For machine learning predictors that do not distinguish between small perturbations, calibration errors are continuous in predictions, e.g., smooth…

Machine Learning · Computer Science 2025-04-23 Jason Hartline , Yifan Wu , Yunran Yang

By invoking quantum estimation theory we formulate bounds of errors in quantum measurement for arbitrary quantum states and observables in a finite-dimensional Hilbert space. We prove that the measurement errors of two observables satisfy…

Quantum Physics · Physics 2013-05-29 Yu Watanabe , Takahiro Sagawa , Masahito Ueda

We make two contributions to the problem of estimating the $L_1$ calibration error of a binary classifier from a finite dataset. First, we provide an upper bound for any classifier where the calibration function has bounded variation.…

Safety-critical prediction systems, such as autonomous vehicles, weather forecasters, and medical monitors, commonly rely on probabilistic forecasters. These forecasters make predictions about possible future outcomes, and their quality and…

Methodology · Statistics 2026-04-30 Romeo Valentin