English
Related papers

Related papers: Calibrating Expressions of Certainty

200 papers

A set of probabilistic predictions is well calibrated if the events that are predicted to occur with probability p do in fact occur about p fraction of the time. Well calibrated predictions are particularly important when machine learning…

Machine Learning · Statistics 2014-01-14 Mahdi Pakdaman Naeini , Gregory F. Cooper , Milos Hauskrecht

The correct use and interpretation of models depends on several steps, two of which being the calibration by parameter estimation and the analysis of uncertainty. In the biological literature, these steps are seldom discussed together, but…

Quantitative Methods · Quantitative Biology 2015-08-17 André Chalom , Paulo Inácio de Knegt López de Prado

Calibration is central to reliable semantic uncertainty quantification, yet prior work has largely focused on discrimination, neglecting calibration. As calibration and discrimination capture distinct aspects of uncertainty, focusing on…

Machine Learning · Computer Science 2026-04-09 Tom A. Lamb , Desi R. Ivanova , Philip H. S. Torr , Tim G. J. Rudner

Machine-generated probability predictions are essential in modern classification tasks such as image classification. A model is well calibrated when its predicted probabilities correspond to observed event frequencies. Despite the need for…

Machine Learning · Statistics 2026-02-24 Amy Vennos , Xin Xing , Christopher T. Franck

Model misspecification is a long-standing enigma of the Bayesian inference framework as posteriors tend to get overly concentrated on ill-informed parameter values towards the large sample limit. Tempering of the likelihood has been…

Methodology · Statistics 2019-12-13 Owen Thomas , Jukka Corander

Large Language Models (LLMs) are increasingly used as powerful tools for several high-stakes natural language processing (NLP) applications. Recent prompting works claim to elicit intermediate reasoning steps and key tokens that serve as…

Computation and Language · Computer Science 2023-11-08 Sree Harsha Tanneru , Chirag Agarwal , Himabindu Lakkaraju

Language models are known to produce vague and generic outputs. We propose two unsupervised decoding strategies based on either word-frequency or point-wise mutual information to increase the specificity of any model that outputs a…

Computation and Language · Computer Science 2021-10-25 Katy Ilonka Gero , Chris Kedzie , Savvas Petridis , Lydia Chilton

There is substantial variability in the expectations that communication partners bring into interactions, creating the potential for misunderstandings. To directly probe these gaps and our ability to overcome them, we propose a…

Computation and Language · Computer Science 2022-04-28 Sonia K. Murthy , Thomas L. Griffiths , Robert D. Hawkins

Survival analysis deals with modeling the time until an event occurs, and accurate probability estimates are crucial for decision-making, particularly in the competing-risks setting where multiple events are possible. While recent work has…

Methodology · Statistics 2026-02-03 Julie Alberge , Tristan Haugomat , Gaël Varoquaux , Judith Abécassis

Large Language Models are known to capture real-world knowledge, allowing them to excel in many downstream tasks. Despite recent advances, these models are still prone to what are commonly known as hallucinations, causing them to emit…

Machine Learning · Computer Science 2024-12-10 Roi Cohen , Konstantin Dobler , Eden Biran , Gerard de Melo

Probabilistic forecasting estimates the likelihood of uncertain future events. To improve LLM forecasting, existing methods typically learn from binary outcomes to output verbalized forecasts. However, while aggregated human forecasts…

Machine Learning · Computer Science 2026-05-28 Hui Dai , Ryan Teehan , Parsa Torabian , Mengye Ren

This paper addresses the challenge of probabilistic parameter estimation given measurement uncertainty in real-time. We provide a general formulation and apply this to pose estimation for an autonomous visual landing system. We present…

Modern neural networks have found to be miscalibrated in terms of confidence calibration, i.e., their predicted confidence scores do not reflect the observed accuracy or precision. Recent work has introduced methods for post-hoc confidence…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Fabian Küppers , Jan Kronenberger , Jonas Schneider , Anselm Haselhoff

Overconfidence and underconfidence in machine learning classifiers is measured by calibration: the degree to which the probabilities predicted for each class match the accuracy of the classifier on that prediction. How one measures…

Machine Learning · Computer Science 2020-08-11 Jeremy Nixon , Mike Dusenberry , Ghassen Jerfel , Timothy Nguyen , Jeremiah Liu , Linchuan Zhang , Dustin Tran

Classifier calibration has received recent attention from the machine learning community due both to its practical utility in facilitating decision making, as well as the observation that modern neural network classifiers are poorly…

Machine Learning · Computer Science 2022-05-24 John Kirchenbauer , Jacob Oaks , Eric Heim

Calibration$\unicode{x2014}$the problem of ensuring that predicted probabilities align with observed class frequencies$\unicode{x2014}$is a basic desideratum for reliable prediction with machine learning systems. Calibration error is…

Machine Learning · Statistics 2026-03-02 Eugène Berta , Sacha Braun , David Holzmüller , Francis Bach , Michael I. Jordan

A suitable scalar metric can help measure multi-calibration, defined as follows. When the expected values of observed responses are equal to corresponding predicted probabilities, the probabilistic predictions are known as "perfectly…

Methodology · Statistics 2026-04-17 Ido Guy , Daniel Haimovich , Fridolin Linder , Nastaran Okati , Lorenzo Perini , Niek Tax , Mark Tygert

In a sequential regression setting, a decision-maker may be primarily concerned with whether the future observation will increase or decrease compared to the current one, rather than the actual value of the future observation. In this…

Machine Learning · Computer Science 2023-06-09 Youngseog Chung , Aaron Rumack , Chirag Gupta

We study the empirical likelihood approach to construct confidence intervals for the optimal value and the optimality gap of a given solution, henceforth quantify the statistical uncertainty of sample average approximation, for optimization…

Methodology · Statistics 2016-10-25 Henry Lam , Enlu Zhou

We provide another look at the statistical calibration problem in computer models. This viewpoint is inspired by two overarching practical considerations of computer models: (i) many computer models are inadequate for perfectly modeling…

Methodology · Statistics 2018-09-26 Xiaowu Dai , Peter Chien