English
Related papers

Related papers: How Flawed Is ECE? An Analysis via Logit Smoothing

200 papers

We investigate the calibration of large language models' (LLMs') confidence across diverse tasks. The results of our preregistered study show that the current crop of LLMs are, like people, too sure they are right: confidence exceeds…

Artificial Intelligence · Computer Science 2026-05-26 Noam Michael , Daniel BenShushan , Jacob Bien , Don A. Moore

We study the problem of entropy calibration, which asks whether a language model's entropy over generations matches its log loss on human text. Past work found that models are miscalibrated, with entropy per step increasing as generations…

Computation and Language · Computer Science 2026-01-14 Steven Cao , Gregory Valiant , Percy Liang

Computer models are commonly used to represent a wide range of real systems, but they often involve some unknown parameters. Estimating the parameters by collecting physical data becomes essential in many scientific fields, ranging from…

Applications · Statistics 2020-05-27 Chih-Li Sung , Beau David Barber , Berkley J. Walker

Recent work has shown that language models' (LMs) prompt-based learning capabilities make them well suited for automating data labeling in domains where manual annotation is expensive. The challenge is that while writing an initial prompt…

Machine Learning · Computer Science 2023-07-21 Neel Guha , Mayee F. Chen , Kush Bhatia , Azalia Mirhoseini , Frederic Sala , Christopher Ré

Calibration and validation techniques are crucial in assessing the descriptive and predictive power of car-following models and their suitability for analyzing traffic flow. Using real and generated floating-car and trajectory data, we…

Physics and Society · Physics 2014-03-21 Martin Treiber , Arne Kesting

Reliable usage of object detectors require them to be calibrated -- a crucial problem that requires careful attention. Recent approaches towards this involve (1) designing new loss functions to obtain calibrated detectors by training them…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Selim Kuzucu , Kemal Oksuz , Jonathan Sadeghi , Puneet K. Dokania

How can one meaningfully make a measurement, if the meter does not conform to any standard and its scale expands or shrinks depending on what is measured? In the present work it is argued that current evaluation practices for…

Machine Learning · Computer Science 2023-02-24 K. Dyrland , A. S. Lundervold , P. G. L. Porta Mana

The confidence calibration of deep learning-based perception models plays a crucial role in their reliability. Especially in the context of autonomous driving, downstream tasks like prediction and planning depend on accurate confidence…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Mariella Dreissig , Florian Piewak , Joschka Boedecker

This paper addresses a significant gap in explainable AI: the necessity of interpreting epistemic uncertainty in model explanations. Although current methods mainly focus on explaining predictions, with some including uncertainty, they fail…

Artificial Intelligence · Computer Science 2024-10-10 Helena Löfström , Tuwe Löfström , Johan Hallberg Szabadvary

Intuitively, unfamiliarity should lead to lack of confidence. In reality, current algorithms often make highly confident yet wrong predictions when faced with relevant but unfamiliar examples. A classifier we trained to recognize gender is…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Zhizhong Li , Derek Hoiem

Reliable confidence estimation for the predictions is important in many safety-critical applications. However, modern deep neural networks are often overconfident for their incorrect predictions. Recently, many calibration methods have been…

Machine Learning · Computer Science 2023-03-07 Fei Zhu , Zhen Cheng , Xu-Yao Zhang , Cheng-Lin Liu

Class probabilities predicted by most multiclass classifiers are uncalibrated, often tending towards over-confidence. With neural networks, calibration can be improved by temperature scaling, a method to learn a single corrective…

Machine Learning · Computer Science 2019-10-29 Meelis Kull , Miquel Perello-Nieto , Markus Kängsepp , Telmo Silva Filho , Hao Song , Peter Flach

Large Language Models (LLMs) show promise for automated grading, but their outputs can be unreliable. Rather than improving grading accuracy directly, we address a complementary problem: \textit{predicting when an LLM grader is likely to be…

Computation and Language · Computer Science 2026-04-01 Robinson Ferrer , Damla Turgut , Zhongzhou Chen , Shashank Sonkar

For many applications of probabilistic classifiers it is important that the predicted confidence vectors reflect true probabilities (one says that the classifier is calibrated). It has been shown that common models fail to satisfy this…

Machine Learning · Statistics 2022-10-10 Michael Panchenko , Anes Benmerzoug , Miguel de Benito Delgado

We give a principled method for decomposing the predictive uncertainty of a model into aleatoric and epistemic components with explicit semantics relating them to the real-world data distribution. While many works in the literature have…

Machine Learning · Computer Science 2024-12-30 Gustaf Ahdritz , Aravind Gollakota , Parikshit Gopalan , Charlotte Peale , Udi Wieder

A new modification of the minimum-contrast estimator (the weighted MCE) of drift parameter in a linear stochastic evolution equation with additive fractional noise is introduced in the setting of the spectral approach (Fourier coordinates…

Probability · Mathematics 2019-09-30 Pavel Kriz

A fundamental requirement for intelligent systems is the ability to learn continuously under changing environments. However, models trained in this regime often suffer from catastrophic forgetting. Leveraging pre-trained models has recently…

Artificial Intelligence · Computer Science 2026-03-12 Tung Tran , Danilo Vasconcellos Vargas , Khoat Than

As LLM-based judges become integral to industry applications, obtaining well-calibrated uncertainty estimates efficiently has become critical for production deployment. However, existing techniques, such as verbalized confidence and…

Machine Learning · Computer Science 2025-12-30 Bhaktipriya Radharapu , Eshika Saxena , Kenneth Li , Chenxi Whitehouse , Adina Williams , Nicola Cancedda

Calibration is a popular framework to evaluate whether a classifier knows when it does not know - i.e., its predictive probabilities are a good indication of how likely a prediction is to be correct. Correctness is commonly estimated…

Computation and Language · Computer Science 2022-12-01 Joris Baan , Wilker Aziz , Barbara Plank , Raquel Fernández

The key factor in implementing machine learning algorithms in decision-making situations is not only the accuracy of the model but also its confidence level. The confidence level of a model in a classification problem is often given by the…

Machine Learning · Statistics 2024-05-02 Masanari Kimura , Hiroki Naganuma