English
Related papers

Related papers: Calibration Across Layers: Understanding Calibrati…

200 papers

One of the key technologies for the success of Large Language Models (LLMs) is preference alignment. However, a notable side effect of preference alignment is poor calibration: while the pre-trained models are typically well-calibrated,…

Machine Learning · Computer Science 2025-10-17 Jiancong Xiao , Bojian Hou , Zhanliang Wang , Ruochen Jin , Qi Long , Weijie J. Su , Li Shen

The advent of pre-trained language models (PLMs) has enabled significant performance gains in the field of natural language processing. However, recent studies have found PLMs to suffer from miscalibration, indicating a lack of accuracy in…

Computation and Language · Computer Science 2024-12-23 Geetanjali Bihani , Julia Rayz

Miscalibration in Large Language Models (LLMs) undermines their reliability, highlighting the need for accurate confidence estimation. We introduce CCPS (Calibrating LLM Confidence by Probing Perturbed Representation Stability), a novel…

Multilingual pre-trained Large Language Models (LLMs) are incredibly effective at Question Answering (QA), a core task in Natural Language Understanding, achieving high accuracies on several multilingual benchmarks. However, little is known…

Computation and Language · Computer Science 2024-04-16 Yahan Yang , Soham Dan , Dan Roth , Insup Lee

Accurate estimation of predictive uncertainty (model calibration) is essential for the safe application of neural networks. Many instances of miscalibration in modern neural networks have been reported, suggesting a trend that newer, more…

Machine Learning · Computer Science 2021-10-27 Matthias Minderer , Josip Djolonga , Rob Romijnders , Frances Hubis , Xiaohua Zhai , Neil Houlsby , Dustin Tran , Mario Lucic

Neural networks have proven successful at learning from complex data distributions by acting as universal function approximators. However, they are often overconfident in their predictions, which leads to inaccurate and miscalibrated…

Machine Learning · Computer Science 2021-02-23 Jeffrey Willette , Juho Lee , Sung Ju Hwang

Large language models (LLMs) are increasingly employed in information-seeking and decision-making tasks. Despite their broad utility, LLMs tend to generate information that conflicts with real-world facts, and their persuasive style can…

Computation and Language · Computer Science 2024-09-19 Arslan Chaudhry , Sridhar Thiagarajan , Dilan Gorur

Neural networks solving real-world problems are often required not only to make accurate predictions but also to provide a confidence level in the forecast. The calibration of a model indicates how close the estimated confidence is to the…

Neural and Evolutionary Computing · Computer Science 2023-03-21 Ruslan Vasilev , Alexander D'yakonov

A machine learning model is calibrated if its predicted probability for an outcome matches the observed frequency for that outcome conditional on the model prediction. This property has become increasingly important as the impact of machine…

Machine Learning · Computer Science 2025-02-25 Muthu Chidambaram , Rong Ge

Building accurate language models that capture meaningful long-term dependencies is a core challenge in natural language processing. Towards this end, we present a calibration-based approach to measure long-term discrepancies between a…

Computation and Language · Computer Science 2019-06-14 Mark Braverman , Xinyi Chen , Sham M. Kakade , Karthik Narasimhan , Cyril Zhang , Yi Zhang

In the field of medical image analysis, achieving high accuracy is not enough; ensuring well-calibrated predictions is also crucial. Confidence scores of a deep neural network play a pivotal role in explainability by providing insights into…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Abhishek Singh Sambyal , Usma Niyaz , Narayanan C. Krishnan , Deepti R. Bathula

Continual learning for large language models is typically evaluated through accuracy retention under sequential fine-tuning. We argue that this perspective is incomplete, because uncertainty reliability can degrade earlier and more sharply…

Machine Learning · Computer Science 2026-04-28 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

Depth pruning improves the inference efficiency of large language models by removing Transformer blocks. Prior work typically treats layer redundancy as an inherent structural property of pretrained networks, emphasizing importance criteria…

Machine Learning · Computer Science 2026-05-28 Minkyu Kim , Vincent-Daniel Yun , Youngrae Kim , Suin Cho , Woosang Lim , Sunwoo Lee

While pre-trained language models (PLMs) have become a de-facto standard promoting the accuracy of text classification tasks, recent studies find that PLMs often predict over-confidently. Although various calibration methods have been…

Computation and Language · Computer Science 2023-02-15 Jaeyoung Kim , Dongbin Na , Sungchul Choi , Sungbin Lim

Deep neural networks have been shown to be highly miscalibrated. often they tend to be overconfident in their predictions. It poses a significant challenge for safety-critical systems to utilise deep neural networks (DNNs), reliably. Many…

Machine Learning · Computer Science 2022-05-05 Aditya Singh , Alessandro Bay , Biswa Sengupta , Andrea Mirabile

When adapting ICL with or without fine-tuning, we are curious about whether the instruction-tuned language model is able to achieve well-calibrated results without suffering from the problem of overconfidence (i.e., miscalibration)…

Computation and Language · Computer Science 2025-05-23 Chengzu Li , Han Zhou , Goran Glavaš , Anna Korhonen , Ivan Vulić

With model trustworthiness being crucial for sensitive real-world applications, practitioners are putting more and more focus on improving the uncertainty calibration of deep neural networks. Calibration errors are designed to quantify the…

Machine Learning · Computer Science 2024-03-14 Sebastian G. Gruber , Florian Buettner

Measuring the quality of responses generated by LLMs is a challenging task, particularly when it comes to evaluating whether the response is aligned with human preference. A novel approach involves using the LLM itself to make evaluation…

Computation and Language · Computer Science 2023-08-04 Xinghua Zhang , Bowen Yu , Haiyang Yu , Yangyu Lv , Tingwen Liu , Fei Huang , Hongbo Xu , Yongbin Li

Graph Neural Networks (GNNs) have demonstrated remarkable effectiveness on graph-based tasks. However, their predictive confidence is often miscalibrated, typically exhibiting under-confidence, which harms the reliability of their…

Machine Learning · Computer Science 2025-09-30 Jincheng Huang , Jie Xu , Xiaoshuang Shi , Ping Hu , Lei Feng , Xiaofeng Zhu

Large Language Models (LLMs) often lack meaningful confidence estimates for their outputs. While base LLMs are known to exhibit next-token calibration, it remains unclear whether they can assess confidence in the actual meaning of their…

Computation and Language · Computer Science 2025-11-10 Preetum Nakkiran , Arwen Bradley , Adam Goliński , Eugene Ndiaye , Michael Kirchhof , Sinead Williamson