English
Related papers

Related papers: Calibration Across Layers: Understanding Calibrati…

200 papers

We consider the issue of calibration in large language models (LLM). Recent studies have found that common interventions such as instruction tuning often result in poorly calibrated LLMs. Although calibration is well-explored in traditional…

Machine Learning · Computer Science 2024-06-28 Maohao Shen , Subhro Das , Kristjan Greenewald , Prasanna Sattigeri , Gregory Wornell , Soumya Ghosh

Going beyond mimicking limited human experiences, recent studies show initial evidence that, like humans, large language models (LLMs) are capable of improving their abilities purely by self-correction, i.e., correcting previous responses…

Machine Learning · Computer Science 2024-11-19 Yifei Wang , Yuyang Wu , Zeming Wei , Stefanie Jegelka , Yisen Wang

While Large language models (LLMs) have proved able to address some complex reasoning tasks, we also know that they are highly sensitive to input variation, which can lead to different solution paths and final answers. Answer consistency…

Computation and Language · Computer Science 2025-03-05 Huiyuan Lai , Xiao Zhang , Malvina Nissim

Confidence calibration in LLMs, i.e., aligning their self-assessed confidence with the actual accuracy of their responses, enabling them to self-evaluate the correctness of their outputs. However, current calibration methods for LLMs…

Computation and Language · Computer Science 2024-11-21 Yige Yuan , Bingbing Xu , Hexiang Tan , Fei Sun , Teng Xiao , Wei Li , Huawei Shen , Xueqi Cheng

Accurate probabilistic predictions are essential for optimal decision making. While neural network miscalibration has been studied primarily in classification, we investigate this in the less-explored domain of regression. We conduct the…

Machine Learning · Computer Science 2023-06-08 Victor Dheur , Souhaib Ben Taieb

Neural collapse ($\mathcal{NC}$) is a phenomenon observed in classification tasks where top-layer representations collapse into their class means, which become equinorm, equiangular and aligned with the classifiers. These behaviours --…

Machine Learning · Computer Science 2024-11-27 Robert Wu , Vardan Papyan

In recent years, multimodal large language models (MLLMs) have made significant progress but continue to face inherent challenges in multimodal reasoning, which requires multi-level (e.g., perception, reasoning) and multi-granular (e.g.,…

Computation and Language · Computer Science 2025-06-30 Zhitao He , Sandeep Polisetty , Zhiyuan Fan , Yuchen Huang , Shujin Wu , Yi R. Fung

Confidence calibration - the process to calibrate the output probability distribution of neural networks - is essential for safety-critical applications of such networks. Recent works verify the link between mis-calibration and overfitting.…

Machine Learning · Computer Science 2023-05-24 Linwei Tao , Minjing Dong , Daochang Liu , Changming Sun , Chang Xu

Recent findings reveal that much of the knowledge in a Transformer-based Large Language Model (LLM) is encoded in its feed-forward (FFN) layers, where each FNN layer can be interpreted as the summation of sub-updates, each corresponding to…

Computation and Language · Computer Science 2025-07-01 Ying Shen , Lifu Huang

Despite significant progress in transformer interpretability, an understanding of the computational mechanisms of large language models (LLMs) remains a fundamental challenge. Many approaches interpret a network's hidden representations but…

Machine Learning · Computer Science 2025-10-14 James R. Golden

Modern neural networks can achieve high accuracy while remaining poorly calibrated, producing confidence estimates that do not match empirical correctness. Yet calibration is often treated as a post-hoc attribute. We take a different…

Machine Learning · Computer Science 2026-04-23 Alessandro Morosini , Matea Gjika , Tomaso Poggio , Pierfrancesco Beneventano

Cross-lingual natural language understanding (NLU) is a critical task in natural language processing (NLP). Recent advancements have seen multilingual pre-trained language models (mPLMs) significantly enhance the performance of these tasks.…

Computation and Language · Computer Science 2024-02-27 Taixi Lu , Haoyu Wang , Huajie Shao , Jing Gao , Huaxiu Yao

Calibration, which establishes the correlation between accuracy and model confidence, is important for LLM development. We design three off-the-shelf calibration methods based on self-consistency (Wang et al., 2022) for math reasoning…

Computation and Language · Computer Science 2024-03-18 Ante Wang , Linfeng Song , Ye Tian , Baolin Peng , Lifeng Jin , Haitao Mi , Jinsong Su , Dong Yu

Large language models (LLMs) may exhibit unintended or undesirable behaviors. Recent works have concentrated on aligning LLMs to mitigate harmful outputs. Despite these efforts, some anomalies indicate that even a well-conducted alignment…

Computation and Language · Computer Science 2025-09-24 Jiaming Ji , Kaile Wang , Tianyi Qiu , Boyuan Chen , Jiayi Zhou , Changye Li , Hantao Lou , Juntao Dai , Yunhuai Liu , Yaodong Yang

Large language models are increasingly deployed in settings where reliability matters, yet output-level uncertainty signals such as token probabilities, entropy, and self-consistency can become brittle under calibration--deployment…

Computation and Language · Computer Science 2026-04-20 Yanli Wang , Peng Kuang , Xiaoyu Han , Kaidi Xu , Haohan Wang

Aligning large language models (LLMs) through supervised fine-tuning is essential for tailoring them to specific applications. Recent studies suggest that alignment primarily adjusts a model's presentation style rather than its foundational…

Computation and Language · Computer Science 2025-04-09 Guangyuan Shi , Zexin Lu , Xiaoyu Dong , Wenlong Zhang , Xuanyu Zhang , Yujie Feng , Xiao-Ming Wu

The conventional design of wireless communication systems typically relies on established mathematical models that capture the characteristics of different communication modules. Unfortunately, such design cannot be easily and directly…

Signal Processing · Electrical Eng. & Systems 2021-10-04 Yifan Ma , Yifei Shen , Xianghao Yu , Jun Zhang , S. H. Song , Khaled B. Letaief

Reasoning language models can solve increasingly complex tasks, but struggle to produce the calibrated confidence estimates necessary for reliable deployment. Existing calibration methods usually depend on labels or repeated sampling at…

Machine Learning · Computer Science 2026-04-22 Thomas Zollo , Jimmy Wang , Richard Zemel

Calibration is a fundamental property of a good predictive model: it requires that the model predicts correctly in proportion to its confidence. Modern neural networks, however, provide no strong guarantees on their calibration -- and can…

Machine Learning · Computer Science 2022-10-07 A. Michael Carrell , Neil Mallinar , James Lucas , Preetum Nakkiran

Recent mechanistic studies suggest that large language models (LLMs) may utilize their depth inefficiently in standard single-turn tasks. Whether this still holds in autonomous agent settings, where models must perform multi-turn planning,…

Artificial Intelligence · Computer Science 2026-05-28 Zhenyu Cui , Xiangzhong Luo