English
Related papers

Related papers: Teaching Models to Express Their Uncertainty in Wo…

200 papers

In typical machine learning systems, an estimate of the probability of the prediction is used to assess the system's confidence in the prediction. This confidence measure is usually uncalibrated; i.e.\ the system's confidence in the…

Computation and Language · Computer Science 2022-05-24 Shehzaad Dhuliawala , Leonard Adolphs , Rajarshi Das , Mrinmaya Sachan

Autonomous agents based on large language models (LLMs) are rapidly evolving to handle multi-turn tasks, but ensuring their trustworthiness remains a critical challenge. A fundamental pillar of this trustworthiness is calibration, which…

Computation and Language · Computer Science 2026-01-13 Weihao Xuan , Qingcheng Zeng , Heli Qi , Yunze Xiao , Junjue Wang , Naoto Yokoya

When a model knows when it does not know, many possibilities emerge. The first question is how to enable a model to recognize that it does not know. A promising approach is to use confidence, computed from the model's internal signals, to…

Artificial Intelligence · Computer Science 2026-01-14 Chenjie Hao , Weyl Lu , Yuko Ishiwaka , Zengyi Li , Weier Wan , Yubei Chen

Machine unlearning aims to remove the influence of specific training data from a model while preserving reliable behavior on the remaining data, making reliable prediction and uncertainty estimation essential for evaluation. Calibration is…

Computation and Language · Computer Science 2026-05-21 Divyaksh Shukla , Ashutosh Modi

Previous literature has proved that Pretrained Language Models (PLMs) can store factual knowledge. However, we find that facts stored in the PLMs are not always correct. It motivates us to explore a fundamental question: How do we calibrate…

Computation and Language · Computer Science 2022-10-19 Qingxiu Dong , Damai Dai , Yifan Song , Jingjing Xu , Zhifang Sui , Lei Li

There has been recent interest in whether large language models (LLMs) can introspect about their own internal states. Such abilities would make LLMs more interpretable, and also validate the use of standard introspective methods in…

Computation and Language · Computer Science 2025-09-25 Siyuan Song , Jennifer Hu , Kyle Mahowald

Reliable uncertainty estimation is crucial for perception systems in safe autonomous driving. Recently, many methods have been proposed to model uncertainties in deep learning based object detectors. However, the estimated probabilities are…

Robotics · Computer Science 2019-09-30 Di Feng , Lars Rosenbaum , Claudius Glaeser , Fabian Timm , Klaus Dietmayer

To use generative question-and-answering (QA) systems for decision-making and in any critical application, these systems need to provide well-calibrated confidence scores that reflect the correctness of their answers. Existing calibration…

Computation and Language · Computer Science 2025-03-04 Putra Manggala , Atalanti Mastakouri , Elke Kirschbaum , Shiva Prasad Kasiviswanathan , Aaditya Ramdas

While past works have shown how uncertainty quantification can be applied to large language model (LLM) outputs, the question of whether resulting uncertainty guarantees still hold within sub-groupings of data remains open. In our work,…

Computation and Language · Computer Science 2025-06-13 Terrance Liu , Zhiwei Steven Wu

Neural networks have proven successful at learning from complex data distributions by acting as universal function approximators. However, they are often overconfident in their predictions, which leads to inaccurate and miscalibrated…

Machine Learning · Computer Science 2021-02-23 Jeffrey Willette , Juho Lee , Sung Ju Hwang

Trustworthy language models should abstain from answering questions when they do not know the answer. However, the answer to a question can be unknown for a variety of reasons. Prior research has focused on the case in which the question is…

Computation and Language · Computer Science 2023-11-16 Jeremy R. Cole , Michael J. Q. Zhang , Daniel Gillick , Julian Martin Eisenschlos , Bhuwan Dhingra , Jacob Eisenstein

Predictive uncertainty estimation of pre-trained language models is an important measure of how likely people can trust their predictions. However, little is known about what makes a model prediction uncertain. Explaining predictive…

Computation and Language · Computer Science 2022-10-11 Hanjie Chen , Wanyu Du , Yangfeng Ji

Like students facing hard exam questions, large language models sometimes guess when uncertain, producing plausible yet incorrect statements instead of admitting uncertainty. Such "hallucinations" persist even in state-of-the-art systems…

Computation and Language · Computer Science 2025-09-08 Adam Tauman Kalai , Ofir Nachum , Santosh S. Vempala , Edwin Zhang

Machine learning classifiers are probabilistic in nature, and thus inevitably involve uncertainty. Predicting the probability of a specific input to be correct is called uncertainty (or confidence) estimation and is crucial for risk…

Machine Learning · Computer Science 2023-01-11 Gabriella Chouraqui , Liron Cohen , Gil Einziger , Liel Leman

Although Gaussian processes (GPs) with deep kernels have been successfully used for meta-learning in regression tasks, its uncertainty estimation performance can be poor. We propose a meta-learning method for calibrating deep kernel GPs for…

Machine Learning · Statistics 2023-12-14 Tomoharu Iwata , Atsutoshi Kumagai

Language models are increasingly used in settings where outputs must satisfy user-specified randomness constraints, yet their generation probabilities are often poorly calibrated to those targets. We study whether this capability can be…

Computation and Language · Computer Science 2026-05-13 Davide Baldelli , Sruthi Kuriakose , Maryam Hashemzadeh , Amal Zouaq , Sarath Chandar

Recently, with the chain of thought (CoT) prompting, large language models (LLMs), e.g., GPT-3, have shown strong reasoning ability in several natural language processing tasks such as arithmetic, commonsense, and logical reasoning.…

Artificial Intelligence · Computer Science 2023-10-20 Yixuan Weng , Minjun Zhu , Fei Xia , Bin Li , Shizhu He , Shengping Liu , Bin Sun , Kang Liu , Jun Zhao

Recently, combinations of generative and Bayesian machine learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated…

Machine Learning · Computer Science 2024-11-21 Sebastian Bieringer , Sascha Diefenbacher , Gregor Kasieczka , Mathias Trabs

The increased deployment of LMs for real-world tasks involving knowledge and facts makes it important to understand model epistemology: what LMs think they know, and how their attitudes toward that knowledge are affected by language use in…

Computation and Language · Computer Science 2023-11-14 Kaitlyn Zhou , Dan Jurafsky , Tatsunori Hashimoto

Building accurate language models that capture meaningful long-term dependencies is a core challenge in natural language processing. Towards this end, we present a calibration-based approach to measure long-term discrepancies between a…

Computation and Language · Computer Science 2019-06-14 Mark Braverman , Xinyi Chen , Sham M. Kakade , Karthik Narasimhan , Cyril Zhang , Yi Zhang