English
Related papers

Related papers: Calibration Is Not Enough: Evaluating Confidence E…

200 papers

Large Language Models (LLMs) have shown significant advances in text generation but often lack the reliability needed for autonomous deployment in high-stakes domains like healthcare, law, and finance. Existing approaches rely on external…

Artificial Intelligence · Computer Science 2024-11-12 Ninad Naik

We observe that current conversational language models often waver in their judgments when faced with follow-up questions, even if the original judgment was correct. This wavering presents a significant challenge for generating reliable…

Computation and Language · Computer Science 2024-06-12 Qiming Xie , Zengzhi Wang , Yi Feng , Rui Xia

Faithful free-text explanations are important to ensure transparency in high-stakes AI decision-making contexts, but they are challenging to generate by language models and assess by humans. In this paper, we present a measure for…

Computation and Language · Computer Science 2025-09-30 Lingjun Zhao , Hal Daumé

Calibration measures quantify how much a forecaster's predictions violates calibration, which requires that forecasts are unbiased conditioning on the forecasted probabilities. Two important desiderata for a calibration measure are its…

Machine Learning · Computer Science 2025-03-05 Mingda Qiao , Eric Zhao

Despite the increasing effectiveness of language models, their reasoning capabilities remain underdeveloped. In particular, causal reasoning through counterfactual question answering is lacking. This work aims to bridge this gap. We first…

Computation and Language · Computer Science 2025-03-18 Alihan Hüyük , Xinnuo Xu , Jacqueline Maasch , Aditya V. Nori , Javier González

Systems design processes are increasingly reliant on simulation models to inform design decisions. A pervasive issue within the systems engineering community is trusting in the models used to make decisions about complex systems. This work…

Computational Engineering, Finance, and Science · Computer Science 2025-08-05 Edward Louis , Gregory Mocko , Evan Taylor

We propose an evaluation framework for class probability estimates (CPEs) in the presence of label uncertainty, which is commonly observed as diagnosis disagreement between experts in the medical domain. We also formalize evaluation metrics…

Machine Learning · Statistics 2021-03-23 Takahiro Mimori , Keiko Sasada , Hirotaka Matsui , Issei Sato

Machine learning models for speech emotion recognition (SER) can be trained for different tasks and are usually evaluated based on a few available datasets per task. Tasks could include arousal, valence, dominance, emotional categories, or…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-13 Anna Derington , Hagen Wierstorf , Ali Özkil , Florian Eyben , Felix Burkhardt , Björn W. Schuller

Evaluating the efficiency of human-AI interactions is challenging, including subjective and objective quality aspects. With the focus on the human experience of the explanations, evaluations of explanation methods have become mostly…

Artificial Intelligence · Computer Science 2024-05-10 Helena Löfström

In the face of dataset shift, model calibration plays a pivotal role in ensuring the reliability of machine learning systems. Calibration error (CE) is an indicator of the alignment between the predicted probabilities and the classifier…

Machine Learning · Computer Science 2023-12-15 Teodora Popordanoska , Gorjan Radevski , Tinne Tuytelaars , Matthew B. Blaschko

As Large Language Models (LLMs) are increasingly deployed in decision-critical domains, it becomes essential to ensure that their confidence estimates faithfully correspond to their actual correctness. Existing calibration methods have…

Computation and Language · Computer Science 2025-08-21 Ke Fang , Tianyi Zhao , Lu Cheng

We study calibration in question answering, estimating whether model correctly predicts answer for each question. Unlike prior work which mainly rely on the model's confidence score, our calibrator incorporates information about the input…

Computation and Language · Computer Science 2021-06-04 Shujian Zhang , Chengyue Gong , Eunsol Choi

Every uncalibrated classifier has a corresponding true calibration map that calibrates its confidence. Deviations of this idealistic map from the identity map reveal miscalibration. Such calibration errors can be reduced with many post-hoc…

Machine Learning · Computer Science 2025-02-27 Markus Kängsepp , Kaspar Valk , Meelis Kull

Large language models (LLMs) are capable of generating plausible explanations of how they arrived at an answer to a question. However, these explanations can misrepresent the model's "reasoning" process, i.e., they can be unfaithful. This,…

Computation and Language · Computer Science 2025-05-21 Katie Matton , Robert Osazuwa Ness , John Guttag , Emre Kıcıman

Recent discussions on alternative facts, fake news, and post truth politics have motivated research on creating technologies that allow people not only to access information, but also to assess the credibility of the information presented…

Information Retrieval · Computer Science 2017-08-25 Christina Lioma , Jakob Grue Simonsen , Birger Larsen

Recent Quality Estimation (QE) models based on multilingual pre-trained representations have achieved very competitive results when predicting the overall quality of translated sentences. Predicting translation errors, i.e. detecting…

Computation and Language · Computer Science 2021-08-30 Marina Fomicheva , Lucia Specia , Nikolaos Aletras

Word sense disambiguation (WSD), which aims to determine an appropriate sense for a target word given its context, is crucial for natural language understanding. Existing supervised methods treat WSD as a classification task and have…

Computation and Language · Computer Science 2023-06-13 Zhu Liu , Ying Liu

Calibration, the practice of choosing the parameters of a structural model to match certain empirical moments, can be viewed as minimum distance estimation. Existing standard error formulas for such estimators require a consistent estimate…

Econometrics · Economics 2024-06-19 Matthew D. Cocci , Mikkel Plagborg-Møller

Large language models (LLMs) are increasingly deployed in culturally diverse environments, yet existing evaluations of cultural competence remain limited. Existing methods focus on de-contextualized correctness or forced-choice judgments,…

Computation and Language · Computer Science 2025-11-18 Truong Vo , Sanmi Koyejo

Large Language Models have significantly advanced natural language processing tasks, but remain prone to generating incorrect or misleading but plausible arguments. This issue, known as hallucination, is particularly concerning in…

Computation and Language · Computer Science 2025-12-04 Ahmad Aghaebrahimian