English
Related papers

Related papers: MedBayes-Lite: Bayesian Uncertainty Quantification…

200 papers

Image segmentation is a critical step in computational biomedical image analysis, typically evaluated using metrics like the Dice coefficient during training and validation. However, in clinical settings without manual annotations,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Sikha O K , Meritxell Riera-Marín , Adrian Galdran , Javier García Lopez , Julia Rodríguez-Comas , Gemma Piella , Miguel A. González Ballester

Given the pressing need for assuring algorithmic transparency, Explainable AI (XAI) has emerged as one of the key areas of AI research. In this paper, we develop a novel Bayesian extension to the LIME framework, one of the most widely used…

Artificial Intelligence · Computer Science 2021-06-01 Xingyu Zhao , Wei Huang , Xiaowei Huang , Valentin Robu , David Flynn

Various AI models are increasingly being considered as part of clinical decision-support tools. However, the trustworthiness of such models is rarely considered. Clinicians are more likely to use a model if they can understand and trust its…

Artificial Intelligence · Computer Science 2020-03-09 Evangelia Kyrimi , Somayyeh Mossadegh , Nigel Tai , William Marsh

Transformer-based language models have set new benchmarks across a wide range of NLP tasks, yet reliably estimating the uncertainty of their predictions remains a significant challenge. Existing uncertainty estimation (UE) techniques often…

Machine Learning · Computer Science 2024-09-18 Elizaveta Kostenok , Daniil Cherniavskii , Alexey Zaytsev

Transformer has become ubiquitous due to its dominant performance in various NLP and image processing tasks. However, it lacks understanding of how to generate mathematically grounded uncertainty estimates for transformer architectures.…

Computation and Language · Computer Science 2022-06-03 Karthik Abinav Sankararaman , Sinong Wang , Han Fang

With the growing adoption of Large Language Models (LLMs) for open-ended tasks, accurately assessing epistemic uncertainty, which reflects a model's lack of knowledge, has become crucial to ensuring reliable outcomes. However, quantifying…

Computation and Language · Computer Science 2025-10-10 Xinyi Liu , Weiguang Wang , Hangfeng He

Bayesian inference is often utilized for uncertainty quantification tasks. A recent analysis by Xu and Raginsky 2022 rigorously decomposed the predictive uncertainty in Bayesian inference into two uncertainties, called aleatoric and…

Machine Learning · Statistics 2023-07-25 Futoshi Futami , Tomoharu Iwata

In this paper, we present an uncertainty-aware INVASE to quantify predictive confidence of healthcare problem. By introducing learnable Gaussian distributions, we lever-age their variances to measure the degree of uncertainty. Based on the…

Machine Learning · Computer Science 2021-05-07 Jia-Xing Zhong , Hongbo Zhang

Despite their widespread applications, Large Language Models (LLMs) often struggle to express uncertainty, posing a challenge for reliable deployment in high stakes and safety critical domains like clinical diagnostics. Existing standard…

Machine Learning · Computer Science 2025-09-25 Mridul Sharma , Adeetya Patel , Zaneta D' Souza , Samira Abbasgholizadeh Rahimi , Siva Reddy , Sreenath Madathil

Modern neural networks have found to be miscalibrated in terms of confidence calibration, i.e., their predicted confidence scores do not reflect the observed accuracy or precision. Recent work has introduced methods for post-hoc confidence…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Fabian Küppers , Jan Kronenberger , Jonas Schneider , Anselm Haselhoff

A key factor in ensuring the accuracy of computer simulations that model physical systems is the proper calibration of their parameters based on real-world observations or experimental data. Inevitably, uncertainties arise, and Bayesian…

Computational Engineering, Finance, and Science · Computer Science 2026-02-25 Daniel Andrés Arcones , Martin Weiser , Phaedon-Stelios Koutsourelakis , Jörg F. Unger

Large language models (LLMs) are increasingly used for conversational clinical decision support, yet they conflate next token prediction with probabilistic decision making. We argue that this conflation reflects an architectural limitation:…

Recent advances in handling long sequences have facilitated the exploration of long-context in-context learning (ICL). While much of the existing research emphasizes performance improvements driven by additional in-context examples, the…

Computation and Language · Computer Science 2025-05-28 Yifei Wang , Yu Sheng , Linjing Li , Daniel Zeng

In context-specific applications such as robotics, telecommunications, and healthcare, artificial intelligence systems often face the challenge of limited training data. This scarcity introduces epistemic uncertainty, i.e., reducible…

Information Theory · Computer Science 2026-03-17 Osvaldo Simeone , Yaniv Romano

This study examines the role of uncertainty estimation (UE) methods in multilingual text classification under noisy and non-topical conditions. Using a complex-vs-simple sentence classification task across several languages, we evaluate a…

Computation and Language · Computer Science 2026-03-10 Nouran Khallaf , Serge Sharoff

Calibration strengthens the trustworthiness of black-box models by producing better accurate confidence estimates on given examples. However, little is known about if model explanations can help confidence calibration. Intuitively, humans…

Computation and Language · Computer Science 2022-11-08 Dongfang Li , Baotian Hu , Qingcai Chen

Dropout is common in clinical studies, with up to half of patients leaving early due to side effects or other reasons. When dropout is informative (i.e., dependent on survival time), it introduces censoring bias, because of which treatment…

Machine Learning · Computer Science 2026-05-12 Yuxin Wang , Dennis Frauen , Jonas Schweisthal , Maresa Schröder , Stefan Feuerriegel

Clinical decision-making demands uncertainty quantification that provides both distribution-free coverage guarantees and risk-adaptive precision, requirements that existing methods fail to jointly satisfy. We present a hybrid…

Machine Learning · Computer Science 2026-01-06 Marzieh Amiri Shahbazi , Ali Baheri , Nasibeh Azadeh-Fard

LLM-based agents are increasingly used to simulate deliberative interactions such as negotiation, conflict resolution, and multi-turn opinion exchange. Yet generated transcripts often do not reveal why an agent's stance changes: movement…

Artificial Intelligence · Computer Science 2026-05-18 Joshua C. Yang , Maurice Flechtner , Damian Dailisan , Michiel A. Bakker

A critical component in the trustworthiness of LLMs is reliable uncertainty communication, yet LLMs often use assertive language when conveying false claims, leading to over-reliance and eroded trust. We present the first systematic study…

Computation and Language · Computer Science 2025-10-03 Gabrielle Kaili-May Liu , Gal Yona , Avi Caciularu , Idan Szpektor , Tim G. J. Rudner , Arman Cohan