English
Related papers

Related papers: Empirical Frequentist Coverage of Deep Learning Un…

200 papers

Deep learning models achieve high predictive accuracy across a broad spectrum of tasks, but rigorously quantifying their predictive uncertainty remains challenging. Usable estimates of predictive uncertainty should (1) cover the true…

Machine Learning · Computer Science 2020-07-28 Ahmed M. Alaa , Mihaela van der Schaar

Uncertainty Quantification (UQ) is pivotal in enhancing the robustness, reliability, and interpretability of Machine Learning (ML) systems for healthcare, optimizing resources and improving patient care. Despite the emergence of ML-based…

Machine Learning · Computer Science 2025-05-07 L. Julián Lechuga López , Shaza Elsharief , Dhiyaa Al Jorf , Firas Darwish , Congbo Ma , Farah E. Shamout

An in-depth understanding of uncertainty is the first step to making effective decisions under uncertainty. Deep/machine learning (ML/DL) has been hugely leveraged to solve complex problems involved with processing high-dimensional data.…

Artificial Intelligence · Computer Science 2022-06-15 Zhen Guo , Zelin Wan , Qisheng Zhang , Xujiang Zhao , Feng Chen , Jin-Hee Cho , Qi Zhang , Lance M. Kaplan , Dong H. Jeong , Audun Jøsang

Uncertainty quantification approaches have been more critical in large language models (LLMs), particularly high-risk applications requiring reliable outputs. However, traditional methods for uncertainty quantification, such as…

Artificial Intelligence · Computer Science 2024-07-01 Ferhat Ozgur Catak , Murat Kuzlu

The estimation of uncertainties associated with predictions from quantitative structure-activity relationship (QSAR) models can accelerate the drug discovery process by identifying promising experiments and allowing an efficient allocation…

Machine Learning · Computer Science 2025-02-07 Hannah Rosa Friesacher , Emma Svensson , Susanne Winiwarter , Lewis Mervin , Adam Arany , Ola Engkvist

The use of AI systems in healthcare for the early screening of diseases is of great clinical importance. Deep learning has shown great promise in medical imaging, but the reliability and trustworthiness of AI systems limit their deployment…

Image and Video Processing · Electrical Eng. & Systems 2023-05-17 Ke Zou , Zhihao Chen , Xuedong Yuan , Xiaojing Shen , Meng Wang , Huazhu Fu

Uncertainty quantification (UQ) is crucial in machine learning, yet most (axiomatic) studies of uncertainty measures focus on classification, leaving a gap in regression settings with limited formal justification and evaluations. In this…

Machine Learning · Computer Science 2025-05-19 Christopher Bülte , Yusuf Sale , Timo Löhr , Paul Hofman , Gitta Kutyniok , Eyke Hüllermeier

Applying a machine learning model for decision-making in the real world requires to distinguish what the model knows from what it does not. A critical factor in assessing the knowledge of a model is to quantify its predictive uncertainty.…

Machine Learning · Computer Science 2023-11-15 Kajetan Schweighofer , Lukas Aichberger , Mykyta Ielanskyi , Sepp Hochreiter

The use of Deep Neural Network (DNN) models in risk-based decision-making has attracted extensive attention with broad applications in medical, finance, manufacturing, and quality control. To mitigate prediction-related risks in decision…

Machine Learning · Statistics 2023-10-11 Maryam Kheirandish , Shengfan Zhang , Donald G. Catanzaro , Valeriu Crudu

Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI. In regression tasks, uncertainty is typically quantified using prediction intervals calibrated to a specific operating point,…

Machine Learning · Computer Science 2021-06-03 Jiri Navratil , Benjamin Elder , Matthew Arnold , Soumya Ghosh , Prasanna Sattigeri

Modern weather forecast models perform uncertainty quantification using ensemble prediction systems, which collect nonparametric statistics based on multiple perturbed simulations. To provide accurate estimation, dozens of such…

Machine Learning · Computer Science 2019-12-06 Peter Grönquist , Tal Ben-Nun , Nikoli Dryden , Peter Dueben , Luca Lavarini , Shigang Li , Torsten Hoefler

The estimation of the amount of uncertainty featured by predictive machine learning models has acquired a great momentum in recent years. Uncertainty estimation provides the user with augmented information about the model's confidence in…

Machine Learning · Computer Science 2022-10-31 Ibai Laña , Ignacio , Olabarrieta , Javier Del Ser

Image reconstruction methods based on deep neural networks have shown outstanding performance, equalling or exceeding the state-of-the-art results of conventional approaches, but often do not provide uncertainty information about the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Riccardo Barbano , Željko Kereta , Chen Zhang , Andreas Hauptmann , Simon Arridge , Bangti Jin

Neural Linear Models (NLM) are deep Bayesian models that produce predictive uncertainty by learning features from the data and then performing Bayesian linear regression over these features. Despite their popularity, few works have focused…

Machine Learning · Statistics 2021-06-25 Cooper Lorsung

Reliable uncertainty quantification (UQ) in machine learning (ML) regression tasks is becoming the focus of many studies in materials and chemical science. It is now well understood that average calibration is insufficient, and most studies…

Machine Learning · Statistics 2024-01-25 Pascal Pernot

Machine learning (ML) offers promising new approaches to tackle complex problems and has been increasingly adopted in chemical and materials sciences. Broadly speaking, ML models employ generic mathematical functions and attempt to learn…

Materials Science · Physics 2024-08-21 Jin Dai , Santosh Adhikari , Mingjian Wen

Uncertainty quantification for image data is dominated by complex deep learning methods, yet the field lacks an interpretable, mathematically grounded baseline. We propose Bayesian scattering to fill this gap, serving as a first-step…

Machine Learning · Computer Science 2026-03-24 Bernardo Fichera , Zarko Ivkovic , Kjell Jorner , Philipp Hennig , Viacheslav Borovitskiy

Uncertainty representation and quantification are paramount in machine learning and constitute an important prerequisite for safety-critical applications. In this paper, we propose novel measures for the quantification of aleatoric and…

Machine Learning · Computer Science 2024-04-22 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

Background and objective: Uncertainty quantification is a pivotal field that contributes to realizing reliable and robust systems. It becomes instrumental in fortifying safe decisions by providing complementary information, particularly…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Jamil Fayyad , Shadi Alijani , Homayoun Najjaran

Despite the massive advancements in large language models (LLMs), they still suffer from producing plausible but incorrect responses. To improve the reliability of LLMs, recent research has focused on uncertainty quantification to predict…

Artificial Intelligence · Computer Science 2025-04-01 Yongjin Yang , Haneul Yoo , Hwaran Lee