English
Related papers

Related papers: Uncertainty Estimation and Calibration with Finite…

200 papers

The value of uncertainty quantification on predictions for trained neural networks (NNs) on quantum chemical reference data is quantitatively explored. For this, the architecture of the PhysNet NN was suitably modified and the resulting…

Chemical Physics · Physics 2022-07-22 Luis Itza Vazquez-Salazar , Eric D. Boittier , M. Meuwly

Reliable probability estimation is of crucial importance in many real-world applications where there is inherent (aleatoric) uncertainty. Probability-estimation models are trained on observed outcomes (e.g. whether it has rained or not, or…

The uncertainty quantification of prediction models (e.g., neural networks) is crucial for their adoption in many robotics applications. This is arguably as important as making accurate predictions, especially for safety-critical…

Robotics · Computer Science 2024-04-09 Junan Chen , Josephine Monica , Wei-Lun Chao , Mark Campbell

Reliable uncertainty estimation is critical for deploying neural networks (NNs) in real-world applications. While existing calibration techniques often rely on post-hoc adjustments or coarse-grained binning methods, they remain limited in…

Machine Learning · Computer Science 2025-05-30 Pedro Mendes , Paolo Romano , David Garlan

Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI. In regression tasks, uncertainty is typically quantified using prediction intervals calibrated to an ad-hoc operating point,…

Machine Learning · Computer Science 2023-10-06 Jiri Navratil , Benjamin Elder , Matthew Arnold , Soumya Ghosh , Prasanna Sattigeri

Bayesian Neural Networks (BNNs) provide a tool to estimate the uncertainty of a neural network by considering a distribution over weights and sampling different models for each input. In this paper, we propose a method for uncertainty…

Machine Learning · Computer Science 2024-10-28 Illia Oleksiienko , Dat Thanh Tran , Alexandros Iosifidis

Stochastic simulation has been widely used to analyze the performance of complex stochastic systems and facilitate decision making in those systems. Stochastic simulation is driven by the input model, which is a collection of probability…

Risk Management · Quantitative Finance 2020-02-14 Tianyi Liu , Enlu Zhou

Graph Neural Networks (GNNs) have shown remarkable performance in the healthcare domain. However, what remained challenging is quantifying the predictive uncertainty of GNNs, which is an important aspect of trustworthiness in clinical…

Machine Learning · Computer Science 2025-08-28 Hirad Daneshvar , Reza Samavi

Neural network potentials (NNPs) combine the computational efficiency of classical interatomic potentials with the high accuracy and flexibility of the ab initio methods used to create the training set, but can also result in unphysical…

Materials Science · Physics 2022-01-24 Leonid Kahle , Federico Zipoli

While neural networks have demonstrated impressive performance across various tasks, accurately quantifying uncertainty in their predictions is essential to ensure their trustworthiness and enable widespread adoption in critical systems.…

Machine Learning · Statistics 2025-11-11 Joseph Wilson , Chris van der Heide , Liam Hodgkinson , Fred Roosta

Accurate state and uncertainty estimation is imperative for mobile robots and self driving vehicles to achieve safe navigation in pedestrian rich environments. A critical component of state and uncertainty estimation for robot navigation is…

Robotics · Computer Science 2021-04-08 Kapil D. Katyal , I-Jeng Wang , Gregory D. Hager

Uncertainty representation and quantification are paramount in machine learning and constitute an important prerequisite for safety-critical applications. In this paper, we propose novel measures for the quantification of aleatoric and…

Machine Learning · Computer Science 2024-04-22 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

Characterizing uncertainty is a common issue in nuclear measurement and has important implications for reliable physical discovery. Traditional methods are either insufficient to cope with the heterogeneous nature of uncertainty or…

Data Analysis, Statistics and Probability · Physics 2022-03-01 Pengcheng Ai , Zhi Deng , Yi Wang , Chendi Shen

Deep learning models are being adopted and applied on various critical decision-making tasks, yet they are trained to provide point predictions without providing degrees of confidence. The trustworthiness of deep learning models can be…

Machine Learning · Computer Science 2024-10-28 Daniel Nolte , Souparno Ghosh , Ranadip Pal

Explanation methods help understand the reasons for a model's prediction. These methods are increasingly involved in model debugging, performance optimization, and gaining insights into the workings of a model. With such critical…

Machine Learning · Computer Science 2025-04-16 Mihir Mulye , Matias Valdenegro-Toro

Uncertainty quantification of deep neural networks has become an active field of research and plays a crucial role in various downstream tasks such as active learning. Recent advances in evidential deep learning shed light on the direct…

Machine Learning · Computer Science 2023-11-21 Ruxiao Duan , Brian Caffo , Harrison X. Bai , Haris I. Sair , Craig Jones

Operator learning has been increasingly adopted in scientific and engineering applications, many of which require calibrated uncertainty quantification. Since the output of operator learning is a continuous function, quantifying uncertainty…

Machine Learning · Computer Science 2024-02-07 Ziqi Ma , Kamyar Azizzadenesheli , Anima Anandkumar

Considering uncertainty estimation of modern neural networks (NNs) is one of the most important steps towards deploying machine learning systems to meaningful real-world applications such as in medicine, finance or autonomous systems. At…

Machine Learning · Computer Science 2022-05-20 Martin Ferianc , Miguel Rodrigues

Interpretability and uncertainty quantification in machine learning can provide justification for decisions, promote scientific discovery and lead to a better understanding of model behavior. Symbolic regression provides inherently…

Neural and Evolutionary Computing · Computer Science 2022-11-23 G. F. Bomarito , P. E. Leser , N. C. M Strauss , K. M. Garbrecht , J. D. Hochhalter

Much of uncertainty quantification to date has focused on determining the effect of variables modeled probabilistically, and with a known distribution, on some physical or engineering system. We develop methods to obtain information on the…

Numerical Analysis · Mathematics 2015-03-19 Kamaljit Chowdhary , Paul Dupuis