English
Related papers

Related papers: Single Model Uncertainty Estimation via Stochastic…

200 papers

Traditional deep learning (DL) models are powerful classifiers, but many approaches do not provide uncertainties for their estimates. Uncertainty quantification (UQ) methods for DL models have received increased attention in the literature…

Machine Learning · Computer Science 2023-08-14 Daniel Ries , Joshua Michalenko , Tyler Ganter , Rashad Imad-Fayez Baiyasi , Jason Adams

The training dynamics and generalization properties of neural networks (NN) can be precisely characterized in function space via the neural tangent kernel (NTK). Structural changes to the NTK during training reflect feature learning and…

Machine Learning · Statistics 2022-02-11 Haozhe Shan , Blake Bordelon

Neural network (NN) potentials promise highly accurate molecular dynamics (MD) simulations within the computational complexity of classical MD force fields. However, when applied outside their training domain, NN potential predictions can…

Chemical Physics · Physics 2023-07-28 Stephan Thaler , Gregor Doehner , Julija Zavadlav

Uncertainty quantification (UQ) is a crucial but challenging task in many high-dimensional regression or learning problems to increase the confidence of a given predictor. We develop a new data-driven approach for UQ in regression that…

Machine Learning · Computer Science 2024-07-19 Frederik Hoppe , Claudio Mayrink Verdun , Hannah Laus , Felix Krahmer , Holger Rauhut

With the advancement of GPS, remote sensing, and computational simulations, large amounts of geospatial and spatiotemporal data are being collected at an increasing speed. Such emerging spatiotemporal big data assets, together with the…

Machine Learning · Computer Science 2024-06-24 Wenchong He , Zhe Jiang

A quantum neural network (QNN) is a parameterized mapping efficiently implementable on near-term Noisy Intermediate-Scale Quantum (NISQ) computers. It can be used for supervised learning when combined with classical gradient-based…

Quantum Physics · Physics 2023-03-28 Xuchen You , Shouvanik Chakrabarti , Boyang Chen , Xiaodi Wu

Accurate uncertainty quantification is a critical challenge in machine learning. While neural networks are highly versatile and capable of learning complex patterns, they often lack interpretability due to their ``black box'' nature. On the…

Machine Learning · Computer Science 2025-11-18 Pragatheeswaran Vipulananthan , Kamal Premaratne , Dilip Sarkar , Manohar N. Murthi

In scientific applications, predictive modeling is often of limited use without accurate uncertainty quantification (UQ) to indicate when a model may be extrapolating or when more data needs to be collected. Bayesian Neural Networks (BNNs)…

Machine Learning · Computer Science 2025-09-26 Scott Koermer , Natalie Klein

Neural networks predictions are unreliable when the input sample is out of the training distribution or corrupted by noise. Being able to detect such failures automatically is fundamental to integrate deep learning algorithms into robotics.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Antonio Loquercio , Mattia Segù , Davide Scaramuzza

Uncertainty is a key feature of any machine learning model and is particularly important in neural networks, which tend to be overconfident. This overconfidence is worrying under distribution shifts, where the model performance silently…

Machine Learning · Computer Science 2024-03-18 Arthur Thuy , Dries F. Benoit

While Deep Neural Networks (DNNs) achieve state-of-the-art accuracy in various applications, they often fall short in accurately estimating their predictive uncertainty and, in turn, fail to recognize when these predictions may be wrong.…

Machine Learning · Computer Science 2020-07-22 Ankur Mallick , Chaitanya Dwivedi , Bhavya Kailkhura , Gauri Joshi , T. Yong-Jin Han

We investigate the problem of weight uncertainty originally proposed by [Blundell et al. (2015). Weight uncertainty in neural networks. In International conference on machine learning, 1613-1622, PMLR.] in the context of neural networks…

Machine Learning · Statistics 2026-03-03 Moein Monemi , Morteza Amini , S. Mahmoud Taheri , Mohammad Arashi

Bayesian neural networks (BNNs) augment deep networks with uncertainty quantification by Bayesian treatment of the network weights. However, such models face the challenge of Bayesian inference in a high-dimensional and usually…

Machine Learning · Computer Science 2021-03-30 Zhijie Deng , Yucen Luo , Jun Zhu , Bo Zhang

Temporal-Difference (TD) learning methods, such as Q-Learning, have proven effective at learning a policy to perform control tasks. One issue with methods like Q-Learning is that the value update introduces bias when predicting the TD…

Machine Learning · Computer Science 2021-10-29 Litian Liang , Yaosheng Xu , Stephen McAleer , Dailin Hu , Alexander Ihler , Pieter Abbeel , Roy Fox

With the increased use of data-driven approaches and machine learning-based methods in material science, the importance of reliable uncertainty quantification (UQ) of the predicted variables for informed decision-making cannot be…

Machine Learning · Computer Science 2024-05-15 Longze Li , Jiang Chang , Aleksandar Vakanski , Yachun Wang , Tiankai Yao , Min Xian

Prediction uncertainty estimation has clinical significance as it can potentially quantify prediction reliability. Clinicians may trust 'blackbox' models more if robust reliability information is available, which may lead to more models…

Machine Learning · Computer Science 2022-10-04 Michael Dohopolski , Kai Wang , Biling Wang , Ti Bai , Dan Nguyen , David Sher , Steve Jiang , Jing Wang

How can we quantify uncertainty if our favorite computational tool - be it a numerical, a statistical, or a machine learning approach, or just any computer model - provides single-valued output only? In this article, we introduce the Easy…

Methodology · Statistics 2023-07-25 Eva-Maria Walz , Alexander Henzi , Johanna Ziegel , Tilmann Gneiting

The Neural Tangent Kernel (NTK) is an important milestone in the ongoing effort to build a theory for deep learning. Its prediction that sufficiently wide neural networks behave as kernel methods, or equivalently as random feature models,…

Machine Learning · Computer Science 2020-06-25 Maxim Samarin , Volker Roth , David Belius

Uncertainty quantification (UQ) in machine learning is currently drawing increasing research interest, driven by the rapid deployment of deep neural networks across different fields, such as computer vision, natural language processing, and…

Machine Learning · Computer Science 2022-08-26 Zongren Zou , Xuhui Meng , Apostolos F Psaros , George Em Karniadakis

Uncertainty estimation methods using deep learning approaches strive against separating how uncertain the state of the world manifests to us via measurement (objective end) from the way this gets scrambled with the model specification and…

Machine Learning · Statistics 2023-04-21 Edgardo Solano-Carrillo