English
Related papers

Related papers: Scalable Uncertainty Quantification for Deep Opera…

200 papers

Statistical learning algorithms provide a generally-applicable framework to sidestep time-consuming experiments, or accurate physics-based modeling, but they introduce a further source of error on top of the intrinsic limitations of the…

Chemical Physics · Physics 2024-05-17 Matthias Kellner , Michele Ceriotti

In this paper, we approach the problem of uncertainty quantification in deep learning through a predictive framework, which captures uncertainty in model parameters by specifying our assumptions about the predictive distribution of unseen…

Machine Learning · Statistics 2024-03-20 Luhuan Wu , Sinead Williamson

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

Prior Networks are a recently developed class of models which yield interpretable measures of uncertainty and have been shown to outperform state-of-the-art ensemble approaches on a range of tasks. They can also be used to distill an…

Machine Learning · Computer Science 2020-12-10 Andrey Malinin , Sergey Chervontsev , Ivan Provilkov , Mark Gales

Deep learning models achieve high predictive accuracy across a broad spectrum of tasks, but rigorously quantifying their predictive uncertainty remains challenging. Usable estimates of predictive uncertainty should (1) cover the true…

Machine Learning · Computer Science 2020-07-28 Ahmed M. Alaa , Mihaela van der Schaar

We evaluate uncertainty quantification (UQ) methods for deep learning applied to liquid argon time projection chamber (LArTPC) physics analysis tasks. As deep learning applications enter widespread usage among physics data analysis, neural…

High Energy Physics - Experiment · Physics 2023-11-02 Dae Heun Koh , Aashwin Mishra , Kazuhiro Terao

While Deep Neural Networks (DNNs) achieve state-of-the-art accuracy in various applications, they often fall short in accurately estimating their predictive uncertainty and, in turn, fail to recognize when these predictions may be wrong.…

Machine Learning · Computer Science 2020-07-22 Ankur Mallick , Chaitanya Dwivedi , Bhavya Kailkhura , Gauri Joshi , T. Yong-Jin Han

Deep neural networks are in the limelight of machine learning with their excellent performance in many data-driven applications. However, they can lead to inaccurate predictions when queried in out-of-distribution data points, which can…

Machine Learning · Computer Science 2023-03-01 Yana Stoyanova , Soroush Ghandi , Maryam Tavakol

Data-driven forecasts of air quality have recently achieved more accurate short-term predictions. Despite their success, most of the current data-driven solutions lack proper quantifications of model uncertainty that communicate how much to…

Machine Learning · Computer Science 2021-12-07 Abdulmajid Murad , Frank Alexander Kraemer , Kerstin Bach , Gavin Taylor

Time-series with volatility clustering pose a unique challenge to uncertainty quantification (UQ) for returns forecasts. Methods for UQ such as Deep Evidential regression offer a simple way of quantifying return forecast uncertainty without…

Statistical Finance · Quantitative Finance 2024-09-20 Steven Y. K. Wong , Jennifer S. K. Chan , Lamiae Azizi

Reliable predictive uncertainty estimation plays an important role in enabling the deployment of neural networks to safety-critical settings. A popular approach for estimating the predictive uncertainty of neural networks is to define a…

Machine Learning · Statistics 2023-12-29 Tim G. J. Rudner , Zonghao Chen , Yee Whye Teh , Yarin Gal

Energy-efficient deep learning algorithms are essential for a sustainable future and feasible edge computing setups. Spiking neural networks (SNNs), inspired from neuroscience, are a positive step in the direction of achieving the required…

Machine Learning · Statistics 2024-12-13 Shailesh Garg , Souvik Chakraborty

Recurrent neural networks (RNNs) are instrumental in modelling sequential and time-series data. Yet, when using RNNs to inform decision-making, predictions by themselves are not sufficient; we also need estimates of predictive uncertainty.…

Machine Learning · Computer Science 2020-06-30 Ahmed M. Alaa , Mihaela van der Schaar

In this paper we address the problem of uncertainty management for robust design, and verification of large dynamic networks whose performance is affected by an equally large number of uncertain parameters. Many such networks (e.g. power,…

Computation · Statistics 2011-10-12 Amit Surana , Tuhin Sahai , Andrzej Banaszuk

This study aims to comprehensively investigate the deep ensemble approach, an approximate Bayesian inference, in the multi-output regression task for predicting the aerodynamic performance of a missile configuration. To this end, the effect…

Machine Learning · Computer Science 2023-11-27 Sunwoong Yang , Kwanjung Yee

The use of Deep Neural Network (DNN) models in risk-based decision-making has attracted extensive attention with broad applications in medical, finance, manufacturing, and quality control. To mitigate prediction-related risks in decision…

Machine Learning · Statistics 2023-10-11 Maryam Kheirandish , Shengfan Zhang , Donald G. Catanzaro , Valeriu Crudu

We propose a method for training a deterministic deep model that can find and reject out of distribution data points at test time with a single forward pass. Our approach, deterministic uncertainty quantification (DUQ), builds upon ideas of…

Machine Learning · Computer Science 2020-06-30 Joost van Amersfoort , Lewis Smith , Yee Whye Teh , Yarin Gal

The opaque nature of transformer-based models, particularly in applications susceptible to unethical practices such as dark-patterns in user interfaces, requires models that integrate uncertainty quantification to enhance trust in…

Machine Learning · Computer Science 2024-12-09 Javier Muñoz , Álvaro Huertas-García , Carlos Martí-González , Enrique De Miguel Ambite

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

Development of an accurate, flexible, and numerically efficient uncertainty quantification (UQ) method is one of fundamental challenges in machine learning. Previously, a UQ method called DISCO Nets has been proposed (Bouchacourt et al.,…

Machine Learning · Computer Science 2023-07-06 Takuya Kanazawa , Chetan Gupta