English
Related papers

Related papers: Qualitative Analysis of Monte Carlo Dropout

200 papers

With increasing computational demand, Neural-Network (NN) based models are being developed as pre-trained surrogates for different thermohydraulics phenomena. An area where this approach has shown promise is in developing higher-fidelity…

Fluid Dynamics · Physics 2024-12-13 Cody Grogan , Som Dutta , Mauricio Tano , Somayajulu L. N. Dhulipala , Izabela Gutowska

Dropout has been commonly used to quantify prediction uncertainty, i.e, the variations of model predictions on a given input example. However, using dropout in practice can be expensive as it requires running dropout inferences many times.…

Machine Learning · Computer Science 2022-06-20 Haichao Yu , Zhe Chen , Dong Lin , Gil Shamir , Jie Han

In this review, we assess the use of Bayesian methods in model predictive control (MPC), focusing on neural-network-based modeling, control design, and uncertainty quantification. We systematically analyze individual studies and how they…

Artificial Intelligence · Computer Science 2025-10-08 Asli Karacelik

The Multilevel Monte Carlo method is an efficient variance reduction technique. It uses a sequence of coarse approximations to reduce the computational cost in uncertainty quantification applications. The method is nowadays often considered…

Numerical Analysis · Mathematics 2018-06-15 Pieterjan Robbe , Dirk Nuyens , Stefan Vandewalle

We propose a multi-fidelity neural network surrogate sampling method for the uncertainty quantification of physical/biological systems described by ordinary or partial differential equations. We first generate a set of low/high-fidelity…

Numerical Analysis · Mathematics 2020-05-07 Mohammad Motamed

Estimating the predictive uncertainty of a Bayesian learning model is critical in various decision-making problems, e.g., reinforcement learning, detecting adversarial attack, self-driving car. As the model posterior is almost always…

Machine Learning · Computer Science 2021-02-16 Yufei Cui , Wuguannan Yao , Qiao Li , Antoni B. Chan , Chun Jason Xue

Markov Chain Monte Carlo (MCMC) sampling is computationally expensive, especially for complex models. Alternative methods make simplifying assumptions about the posterior to reduce computational burden, but their impact on predictive…

Computation · Statistics 2025-10-27 Florian D. van Leeuwen , Sara van Erp

Deep neural networks are increasingly being used for the analysis of medical images. However, most works neglect the uncertainty in the model's prediction. We propose an uncertainty-aware deep kernel learning model which permits the…

Machine Learning · Computer Science 2021-06-11 Zhiliang Wu , Yinchong Yang , Jindong Gu , Volker Tresp

The recently introduced dropout training criterion for neural networks has been the subject of much attention due to its simplicity and remarkable effectiveness as a regularizer, as well as its interpretation as a training procedure for an…

Machine Learning · Statistics 2014-01-03 David Warde-Farley , Ian J. Goodfellow , Aaron Courville , Yoshua Bengio

Deep neural networks excel in perception tasks such as semantic segmentation and monocular depth estimation, making them indispensable in safety-critical applications like autonomous driving and industrial inspection. However, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Steven Landgraf , Markus Hillemann , Theodor Kapler , Markus Ulrich

This paper proposes a novel uncertainty quantification framework for computationally demanding systems characterized by a large vector of non-Gaussian uncertainties. It combines state-of-the-art techniques in advanced Monte Carlo sampling…

Computation · Statistics 2018-03-05 Phaedon-Stelios Koutsourelakis

Computational tools for characterizing electromagnetic scattering from objects with uncertain shapes are needed in various applications ranging from remote sensing at microwave frequencies to Raman spectroscopy at optical frequencies.…

Robustness analysis is very important in biology and neuroscience, to unravel behavioural patterns of systems that are conserved despite large parametric uncertainties. To make studies of probabilistic robustness more efficient and scalable…

Quantitative Methods · Quantitative Biology 2026-01-08 Uros Sutulovic , Daniele Proverbio , Rami Katz , Giulia Giordano

Probabilistic prediction of sequences from images and other high-dimensional data is a key challenge, particularly in risk-sensitive applications. In these settings, it is often desirable to quantify the uncertainty associated with the…

Machine Learning · Computer Science 2024-10-31 Qidong Yang , Weicheng Zhu , Joseph Keslin , Laure Zanna , Tim G. J. Rudner , Carlos Fernandez-Granda

Convolutional neural networks have shown to achieve superior performance on image segmentation tasks. However, convolutional neural networks, operating as black-box systems, generally do not provide a reliable measure about the confidence…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Alexander Treiss , Jannis Walk , Niklas Kühl

We describe Monte Carlo methods for estimating lower envelopes of expectations of real random variables. We prove that the estimation bias is negative and that its absolute value shrinks with increasing sample size. We discuss fairly…

Probability · Mathematics 2019-09-02 Arne Decadt , Gert de Cooman , Jasper De Bock

Importance sampling Monte-Carlo methods are widely used for the approximation of expectations with respect to partially known probability measures. In this paper we study a deterministic version of such an estimator based on quasi-Monte…

Computation · Statistics 2024-12-20 Josef Dick , Daniel Rudolf , Houying Zhu

In this article, we introduce the concept of model confidence bounds (MCB) for variable selection in the context of nested models. Similarly to the endpoints in the familiar confidence interval for parameter estimation, the MCB identifies…

Methodology · Statistics 2018-07-27 Yang Li , Yuetian Luo , Davide Ferrari , Xiaonan Hu , Yichen Qin

Deep learning models struggle with uncertainty estimation. Many approaches are either computationally infeasible or underestimate uncertainty. We investigate \textit{BatchEnsemble} as a general and scalable method for uncertainty estimation…

Machine Learning · Computer Science 2026-01-30 Morten Blørstad , Herman Jangsett Mostein , Nello Blaser , Pekka Parviainen

In this work we consider a class of uncertainty quantification problems where the system performance or reliability is characterized by a scalar parameter $y$. The performance parameter $y$ is random due to the presence of various sources…

Numerical Analysis · Mathematics 2016-07-20 Keyi Wu , Jinglai Li