English
Related papers

Related papers: Monte Carlo Stochastic Depth for Uncertainty Estim…

200 papers

Automated segmentation of BUS images is important for precise lesion delineation and tumor characterization, but is challenged by inherent artifacts and dataset inconsistencies. In this work, we evaluate the use of a modified Residual…

We develop a novel deep learning method for uncertainty quantification in stochastic partial differential equations based on Bayesian neural network (BNN) and Hamiltonian Monte Carlo (HMC). A BNN efficiently learns the posterior…

Machine Learning · Statistics 2022-10-24 Jeahan Jung , Minseok Choi

We explore the application of the quasi-Monte Carlo (QMC) method in deep backward dynamic programming (DBDP) (Hure et al. 2020) for numerically solving high-dimensional nonlinear partial differential equations (PDEs). Our study focuses on…

Numerical Analysis · Mathematics 2024-07-23 Du Ouyang , Jichang Xiao , Xiaoqun Wang

While neural networks have demonstrated impressive performance across various tasks, accurately quantifying uncertainty in their predictions is essential to ensure their trustworthiness and enable widespread adoption in critical systems.…

Machine Learning · Statistics 2025-11-11 Joseph Wilson , Chris van der Heide , Liam Hodgkinson , Fred Roosta

In image classification tasks, the evaluation of models' robustness to increased dataset shifts with a probabilistic framework is very well studied. However, object detection (OD) tasks pose other challenges for uncertainty estimation and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Tiago Azevedo , René de Jong , Matthew Mattina , Partha Maji

Deep neural networks have become the gold-standard approach for the automated segmentation of 3D medical images. Their full acceptance by clinicians remains however hampered by the lack of intelligible uncertainty assessment of the provided…

Image and Video Processing · Electrical Eng. & Systems 2022-09-23 Benjamin Lambert , Florence Forbes , Senan Doyle , Alan Tucholka , Michel Dojat

Despite the great performance of deep learning models in many areas, they still make mistakes and underperform on certain subsets of data, i.e. error slices. Given a trained model, it is important to identify its semantically coherent error…

Machine Learning · Computer Science 2025-12-23 Han Yu , Hao Zou , Jiashuo Liu , Renzhe Xu , Yue He , Xingxuan Zhang , Peng Cui

Quantifying uncertainty of machine learning model predictions is essential for reliable decision-making, especially in safety-critical applications. Recently, uncertainty quantification (UQ) theory has advanced significantly, building on a…

Machine Learning · Computer Science 2025-10-01 Alexander Fishkov , Kajetan Schweighofer , Mykyta Ielanskyi , Nikita Kotelevskii , Mohsen Guizani , Maxim Panov

Machine learning (ML) is often viewed as a powerful data analysis tool that is easy to learn because of its black-box nature. Yet this very nature also makes it difficult to quantify confidence in predictions extracted from ML models, and…

Machine Learning · Computer Science 2025-09-30 Paul Patrone , Anthony Kearsley

We consider the problem of estimating expectations with respect to a target distribution with an unknown normalizing constant, and where even the unnormalized target needs to be approximated at finite resolution. Under such an assumption,…

Numerical Analysis · Mathematics 2023-06-29 Xinzhu Liang , Shangda Yang , Simon L. Cotter , Kody J. H. Law

Accurate brain tumor segmentation from MRI is vital for diagnosis and treatment planning. Although Monte Carlo (MC) Dropout is widely used to estimate model uncertainty, the effectiveness of variance-based uncertainty - computed as…

Machine Learning · Computer Science 2026-05-28 Saumya B

We present JaxSGMC, an application-agnostic library for stochastic gradient Markov chain Monte Carlo (SG-MCMC) in JAX. SG-MCMC schemes are uncertainty quantification (UQ) methods that scale to large datasets and high-dimensional models,…

Computation · Statistics 2025-05-19 Stephan Thaler , Paul Fuchs , Ana Cukarska , Julija Zavadlav

The quantification of uncertainty is important for the adoption of machine learning, especially to reject out-of-distribution (OOD) data back to human experts for review. Yet progress has been slow, as a balance must be struck between…

Machine Learning · Computer Science 2022-09-12 Derek Everett , Andre T. Nguyen , Luke E. Richards , Edward Raff

We consider the computational efficiency of Monte Carlo (MC) and Multilevel Monte Carlo (MLMC) methods applied to partial differential equations with random coefficients. These arise, for example, in groundwater flow modelling, where a…

Numerical Analysis · Mathematics 2024-12-12 Anastasia Istratuca , Aretha Teckentrup

In statistical analysis, Monte Carlo (MC) stands as a classical numerical integration method. When encountering challenging sample problem, Markov chain Monte Carlo (MCMC) is a commonly employed method. However, the MCMC estimator is biased…

Numerical Analysis · Mathematics 2024-11-05 Jiarui Du , Zhijian He

Quantification of uncertainty is one of the most promising approaches to establish safe machine learning. Despite its importance, it is far from being generally solved, especially for neural networks. One of the most commonly used…

Machine Learning · Computer Science 2021-01-11 Joachim Sicking , Maram Akila , Maximilian Pintz , Tim Wirtz , Asja Fischer , Stefan Wrobel

Monte Carlo (MC) dropout is a simple and efficient ensembling method that can improve the accuracy and confidence calibration of high-capacity deep neural network models. However, MC dropout is not as effective as more compute-intensive…

Machine Learning · Computer Science 2021-06-10 Zhilu Zhang , Vianne R. Gao , Mert R. Sabuncu

We describe and analyze some Monte Carlo methods for manifolds in Euclidean space defined by equality and inequality constraints. First, we give an MCMC sampler for probability distributions defined by un-normalized densities on such…

Numerical Analysis · Mathematics 2017-09-21 Emilio Zappa , Miranda Holmes-Cerfon , Jonathan Goodman

Accurate predictions and uncertainty quantification (UQ) are essential for decision-making in risk-sensitive fields such as system safety modeling. Deep ensembles (DEs) are efficient and scalable methods for UQ in Deep Neural Networks…

Machine Learning · Computer Science 2024-12-13 Zaid Abulawi , Rui Hu , Prasanna Balaprakash , Yang Liu

In the last few decades, Markov chain Monte Carlo (MCMC) methods have been widely applied to Bayesian updating of structural dynamic models in the field of structural health monitoring. Recently, several MCMC algorithms have been developed…

Applications · Statistics 2026-04-29 Xianghao Meng , James L. Beck , Yong Huang , Hui Li