English
Related papers

Related papers: Is MC Dropout Bayesian?

200 papers

The Monte Carlo dropout method has proved to be a scalable and easy-to-use approach for estimating the uncertainty of deep neural network predictions. This approach was recently applied to Fault Detection and Di-agnosis (FDD) applications…

Machine Learning · Computer Science 2019-09-11 Baihong Jin , Yingshui Tan , Yuxin Chen , Alberto Sangiovanni-Vincentelli

Uncertainty estimation in Neural Networks (NNs) is vital in improving reliability and confidence in predictions, particularly in safety-critical applications. Bayesian Neural Networks (BayNNs) with Dropout as an approximation offer a…

Machine Learning · Computer Science 2024-01-12 Soyed Tuhin Ahmed , Kamal Danouchi , Michael Hefenbrock , Guillaume Prenat , Lorena Anghel , Mehdi B. Tahoori

Because of their multimodality, mixture posterior distributions are difficult to sample with standard Markov chain Monte Carlo (MCMC) methods. We propose a strategy to enhance the sampling of MCMC in this context, using a biasing procedure…

Computation · Statistics 2011-04-19 Nicolas Chopin , Tony Lelievre , Gabriel Stoltz

Knowing the uncertainty associated with the output of a deep neural network is of paramount importance in making trustworthy decisions, particularly in high-stakes fields like medical diagnosis and autonomous systems. Monte Carlo Dropout…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Hamzeh Asgharnezhad , Afshar Shamsi , Roohallah Alizadehsani , Arash Mohammadi , Hamid Alinejad-Rokny

Bayesian model averaging, model selection and its approximations such as BIC are generally statistically consistent, but sometimes achieve slower rates og convergence than other methods such as AIC and leave-one-out cross-validation. On the…

Statistics Theory · Mathematics 2008-09-17 Tim van Erven , Peter Grunwald , Steven de Rooij

While Bayesian methods are extremely popular in statistics and machine learning, their application to massive datasets is often challenging, when possible at all. Indeed, the classical MCMC algorithms are prohibitively slow when both the…

Statistics Theory · Mathematics 2019-04-23 Pierre Alquier , James Ridgway

Acyclic digraphs are the underlying representation of Bayesian networks, a widely used class of probabilistic graphical models. Learning the underlying graph from data is a way of gaining insights about the structural properties of a…

Machine Learning · Statistics 2022-05-06 Jack Kuipers , Giusi Moffa

In classification applications, we often want probabilistic predictions to reflect confidence or uncertainty. Dropout, a commonly used training technique, has recently been linked to Bayesian inference, yielding an efficient way to quantify…

Machine Learning · Computer Science 2019-06-25 Zhilu Zhang , Adrian V. Dalca , Mert R. Sabuncu

Approximate Bayesian Computational (ABC) methods (or likelihood-free methods) have appeared in the past fifteen years as useful methods to perform Bayesian analyses when the likelihood is analytically or computationally intractable. Several…

Methodology · Statistics 2012-05-01 Meili Baragatti , Agnès Grimaud , Denys Pommeret

Mechanistic models of single-neuron dynamics have been extensively studied in computational neuroscience. However, identifying which models can quantitatively reproduce empirically measured data has been challenging. We propose to overcome…

Approximate Bayesian Computation (ABC for short) is a family of computational techniques which offer an almost automated solution in situations where evaluation of the posterior likelihood is computationally prohibitive, or whenever…

Statistics Theory · Mathematics 2013-06-04 Gérard Biau , Frédéric Cérou , Arnaud Guyader

Dropout has been proven to be an effective algorithm for training robust deep networks because of its ability to prevent overfitting by avoiding the co-adaptation of feature detectors. Current explanations of dropout include bagging, naive…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Xu Shen , Xinmei Tian , Tongliang Liu , Fang Xu , Dacheng Tao

While MCMC methods have become a main work-horse for Bayesian inference, scaling them to large distributed datasets is still a challenge. Embarrassingly parallel MCMC strategies take a divide-and-conquer stance to achieve this by writing…

Machine Learning · Computer Science 2021-06-16 Diego Mesquita , Paul Blomstedt , Samuel Kaski

To adopt neural networks in safety critical domains, knowing whether we can trust their predictions is crucial. Bayesian neural networks (BNNs) provide uncertainty estimates by averaging predictions with respect to the posterior weight…

Machine Learning · Computer Science 2021-03-17 Jannik Schmitt , Stefan Roth

Finite mixture models are used in statistics and other disciplines, but inference for mixture models is challenging due, in part, to the multimodality of the likelihood function and the so-called label switching problem. We propose…

Methodology · Statistics 2020-11-03 Umberto Simola , Jessi Cisewski-Kehe , Robert L. Wolpert

Estimating model parameters of a general family of cure models is always a challenging task mainly due to flatness and multimodality of the likelihood function. In this work, we propose a fully Bayesian approach in order to overcome these…

Methodology · Statistics 2024-08-20 Panagiotis Papastamoulis , Fotios Milienos

Approximate Bayesian computation (ABC) is commonly used for parameter estimation and model comparison for intractable simulator-based models whose likelihood function cannot be evaluated. In this paper we instead investigate the feasibility…

Methodology · Statistics 2022-09-13 Marko Järvenpää , Jukka Corander

Accurate brain tumor segmentation from MRI is vital for diagnosis and treatment planning. Although Monte Carlo (MC) Dropout is widely used to estimate model uncertainty, the effectiveness of variance-based uncertainty - computed as…

Machine Learning · Computer Science 2026-05-28 Saumya B

The radio astronomy community is adopting deep learning techniques to deal with the huge data volumes expected from the next-generation of radio observatories. Bayesian neural networks (BNNs) provide a principled way to model uncertainty in…

Instrumentation and Methods for Astrophysics · Physics 2023-11-15 Devina Mohan , Anna Scaife

Undirected graphical models are applied in genomics, protein structure prediction, and neuroscience to identify sparse interactions that underlie discrete data. Although Bayesian methods for inference would be favorable in these contexts,…

Machine Learning · Statistics 2017-06-15 John Ingraham , Debora Marks