English
Related papers

Related papers: The Bayesian Confidence (BACON) Estimator for Deep…

200 papers

Objective: Convolutional neural networks (CNNs) have demonstrated promise in automated cardiac magnetic resonance image segmentation. However, when using CNNs in a large real-world dataset, it is important to quantify segmentation…

Image and Video Processing · Electrical Eng. & Systems 2023-01-02 Matthew Ng , Fumin Guo , Labonny Biswas , Steffen E. Petersen , Stefan K. Piechnik , Stefan Neubauer , Graham Wright

How can we efficiently compress Convolutional Neural Network (CNN) while retaining their accuracy on classification tasks? Depthwise Separable Convolution (DSConv), which replaces a standard convolution with a depthwise convolution and a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Jun-Gi Jang , Chun Quan , Hyun Dong Lee , U Kang

The is no other model or hypothesis verification tool in Bayesian statistics that is as widely used as the Bayes factor. We focus on generative models that are likelihood-free and, therefore, render the computation of Bayes factors…

Methodology · Statistics 2024-12-30 Jungeum Kim , Veronika Rockova

Multiple techniques for producing calibrated predictive probabilities using deep neural networks in supervised learning settings have emerged that leverage approaches to ensemble diverse solutions discovered during cyclic training or…

Machine Learning · Computer Science 2021-12-08 John T. Holodnak , Allan B. Wollaber

Bayesian Neural Networks (BNNs) have become one of the promising approaches for uncertainty estimation due to the solid theorical foundations. However, the performance of BNNs is affected by the ability of catching uncertainty. Instead of…

Machine Learning · Computer Science 2024-04-15 Shiyu Shen , Bin Pan , Tianyang Shi , Tao Li , Zhenwei Shi

The Bayes Error Rate (BER) is the fundamental limit on the achievable generalizable classification accuracy of any machine learning model due to inherent uncertainty within the data. BER estimators offer insight into the difficulty of any…

Machine Learning · Computer Science 2025-09-24 Lesley Wheat , Martin v. Mohrenschildt , Saeid Habibi

The Deep Operator Networks~(DeepONet) is a fundamentally different class of neural networks that we train to approximate nonlinear operators, including the solution operator of parametric partial differential equations (PDE). DeepONets have…

Numerical Analysis · Mathematics 2021-11-05 Guang Lin , Christian Moya , Zecheng Zhang

We implement a Bayesian inference process for Neural Networks to model the time to failure of highly reliable weapon systems with interval-censored data and time-varying covariates. We analyze and benchmark our approach, LaplaceNN, on…

Machine Learning · Computer Science 2024-01-09 Michael Potter , Miru Jun

Achieving robust uncertainty quantification for deep neural networks represents an important requirement in many real-world applications of deep learning such as medical imaging where it is necessary to assess the reliability of a neural…

Machine Learning · Computer Science 2024-03-15 Tim Rensmeyer , Oliver Niggemann

Generalization is essential for deep learning. In contrast to previous works claiming that Deep Neural Networks (DNNs) have an implicit regularization implemented by the stochastic gradient descent, we demonstrate explicitly Bayesian…

Machine Learning · Computer Science 2019-10-23 Xinjie Lan , Kenneth E. Barner

Deep neural networks have achieved impressive results on a wide variety of tasks. However, quantifying uncertainty in the network's output is a challenging task. Bayesian models offer a mathematical framework to reason about model…

Machine Learning · Computer Science 2019-05-28 Manikanta Srikar Yellapragada , Chandra Prakash Konkimalla

A key challenge for deploying deep neural networks (DNNs) in safety critical settings is the need to provide rigorous ways to quantify their uncertainty. In this paper, we propose a novel algorithm for constructing predicted classification…

Machine Learning · Computer Science 2021-03-19 Sangdon Park , Shuo Li , Insup Lee , Osbert Bastani

Despite their incredible performance, it is well reported that deep neural networks tend to be overoptimistic about their prediction confidence. Finding effective and efficient calibration methods for neural networks is therefore an…

Machine Learning · Computer Science 2023-09-07 Lucas Clarté , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

One major impediment to the wider use of deep learning for clinical decision making is the difficulty of assigning a level of confidence to model predictions. Currently, deep Bayesian neural networks and sparse Gaussian processes are the…

Due to the importance of uncertainty quantification (UQ), Bayesian approach to inverse problems has recently gained popularity in applied mathematics, physics, and engineering. However, traditional Bayesian inference methods based on Markov…

Computation · Statistics 2022-04-26 Shiwei Lan , Shuyi Li , Babak Shahbaba

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using…

Machine Learning · Statistics 2019-05-28 Aliaksandr Hubin , Geir Storvik

Bayesian Neural Networks (BNNs) place priors over the parameters in a neural network. Inference in BNNs, however, is difficult; all inference methods for BNNs are approximate. In this work, we empirically compare the quality of predictive…

Machine Learning · Computer Science 2019-06-25 Jiayu Yao , Weiwei Pan , Soumya Ghosh , Finale Doshi-Velez

In recent years, researchers in decision analysis and artificial intelligence (AI) have used Bayesian belief networks to build models of expert opinion. Using standard methods drawn from the theory of computational complexity, workers in…

Artificial Intelligence · Computer Science 2013-04-05 R. Martin Chavez , Gregory F. Cooper

In the event of a nuclear accident, or the detonation of a radiological dispersal device, quickly locating the source of the accident or blast is important for emergency response and environmental decontamination. At a specified time after…

Machine Learning · Computer Science 2025-02-26 Christopher Edwards , Ralph C Smith

Approximate Bayesian Computation (ABC) is a powerful method for carrying out Bayesian inference when the likelihood is computationally intractable. However, a drawback of ABC is that it is an approximate method that induces a systematic…

Methodology · Statistics 2015-09-29 Minh Ngoc Tran , Robert Kohn