English
Related papers

Related papers: Spatial-Temporal-Fusion BNN: Variational Bayesian …

200 papers

Modern Convolutional Neural Networks (CNN) are extremely powerful on a range of computer vision tasks. However, their performance may degrade when the data is characterised by large intra-class variability caused by spatial transformations.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Roberto Annunziata , Christos Sagonas , Jacques Calì

This paper describes and discusses Bayesian Neural Network (BNN). The paper showcases a few different applications of them for classification and regression problems. BNNs are comprised of a Probabilistic Model and a Neural Network. The…

Machine Learning · Computer Science 2018-01-31 Vikram Mullachery , Aniruddh Khera , Amir Husain

As data size and computing power increase, the architectures of deep neural networks (DNNs) have been getting more complex and huge, and thus there is a growing need to simplify such complex and huge DNNs. In this paper, we propose a novel…

Machine Learning · Statistics 2023-05-24 Insung Kong , Dongyoon Yang , Jongjin Lee , Ilsang Ohn , Yongdai Kim

Bayesian neural networks (BNNs) combine the expressive power of deep learning with the advantages of Bayesian formalism. In recent years, the analysis of wide, deep BNNs has provided theoretical insight into their priors and posteriors.…

Machine Learning · Computer Science 2022-02-24 Beau Coker , Wessel P. Bruinsma , David R. Burt , Weiwei Pan , Finale Doshi-Velez

Bayesian Neural Networks (BNNs) provide a probabilistic interpretation for deep learning models by imposing a prior distribution over model parameters and inferring a posterior distribution based on observed data. The model sampled from the…

Machine Learning · Computer Science 2023-11-15 Van-Anh Nguyen , Tung-Long Vuong , Hoang Phan , Thanh-Toan Do , Dinh Phung , Trung Le

Bayesian approaches for learning deep neural networks (BNN) have been received much attention and successfully applied to various applications. Particularly, BNNs have the merit of having better generalization ability as well as better…

Machine Learning · Statistics 2023-05-25 Insung Kong , Dongyoon Yang , Jongjin Lee , Ilsang Ohn , Gyuseung Baek , Yongdai Kim

Bayesian neural networks (BNNs) promise improved generalization under covariate shift by providing principled probabilistic representations of epistemic uncertainty. However, weight-based BNNs often struggle with high computational…

Machine Learning · Statistics 2022-06-13 Trung Trinh , Markus Heinonen , Luigi Acerbi , Samuel Kaski

We propose Radial Bayesian Neural Networks (BNNs): a variational approximate posterior for BNNs which scales well to large models while maintaining a distribution over weight-space with full support. Other scalable Bayesian deep learning…

Machine Learning · Statistics 2021-06-01 Sebastian Farquhar , Michael Osborne , Yarin Gal

Uncertainty in biological neural systems appears to be computationally beneficial rather than detrimental. However, in neuromorphic computing systems, device variability often limits performance, including accuracy and efficiency. In this…

Neural and Evolutionary Computing · Computer Science 2026-02-10 Huannan Zheng , Jingli Liu , Kezhou Yang

Binary Stochastic Filtering (BSF), the algorithm for feature selection and neuron pruning is proposed in this work. The method defines filtering layer which penalizes amount of the information involved in the training process. This…

Machine Learning · Computer Science 2019-08-21 Andrii Trelin , Ales Prochazka

Function-space priors in Bayesian Neural Networks (BNNs) provide a more intuitive approach to embedding beliefs directly into the model's output, thereby enhancing regularization, uncertainty quantification, and risk-aware decision-making.…

Machine Learning · Computer Science 2025-08-13 Marcin Sendera , Amin Sorkhei , Tomasz Kuśmierczyk

While Bayesian neural networks (BNNs) hold the promise of being flexible, well-calibrated statistical models, inference often requires approximations whose consequences are poorly understood. We study the quality of common variational…

Machine Learning · Statistics 2020-10-26 Andrew Y. K. Foong , David R. Burt , Yingzhen Li , Richard E. Turner

The need for function estimation in label-limited settings is common in the natural sciences. At the same time, prior knowledge of function values is often available in these domains. For example, data-free biophysics-based models can be…

Machine Learning · Computer Science 2022-10-17 Hunter Nisonoff , Yixin Wang , Jennifer Listgarten

Conventional federated learning (FL) frameworks often suffer from training degradation due to data uncertainty and heterogeneity across local clients. Probabilistic approaches such as Bayesian neural networks (BNNs) can mitigate this issue…

Machine Learning · Computer Science 2026-03-20 Ratun Rahman , Dinh C. Nguyen

We propose a new class of Bayesian neural networks (BNNs) that can be trained using noisy data of variable fidelity, and we apply them to learn function approximations as well as to solve inverse problems based on partial differential…

Machine Learning · Computer Science 2021-06-02 Xuhui Meng , Hessam Babaee , George Em Karniadakis

Bayesian Neural Networks (BNNs) that possess a property of uncertainty estimation have been increasingly adopted in a wide range of safety-critical AI applications which demand reliable and robust decision making, e.g., self-driving, rescue…

Hardware Architecture · Computer Science 2021-10-08 Qiyu Wan , Haojun Xia , Xingyao Zhang , Lening Wang , Shuaiwen Leon Song , Xin Fu

Bayesian Neural Networks (BNNs) provide a tool to estimate the uncertainty of a neural network by considering a distribution over weights and sampling different models for each input. In this paper, we propose a method for uncertainty…

Machine Learning · Computer Science 2024-10-28 Illia Oleksiienko , Dat Thanh Tran , Alexandros Iosifidis

Bayesian Neural Networks (BNNs) provide principled uncertainty quantification but suffer from substantial computational and memory overhead compared to deterministic networks. While quantization techniques have successfully reduced resource…

Machine Learning · Computer Science 2025-12-12 Hendrik Borras , Yong Wu , Bernhard Klein , Holger Fröning

Bayesian Neural Networks (BNNs) offer a principled and natural framework for proper uncertainty quantification in the context of deep learning. They address the typical challenges associated with conventional deep learning methods, such as…

Computation · Statistics 2024-11-13 Zahra Moslemi , Yang Meng , Shiwei Lan , Babak Shahbaba

Neural network ensembles, such as Bayesian neural networks (BNNs), have shown success in the areas of uncertainty estimation and robustness. However, a crucial challenge prohibits their use in practice. BNNs require a large number of…

Machine Learning · Computer Science 2022-07-15 Namuk Park , Songkuk Kim