中文
相关论文

相关论文: Few-sample Variational Inference of Bayesian Neura…

200 篇论文

Achieving robust uncertainty quantification for deep neural networks represents an important requirement in many real-world applications of deep learning such as medical imaging where it is necessary to assess the reliability of a neural…

机器学习 · 计算机科学 2024-03-15 Tim Rensmeyer , Oliver Niggemann

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than…

机器学习 · 统计学 2022-09-07 Joel Janek Dabrowski , Daniel Edward Pagendam

Bayesian Neural Networks (BNNs) offer a principled and natural framework for proper uncertainty quantification in the context of deep learning. They address the typical challenges associated with conventional deep learning methods, such as…

统计计算 · 统计学 2024-11-13 Zahra Moslemi , Yang Meng , Shiwei Lan , Babak Shahbaba

This paper describes and discusses Bayesian Neural Network (BNN). The paper showcases a few different applications of them for classification and regression problems. BNNs are comprised of a Probabilistic Model and a Neural Network. The…

机器学习 · 计算机科学 2018-01-31 Vikram Mullachery , Aniruddh Khera , Amir Husain

Modern neural networks have proven to be powerful function approximators, providing state-of-the-art performance in a multitude of applications. They however fall short in their ability to quantify confidence in their predictions - this is…

机器学习 · 统计学 2020-06-29 Alex J. Chan , Ahmed M. Alaa , Zhaozhi Qian , Mihaela van der Schaar

Modern neural network architectures have achieved remarkable accuracies but remain highly dependent on their training data, often lacking interpretability in their learned mappings. While effective on large datasets, they tend to overfit on…

机器学习 · 计算机科学 2025-03-19 Pavia Bera , Sanjukta Bhanja

Recurrent neural networks (RNNs) are nonlinear dynamical models commonly used in the machine learning and dynamical systems literature to represent complex dynamical or sequential relationships between variables. More recently, as deep…

统计方法学 · 统计学 2018-02-08 Patrick L. McDermott , Christopher K. Wikle

Understanding the uncertainty of a neural network's (NN) predictions is essential for many purposes. The Bayesian framework provides a principled approach to this, however applying it to NNs is challenging due to large numbers of parameters…

机器学习 · 统计学 2020-02-27 Tim Pearce , Felix Leibfried , Alexandra Brintrup , Mohamed Zaki , Andy Neely

Active learning optimizes the exploration of large parameter spaces by strategically selecting which experiments or simulations to conduct, thus reducing resource consumption and potentially accelerating scientific discovery. A key…

机器学习 · 计算机科学 2024-05-20 Maxim Ziatdinov

Neural networks have achieved remarkable performance across various problem domains, but their widespread applicability is hindered by inherent limitations such as overconfidence in predictions, lack of interpretability, and vulnerability…

机器学习 · 统计学 2023-09-29 Julyan Arbel , Konstantinos Pitas , Mariia Vladimirova , Vincent Fortuin

Bayesian Neural Networks (BNNs) offer robust uncertainty quantification in model predictions, but training them presents a significant computational challenge. This is mainly due to the problem of sampling multimodal posterior distributions…

机器学习 · 计算机科学 2025-01-14 Ratneel Deo , Scott Sisson , Jody M. Webster , Rohitash Chandra

We investigate uncertainty estimation and multimodality via the non-deterministic predictions of Bayesian neural networks (BNNs) in fluid simulations. To this end, we deploy BNNs in three challenging experimental test-cases of increasing…

流体动力学 · 物理学 2022-05-04 Maximilian Mueller , Robin Greif , Frank Jenko , Nils Thuerey

Variational Bayesian neural networks (BNNs) perform variational inference over weights, but it is difficult to specify meaningful priors and approximate posteriors in a high-dimensional weight space. We introduce functional variational…

机器学习 · 计算机科学 2019-03-15 Shengyang Sun , Guodong Zhang , Jiaxin Shi , Roger Grosse

Bayesian neural networks (BNNs) allow rigorous uncertainty quantification in deep learning, but often come at a prohibitive computational cost. We propose three different innovative architectures of partial trace-class Bayesian neural…

机器学习 · 统计学 2025-11-04 Arran Carter , Torben Sell

Convolutional neural networks (CNNs) work well on large datasets. But labelled data is hard to collect, and in some applications larger amounts of data are not available. The problem then is how to use CNNs with small data -- as CNNs…

机器学习 · 统计学 2016-01-19 Yarin Gal , Zoubin Ghahramani

We propose a new class of Bayesian neural networks (BNNs) that can be trained using noisy data of variable fidelity, and we apply them to learn function approximations as well as to solve inverse problems based on partial differential…

机器学习 · 计算机科学 2021-06-02 Xuhui Meng , Hessam Babaee , George Em Karniadakis

We present a novel approach for training deep neural networks in a Bayesian way. Classical, i.e. non-Bayesian, deep learning has two major drawbacks both originating from the fact that network parameters are considered to be deterministic.…

机器学习 · 统计学 2019-03-11 Konstantin Posch , Jan Steinbrener , Jürgen Pilz

This article expands the framework of Bayesian inference and provides direct probabilistic methods for approaching inference tasks that are typically handled with information theory. We treat Bayesian probability updating as a random…

数据分析、统计与概率 · 物理学 2023-11-20 Kevin Vanslette

Bayesian Neural Networks (BNNs) provide principled uncertainty quantification but suffer from substantial computational and memory overhead compared to deterministic networks. While quantization techniques have successfully reduced resource…

机器学习 · 计算机科学 2025-12-12 Hendrik Borras , Yong Wu , Bernhard Klein , Holger Fröning

We present a new method to propagate lower bounds on conditional probability distributions in conventional Bayesian networks. Our method guarantees to provide outer approximations of the exact lower bounds. A key advantage is that we can…

人工智能 · 计算机科学 2012-05-14 Daniel Andrade , Bernhard Sick