English
Related papers

Related papers: Accelerated Execution of Bayesian Neural Networks …

200 papers

Bayesian neural network posterior distributions have a great number of modes that correspond to the same network function. The abundance of such modes can make it difficult for approximate inference methods to do their job. Recent work has…

Machine Learning · Statistics 2024-07-03 Tommy Rochussen

Bayesian Neural Networks (BNNs) provide a tool to estimate the uncertainty of a neural network by considering a distribution over weights and sampling different models for each input. In this paper, we propose a method for uncertainty…

Machine Learning · Computer Science 2024-10-28 Illia Oleksiienko , Dat Thanh Tran , Alexandros Iosifidis

Bayesian neural networks (BNNs) have received an increased interest in the last years. In BNNs, a complete posterior distribution of the unknown weight and bias parameters of the network is produced during the training stage. This…

Machine Learning · Computer Science 2023-04-14 Yunshi Huang , Emilie Chouzenoux , Victor Elvira , Jean-Christophe Pesquet

Particle image velocimetry (PIV) is an effective tool in experimental fluid mechanics to extract flow fields from images. Recently, convolutional neural networks (CNNs) have been used to perform PIV analysis with accuracy on par with…

Fluid Dynamics · Physics 2021-07-07 Mia Morrell , Kyle Hickmann , Brandon Wilson

Recurrent neural networks (RNNs) have been extraordinarily successful for prediction with sequential data. To tackle highly variable and noisy real-world data, we introduce Particle Filter Recurrent Neural Networks (PF-RNNs), a new RNN…

Machine Learning · Computer Science 2019-12-03 Xiao Ma , Peter Karkus , David Hsu , Wee Sun Lee

The need for function estimation in label-limited settings is common in the natural sciences. At the same time, prior knowledge of function values is often available in these domains. For example, data-free biophysics-based models can be…

Machine Learning · Computer Science 2022-10-17 Hunter Nisonoff , Yixin Wang , Jennifer Listgarten

While Bayesian neural networks (BNNs) hold the promise of being flexible, well-calibrated statistical models, inference often requires approximations whose consequences are poorly understood. We study the quality of common variational…

Machine Learning · Statistics 2020-10-26 Andrew Y. K. Foong , David R. Burt , Yingzhen Li , Richard E. Turner

Deep neural networks (NNs) are powerful black box predictors that have recently achieved impressive performance on a wide spectrum of tasks. Quantifying predictive uncertainty in NNs is a challenging and yet unsolved problem. Bayesian NNs,…

Machine Learning · Statistics 2017-11-07 Balaji Lakshminarayanan , Alexander Pritzel , Charles Blundell

Bayesian neural networks (BNNs) combine the expressive power of deep learning with the advantages of Bayesian formalism. In recent years, the analysis of wide, deep BNNs has provided theoretical insight into their priors and posteriors.…

Machine Learning · Computer Science 2022-02-24 Beau Coker , Wessel P. Bruinsma , David R. Burt , Weiwei Pan , Finale Doshi-Velez

Animals are known to make efficient probabilistic inferences based on uncertain and noisy information from the outside world. Although it is known that generic neural networks can perform near-optimal point estimation by probabilistic…

Neurons and Cognition · Quantitative Biology 2021-11-10 Kohei Ichikawa , Asaki Kataoka

Artificial neural networks (NNs) have become the de facto standard in machine learning. They allow learning highly nonlinear transformations in a plethora of applications. However, NNs usually only provide point estimates without…

Machine Learning · Statistics 2020-09-11 Marco F. Huber

Existing methods for estimating uncertainty in deep learning tend to require multiple forward passes, making them unsuitable for applications where computational resources are limited. To solve this, we perform probabilistic reasoning over…

Machine Learning · Statistics 2020-12-08 Javier Antorán , James Urquhart Allingham , José Miguel Hernández-Lobato

Convolutional neural networks (CNNs) have been established as the main workhorse in image data processing; nonetheless, they require large amounts of data to train, often produce overconfident predictions, and frequently lack the ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Sarah Harkins Dayton , Hayden Everett , Ioannis Schizas , David L. Boothe , Vasileios Maroulas

Bayesian neural networks (BNNs) augment deep networks with uncertainty quantification by Bayesian treatment of the network weights. However, such models face the challenge of Bayesian inference in a high-dimensional and usually…

Machine Learning · Computer Science 2021-03-30 Zhijie Deng , Yucen Luo , Jun Zhu , Bo Zhang

Two of the most popular modelling paradigms in computer vision are feed-forward neural networks (FFNs) and probabilistic graphical models (GMs). Various connections between the two have been studied in recent works, such as e.g. expressing…

Machine Learning · Statistics 2017-10-31 Dmitrij Schlesinger

Probabilistic Neural Network (PNN) is a feed-forward artificial neural network developed for solving classification problems. This paper proposes a hardware implementation of an approximated PNN (APNN) algorithm in which the conventional…

Emerging Technologies · Computer Science 2018-08-03 Olga Krestinskaya , Alex Pappachen James

Deep Neural Networks (DNNs) have achieved state-of-the-art accuracy performance in many tasks. However, recent works have pointed out that the outputs provided by these models are not well-calibrated, seriously limiting their use in…

Machine Learning · Computer Science 2020-07-16 Juan Maroñas , Roberto Paredes , Daniel Ramos

Training neural networks on randomly generated artificial datasets yields Bayesian models that capture the prior defined by the dataset-generating distribution. Prior-data Fitted Networks (PFNs) are a class of methods designed to leverage…

Machine Learning · Computer Science 2025-06-02 Samuel Müller , Arik Reuter , Noah Hollmann , David Rügamer , Frank Hutter

Artificial intelligence (AI) for fluid mechanics has become attractive topic. High-fidelity data is one of most critical issues for the successful applications of AI in fluid mechanics, however, it is expensively obtained or even…

Machine Learning · Computer Science 2025-09-03 Ruilin Chen

Physics-informed neural networks (PINNs) provide a mesh-free framework for solving PDE-constrained inverse problems, but their extension to Bayesian inversion still faces a fundamental difficulty: prior distributions are typically defined…

Geophysics · Physics 2026-05-15 Ryoichiro Agata , Tomohisa Okazaki