English
Related papers

Related papers: TensorBNN: Bayesian Inference for Neural Networks …

200 papers

Bayesian Neural Networks (BNNs) offer robust uncertainty quantification in model predictions, but training them presents a significant computational challenge. This is mainly due to the problem of sampling multimodal posterior distributions…

Machine Learning · Computer Science 2025-01-14 Ratneel Deo , Scott Sisson , Jody M. Webster , Rohitash Chandra

Monte Carlo methods are widely used in particle physics to integrate and sample probability distributions (differential cross sections or decay rates) on multi-dimensional phase spaces. We present a Neural Network (NN) algorithm optimized…

High Energy Physics - Phenomenology · Physics 2020-10-21 Matthew D. Klimek , Maxim Perelstein

We develop a weighted Bayesian Bootstrap (WBB) for machine learning and statistics. WBB provides uncertainty quantification by sampling from a high dimensional posterior distribution. WBB is computationally fast and scalable using only…

Methodology · Statistics 2021-04-06 Michael Newton , Nicholas G. Polson , Jianeng Xu

We present Sequential Neural Likelihood (SNL), a new method for Bayesian inference in simulator models, where the likelihood is intractable but simulating data from the model is possible. SNL trains an autoregressive flow on simulated data…

Machine Learning · Statistics 2019-01-23 George Papamakarios , David C. Sterratt , Iain Murray

Graph neural networks for molecular property prediction are frequently underspecified by data and fail to generalise to new scaffolds at test time. A potential solution is Bayesian learning, which can capture our uncertainty in the model…

Biomolecules · Quantitative Biology 2020-12-04 George Lamb , Brooks Paige

Bayesian networks (BNs) are graphical \emph{first-order} probabilistic models that allow for a compact representation of large probability distributions, and for efficient inference, both exact and approximate. We introduce a…

Logic in Computer Science · Computer Science 2023-12-12 Claudia Faggian , Daniele Pautasso , Gabriele Vanoni

In this paper we introduce ZhuSuan, a python probabilistic programming library for Bayesian deep learning, which conjoins the complimentary advantages of Bayesian methods and deep learning. ZhuSuan is built upon Tensorflow. Unlike existing…

Machine Learning · Statistics 2017-09-19 Jiaxin Shi , Jianfei Chen , Jun Zhu , Shengyang Sun , Yucen Luo , Yihong Gu , Yuhao Zhou

Deep neural networks (NNs) are powerful black box predictors that have recently achieved impressive performance on a wide spectrum of tasks. Quantifying predictive uncertainty in NNs is a challenging and yet unsolved problem. Bayesian NNs,…

Machine Learning · Statistics 2017-11-07 Balaji Lakshminarayanan , Alexander Pritzel , Charles Blundell

Deep convolutional neural networks (DCNNs) have dominated the recent developments in computer vision through making various record-breaking models. However, it is still a great challenge to achieve powerful DCNNs in resource-limited…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Jiaxin Gu , Junhe Zhao , Xiaolong Jiang , Baochang Zhang , Jianzhuang Liu , Guodong Guo , Rongrong Ji

Traditional Recurrent Neural Networks assume vectorized data as inputs. However many data from modern science and technology come in certain structures such as tensorial time series data. To apply the recurrent neural networks for this type…

Machine Learning · Computer Science 2017-08-02 Mingyuan Bai , Boyan Zhang , Junbin Gao

Binary Neural Networks (BiNNs), which employ single-bit precision weights, have emerged as a promising solution to reduce memory usage and power consumption while maintaining competitive performance in large-scale systems. However, training…

Quantum Physics · Physics 2025-11-18 Luca Nepote , Alix Lhéritier , Nicolas Bondoux , Marios Kountouris , Maurizio Filippone

Binary Neural Network (BNN) converts full-precision weights and activations into their extreme 1-bit counterparts, making it particularly suitable for deployment on lightweight mobile devices. While binary neural networks are typically…

Machine Learning · Computer Science 2025-01-08 Jun Chen , Jingyang Xiang , Tianxin Huang , Xiangrui Zhao , Yong Liu

Injecting structure into neural networks enables learning functions that satisfy invariances with respect to subsets of inputs. For instance, when learning generative models using neural networks, it is advantageous to encode the…

Machine Learning · Computer Science 2023-11-07 Asic Q. Chen , Ruian Shi , Xiang Gao , Ricardo Baptista , Rahul G. Krishnan

Measuring the structural parameters (size, total brightness, light concentration, etc.) of galaxies is a significant first step towards a quantitative description of different galaxy populations. In this work, we demonstrate that a Bayesian…

Instrumentation and Methods for Astrophysics · Physics 2022-07-08 Dimitrios Tanoglidis , Aleksandra Ćiprijanović , Alex Drlica-Wagner

In recent years, research on hyperspectral image (HSI) classification has continuous progress on introducing deep network models, and recently the graph convolutional network (GCN) based models have shown impressive performance. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Mingyang Zhang , Ziqi Di , Maoguo Gong , Yue Wu , Hao Li , Xiangming Jiang

Deep learning systems extensively use convolution operations to process input data. Though convolution is clearly defined for structured data such as 2D images or 3D volumes, this is not true for other data types such as sparse point…

Computer Vision and Pattern Recognition · Computer Science 2018-09-26 Pedro Hermosilla , Tobias Ritschel , Pere-Pau Vázquez , Àlvar Vinacua , Timo Ropinski

Variational Bayesian neural networks (BNNs) perform variational inference over weights, but it is difficult to specify meaningful priors and approximate posteriors in a high-dimensional weight space. We introduce functional variational…

Machine Learning · Computer Science 2019-03-15 Shengyang Sun , Guodong Zhang , Jiaxin Shi , Roger Grosse

We introduce a probabilistic robustness measure for Bayesian Neural Networks (BNNs), defined as the probability that, given a test point, there exists a point within a bounded set such that the BNN prediction differs between the two. Such a…

Machine Learning · Computer Science 2019-03-06 Luca Cardelli , Marta Kwiatkowska , Luca Laurenti , Nicola Paoletti , Andrea Patane , Matthew Wicker

A novel method for estimating Bayesian network (BN) parameters from data is presented which provides improved performance on test data. Previous research has shown the value of representing conditional probability distributions (CPDs) via…

Machine Learning · Computer Science 2013-01-14 Geoff A. Jarrad

Hypergraph neural networks (HGNN) have recently become attractive and received significant attention due to their excellent performance in various domains. However, most existing HGNNs rely on first-order approximations of hypergraph…

Artificial Intelligence · Computer Science 2024-01-11 Maolin Wang , Yaoming Zhen , Yu Pan , Yao Zhao , Chenyi Zhuang , Zenglin Xu , Ruocheng Guo , Xiangyu Zhao