English
Related papers

Related papers: Streaming Bayes GFlowNets

200 papers

Approximate inference in Bayesian deep networks exhibits a dilemma of how to yield high fidelity posterior approximations while maintaining computational efficiency and scalability. We tackle this challenge by introducing a novel…

Machine Learning · Computer Science 2021-11-01 Son Nguyen , Duong Nguyen , Khai Nguyen , Khoat Than , Hung Bui , Nhat Ho

Generative Flow Networks (GFlowNets) have emerged as a powerful paradigm for generating composite structures, demonstrating considerable promise across diverse applications. While substantial progress has been made in exploring their…

Machine Learning · Computer Science 2025-05-06 Tianshu Yu

Divide-and-conquer based methods for Bayesian inference provide a general approach for tractable posterior inference when the sample size is large. These methods divide the data into smaller subsets, sample from the posterior distribution…

Methodology · Statistics 2018-06-21 Sanvesh Srivastava , Cheng Li , David B. Dunson

We propose a new Bayesian Neural Net formulation that affords variational inference for which the evidence lower bound is analytically tractable subject to a tight approximation. We achieve this tractability by (i) decomposing ReLU…

Machine Learning · Statistics 2019-06-13 Manuel Haussmann , Fred A. Hamprecht , Melih Kandemir

In all areas of human knowledge, datasets are increasing in both size and complexity, creating the need for richer statistical models. This trend is also true for economic data, where high-dimensional and nonlinear/nonparametric inference…

Econometrics · Economics 2021-12-23 Dimitris Korobilis , Kenichi Shimizu

To adopt neural networks in safety critical domains, knowing whether we can trust their predictions is crucial. Bayesian neural networks (BNNs) provide uncertainty estimates by averaging predictions with respect to the posterior weight…

Machine Learning · Computer Science 2021-03-17 Jannik Schmitt , Stefan Roth

Ultrasound images are commonly formed by sequential acquisition of beam-steered scan-lines. Minimizing the number of required scan-lines can significantly enhance frame rate, field of view, energy efficiency, and data transfer speeds.…

Image and Video Processing · Electrical Eng. & Systems 2025-01-08 Simon W. Penninga , Hans van Gorp , Ruud J. G. van Sloun

Methods based on Deep Learning have recently been applied on astrophysical parameter recovery thanks to their ability to capture information from complex data. One of these methods is the approximate Bayesian Neural Networks (BNNs) which…

Instrumentation and Methods for Astrophysics · Physics 2023-06-21 Héctor J. Hortúa , Luz Ángela García , Leonardo Castañeda C

Modern Bayesian inference involves a mixture of computational techniques for estimating, validating, and drawing conclusions from probabilistic models as part of principled workflows for data analysis. Typical problems in Bayesian workflows…

Phylogenetics is a branch of computational biology that studies the evolutionary relationships among biological entities. Its long history and numerous applications notwithstanding, inference of phylogenetic trees from sequence data remains…

Populations and Evolution · Quantitative Biology 2024-03-26 Mingyang Zhou , Zichao Yan , Elliot Layne , Nikolay Malkin , Dinghuai Zhang , Moksh Jain , Mathieu Blanchette , Yoshua Bengio

Although linear regression models are fundamental tools in statistical science, the estimation results can be sensitive to outliers. While several robust methods have been proposed in frequentist frameworks, statistical inference is not…

Methodology · Statistics 2020-07-15 Shintaro Hashimoto , Shonosuke Sugasawa

Modern neural networks tend to be overconfident on unseen, noisy or incorrectly labelled data and do not produce meaningful uncertainty measures. Bayesian deep learning aims to address this shortcoming with variational approximations (such…

Machine Learning · Statistics 2018-05-28 Nick Pawlowski , Andrew Brock , Matthew C. H. Lee , Martin Rajchl , Ben Glocker

Generative Flow Networks (GFlowNets) are a family of generative models that learn to sample objects from a given probability distribution, potentially known up to a normalizing constant. Instead of working in the object space, GFlowNets…

Machine Learning · Computer Science 2025-09-12 Nikita Morozov , Ian Maksimov , Daniil Tiapkin , Sergey Samsonov

Generative flow networks (GFlowNets) are a method for learning a stochastic policy for generating compositional objects, such as graphs or strings, from a given unnormalized density by sequences of actions, where many possible action…

Machine Learning · Computer Science 2023-10-05 Nikolay Malkin , Moksh Jain , Emmanuel Bengio , Chen Sun , Yoshua Bengio

The task of quantifying the inherent uncertainty associated with neural network predictions is a key challenge in artificial intelligence. Bayesian neural networks (BNNs) and deep ensembles are among the most prominent approaches to tackle…

Machine Learning · Computer Science 2025-05-23 Valentin Villecroze , Yixin Wang , Gabriel Loaiza-Ganem

Bayesian inference provides an attractive online-learning framework to analyze sequential data, and offers generalization guarantees which hold even with model mismatch and adversaries. Unfortunately, exact Bayesian inference is rarely…

Machine Learning · Statistics 2020-08-03 Badr-Eddine Chérief-Abdellatif , Pierre Alquier , Mohammad Emtiyaz Khan

Bayesian learning is a powerful learning framework which combines the external information of the data (background information) with the internal information (training data) in a logically consistent way in inference and prediction. By…

Machine Learning · Statistics 2026-02-11 Erdong Guo , David Draper

Variational inference (VI) is a technique to approximate difficult to compute posteriors by optimization. In contrast to MCMC, VI scales to many observations. In the case of complex posteriors, however, state-of-the-art VI approaches often…

Machine Learning · Statistics 2024-02-26 Oliver Dürr , Stephan Hörling , Daniel Dold , Ivonne Kovylov , Beate Sick

Variational Bayesian Inference is a popular methodology for approximating posterior distributions over Bayesian neural network weights. Recent work developing this class of methods has explored ever richer parameterizations of the…

Bayesian neural networks (BNNs) treat neural network weights as random variables, which aim to provide posterior uncertainty estimates and avoid overfitting by performing inference on the posterior weights. However, the selection of…

Machine Learning · Computer Science 2025-05-27 Tsai Hor Chan , Dora Yan Zhang , Guosheng Yin , Lequan Yu