English
Related papers

Related papers: Flow-Based Likelihoods for Non-Gaussian Inference

200 papers

Simulation-free training frameworks have been at the forefront of the generative modelling revolution in continuous spaces, leading to large-scale diffusion and flow matching models. However, such modern generative models suffer from…

Machine Learning · Computer Science 2025-10-31 Danyal Rehman , Oscar Davis , Jiarui Lu , Jian Tang , Michael Bronstein , Yoshua Bengio , Alexander Tong , Avishek Joey Bose

We derive a novel generative model from iterative Gaussian posterior inference. By treating the generated sample as an unknown variable, we can formulate the sampling process in the language of Bayesian probability. Our model uses a…

Machine Learning · Computer Science 2026-01-28 Marten Lienen , Marcel Kollovieh , Stephan Günnemann

Consider a Bayesian inference problem where a variable of interest does not take values in a Euclidean space. These "non-standard" data structures are in reality fairly common. They are frequently used in problems involving latent discrete…

Fueled by the expressive power of deep neural networks, normalizing flows have achieved spectacular success in generative modeling, or learning to draw new samples from a distribution given a finite dataset of training samples. Normalizing…

Machine Learning · Computer Science 2023-05-05 Yuehaw Khoo , Michael Lindsey , Hongli Zhao

Solving decision problems in complex, stochastic environments is often achieved by estimating the expected outcome of decisions via Monte Carlo sampling. However, sampling may overlook rare, but important events, which can severely impact…

Machine Learning · Statistics 2023-05-16 Lachlan Gibson , Marcus Hoerger , Dirk Kroese

Flows are exact-likelihood generative neural networks that transform samples from a simple prior distribution to the samples of the probability distribution of interest. Boltzmann Generators (BG) combine flows and statistical mechanics to…

Machine Learning · Statistics 2019-10-03 Jonas Köhler , Leon Klein , Frank Noé

Normalizing Flows (NFs) are likelihood-based models for continuous inputs. They have demonstrated promising results on both density estimation and generative modeling tasks, but have received relatively little attention in recent years. In…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Shuangfei Zhai , Ruixiang Zhang , Preetum Nakkiran , David Berthelot , Jiatao Gu , Huangjie Zheng , Tianrong Chen , Miguel Angel Bautista , Navdeep Jaitly , Josh Susskind

Generative flow networks (GFNs) are a class of models for sequential sampling of composite objects, which approximate a target distribution that is defined in terms of an energy function or a reward. GFNs are typically trained using a flow…

Machine Learning · Statistics 2022-10-17 Heiko Zimmermann , Fredrik Lindsten , Jan-Willem van de Meent , Christian A. Naesseth

Flow-based generative models are powerful exact likelihood models with efficient sampling and inference. Despite their computational efficiency, flow-based models generally have much worse density modeling performance compared to…

Machine Learning · Computer Science 2019-05-17 Jonathan Ho , Xi Chen , Aravind Srinivas , Yan Duan , Pieter Abbeel

Recent studies suggest utilizing generative models instead of traditional auto-regressive algorithms for time series forecasting (TSF) tasks. These non-auto-regressive approaches involving different generative methods, including GAN,…

Machine Learning · Computer Science 2025-03-19 Jiangxuan Long , Zhao Song , Chiwun Yang

In Bayesian structure learning, we are interested in inferring a distribution over the directed acyclic graph (DAG) structure of Bayesian networks, from data. Defining such a distribution is very challenging, due to the combinatorially…

Machine Learning · Computer Science 2022-06-30 Tristan Deleu , António Góis , Chris Emezue , Mansi Rankawat , Simon Lacoste-Julien , Stefan Bauer , Yoshua Bengio

Recent advances in generative machine learning models rekindled research interest in the area of password guessing. Data-driven password guessing approaches based on GANs, language models and deep latent variable models have shown…

Cryptography and Security · Computer Science 2021-12-15 Giulio Pagnotta , Dorjan Hitaj , Fabio De Gaspari , Luigi V. Mancini

In science and engineering, we often work with models designed for accurate prediction of variables of interest. Recognizing that these models are approximations of reality, it becomes desirable to apply multiple models to the same data and…

Machine Learning · Computer Science 2024-04-03 Marzieh Ajirak , Daniel Waxman , Fernando Llorente , Petar M. Djuric

Approximations in computing model likelihoods with continuous normalizing flows (CNFs) hinder the use of these models for importance sampling of Boltzmann distributions, where exact likelihoods are required. In this work, we present Verlet…

Machine Learning · Computer Science 2024-05-07 Ezra Erives , Bowen Jing , Tommi Jaakkola

Studying potential BSM effects at the precision frontier requires accurate transfer of information from low-energy measurements to high-energy BSM models. We propose to use normalising flows to construct likelihood functions that achieve…

High Energy Physics - Phenomenology · Physics 2023-09-20 Anja Beck , Méril Reboud , Danny van Dyk

We propose Multiscale Flow, a generative Normalizing Flow that creates samples and models the field-level likelihood of two-dimensional cosmological data such as weak lensing. Multiscale Flow uses hierarchical decomposition of cosmological…

Cosmology and Nongalactic Astrophysics · Physics 2024-02-16 Biwei Dai , Uros Seljak

This paper introduces Bayesian Flow Networks (BFNs), a new class of generative model in which the parameters of a set of independent distributions are modified with Bayesian inference in the light of noisy data samples, then passed as input…

Machine Learning · Computer Science 2025-03-12 Alex Graves , Rupesh Kumar Srivastava , Timothy Atkinson , Faustino Gomez

Generative Flow Networks (or GFlowNets for short) are a family of probabilistic agents that learn to sample complex combinatorial structures through the lens of "inference as control". They have shown great potential in generating…

Machine Learning · Computer Science 2023-06-27 Ling Pan , Dinghuai Zhang , Moksh Jain , Longbo Huang , Yoshua Bengio

Through examples of coordinate and probability transformation between different distributions, the basic principle of normalizing flow is introduced in a simple and concise manner. From the perspective of the distribution of random variable…

Machine Learning · Computer Science 2024-01-22 Hongjun Zhang

Bayesian inference for complex models with an intractable likelihood can be tackled using algorithms performing many calls to computer simulators. These approaches are collectively known as "simulation-based inference" (SBI). Recent SBI…