English
Related papers

Related papers: Lifting Architectural Constraints of Injective Flo…

200 papers

The two key characteristics of a normalizing flow is that it is invertible (in particular, dimension preserving) and that it monitors the amount by which it changes the likelihood of data points as samples are propagated along the network.…

Machine Learning · Computer Science 2023-01-27 Bálint Máté , Samuel Klein , Tobias Golling , François Fleuret

Normalizing flows and variational autoencoders are powerful generative models that can represent complicated density functions. However, they both impose constraints on the models: Normalizing flows use bijective transformations to model…

Machine Learning · Computer Science 2020-11-02 Didrik Nielsen , Priyank Jaini , Emiel Hoogeboom , Ole Winther , Max Welling

Likelihood-based, or explicit, deep generative models use neural networks to construct flexible high-dimensional densities. This formulation directly contradicts the manifold hypothesis, which states that observed data lies on a…

Machine Learning · Statistics 2022-11-30 Gabriel Loaiza-Ganem , Brendan Leigh Ross , Jesse C. Cresswell , Anthony L. Caterini

Generating a Boltzmann distribution in high dimension has recently been achieved with Normalizing Flows, which enable fast and exact computation of the generated density, and thus unbiased estimation of expectations. However, current…

Machine Learning · Computer Science 2023-01-16 Loris Felardos , Jérôme Hénin , Guillaume Charpiat

Normalizing flows are constructed from a base distribution with a known density and a diffeomorphism with a tractable Jacobian. The base density of a normalizing flow can be parameterised by a different normalizing flow, thus allowing maps…

Machine Learning · Computer Science 2022-11-07 Samuel Klein , John Andrew Raine , Tobias Golling

Likelihood-free inference is quickly emerging as a powerful tool to perform fast/effective parameter estimation. We demonstrate a technique of optimizing likelihood-free inference to make it even faster by marginalizing symmetries in a…

Machine Learning · Computer Science 2023-12-14 Deep Chatterjee , Philip C. Harris , Maanas Goel , Malina Desai , Michael W. Coughlin , Erik Katsavounidis

Normalizing flows are bijective mappings between inputs and latent representations with a fully factorized distribution. They are very attractive due to exact likelihood valuation and efficient sampling. However, their effective capacity is…

Machine Learning · Computer Science 2021-11-03 Matej Grcić , Ivan Grubišić , Siniša Šegvić

We present an alternative to reweighting techniques for modifying distributions to account for a desired change in an underlying conditional distribution, as is often needed to correct for mis-modelling in a simulated sample. We employ…

High Energy Physics - Phenomenology · Physics 2023-05-01 Malte Algren , Tobias Golling , Manuel Guth , Chris Pollard , John Andrew Raine

Generative models that maximize model likelihood have gained traction in many practical settings. Among them, perturbation based approaches underpin many strong likelihood estimation models, yet they often face slow convergence and limited…

Information Theory · Computer Science 2025-10-27 Yirong Shen , Lu Gan , Cong Ling

Simulation-free training frameworks have been at the forefront of the generative modelling revolution in continuous spaces, leading to large-scale diffusion and flow matching models. However, such modern generative models suffer from…

Machine Learning · Computer Science 2025-10-31 Danyal Rehman , Oscar Davis , Jiarui Lu , Jian Tang , Michael Bronstein , Yoshua Bengio , Alexander Tong , Avishek Joey Bose

Normalizing flows model complex probability distributions using maps obtained by composing invertible layers. Special linear layers such as masked and 1x1 convolutions play a key role in existing architectures because they increase…

Machine Learning · Computer Science 2022-09-29 Chenlin Meng , Linqi Zhou , Kristy Choi , Tri Dao , Stefano Ermon

Normalizing Flows (NFs) describe a class of models that express a complex target distribution as the composition of a series of bijective transformations over a simpler base distribution. By limiting the space of candidate transformations…

Machine Learning · Computer Science 2023-09-11 Keegan Kelly , Lorena Piedras , Sukrit Rao , David Roth

To better conform to data geometry, recent deep generative modelling techniques adapt Euclidean constructions to non-Euclidean spaces. In this paper, we study normalizing flows on manifolds. Previous work has developed flow models for…

Machine Learning · Statistics 2020-06-19 Aaron Lou , Derek Lim , Isay Katsman , Leo Huang , Qingxuan Jiang , Ser-Nam Lim , Christopher De Sa

Normalizing flows provide an elegant approach to generative modeling that allows for efficient sampling and exact density evaluation of unknown data distributions. However, current techniques have significant limitations in their…

Machine Learning · Computer Science 2022-06-22 Sahil Sidheekh , Chris B. Dock , Tushar Jain , Radu Balan , Maneesh K. Singh

Flow-based generative models parameterize probability distributions through an invertible transformation and can be trained by maximum likelihood. Invertible residual networks provide a flexible family of transformations where only…

Machine Learning · Statistics 2020-07-27 Ricky T. Q. Chen , Jens Behrmann , David Duvenaud , Jörn-Henrik Jacobsen

Model independent techniques for constructing background data templates using generative models have shown great promise for use in searches for new physics processes at the LHC. We introduce a major improvement to the CURTAINs method by…

High Energy Physics - Phenomenology · Physics 2023-05-09 Debajyoti Sengupta , Samuel Klein , John Andrew Raine , Tobias Golling

Continuous Normalizing Flows (CNFs) are a class of generative models that transform a prior distribution to a model distribution by solving an ordinary differential equation (ODE). We propose to train CNFs on manifolds by minimizing…

The normalization constraint on probability density poses a significant challenge for solving the Fokker-Planck equation. Normalizing Flow, an invertible generative model leverages the change of variables formula to ensure probability…

Machine Learning · Computer Science 2023-09-28 Feng Liu , Faguo Wu , Xiao Zhang

The field of general-purpose robotics has recently embraced powerful probabilistic diffusion-based models to learn the complex embodiment behaviours. However, existing models often come with significant trade-offs, namely high computational…

Robotics · Computer Science 2026-02-26 Jialong Li , Simon Kristoffersson Lind , Wenrui Xie , Maj Stenmark , Volker Krüger

Reinforcement learning policies are typically represented by black-box neural networks, which are non-interpretable and not well-suited for safety-critical domains. To address both of these issues, we propose constrained normalizing flow…

Machine Learning · Computer Science 2024-05-03 Finn Rietz , Erik Schaffernicht , Stefan Heinrich , Johannes A. Stork