English
Related papers

Related papers: Sylvester Normalizing Flows for Variational Infere…

200 papers

We introduce graph normalizing flows: a new, reversible graph neural network model for prediction and generation. On supervised tasks, graph normalizing flows perform similarly to message passing neural networks, but at a significantly…

Machine Learning · Computer Science 2019-05-31 Jenny Liu , Aviral Kumar , Jimmy Ba , Jamie Kiros , Kevin Swersky

This notebook tutorial demonstrates a method for sampling Boltzmann distributions of lattice field theories using a class of machine learning models known as normalizing flows. The ideas and approaches proposed in arXiv:1904.12072,…

A generative model based on a continuous-time normalizing flow between any pair of base and target probability densities is proposed. The velocity field of this flow is inferred from the probability current of a time-dependent density that…

Machine Learning · Computer Science 2023-03-10 Michael S. Albergo , Eric Vanden-Eijnden

Given an inverse problem with a normalizing flow prior, we wish to estimate the distribution of the underlying signal conditioned on the observations. We approach this problem as a task of conditional inference on the pre-trained…

Machine Learning · Statistics 2021-06-16 Jay Whang , Erik M. Lindgren , Alexandros G. Dimakis

A Normalizing Flow computes a bijective mapping from an arbitrary distribution to a predefined (e.g. normal) distribution. Such a flow can be used to address different tasks, e.g. anomaly detection, once such a mapping has been learned. In…

Quantum Physics · Physics 2024-07-23 Bodo Rosenhahn , Christoph Hirche

Normalizing flows are objects used for modeling complicated probability density functions, and have attracted considerable interest in recent years. Many flexible families of normalizing flows have been developed. However, the focus to date…

Methodology · Statistics 2023-01-18 Tin Lok James Ng , Andrew Zammit-Mangion

To overcome topological constraints and improve the expressiveness of normalizing flow architectures, Wu, K\"ohler and No\'e introduced stochastic normalizing flows which combine deterministic, learnable flow transformations with stochastic…

Machine Learning · Computer Science 2022-12-02 Paul Hagemann , Johannes Hertrich , Gabriele Steidl

Efficient gradient computation of the Jacobian determinant term is a core problem in many machine learning settings, and especially so in the normalizing flow framework. Most proposed flow models therefore either restrict to a function…

Machine Learning · Computer Science 2021-06-10 T. Anderson Keller , Jorn W. T. Peters , Priyank Jaini , Emiel Hoogeboom , Patrick Forré , Max Welling

Eliciting a high-dimensional probability distribution from an expert via noisy judgments is notoriously challenging, yet useful for many applications, such as prior elicitation and reward modeling. We introduce a method for eliciting the…

Machine Learning · Computer Science 2024-10-17 Petrus Mikkola , Luigi Acerbi , Arto Klami

The so-called trivializing flows were proposed to speed up Hybrid Monte Carlo simulations, where the Wilson flow was used as an approximation of a trivializing map, a transformation of the gauge fields which trivializes the theory. It was…

High Energy Physics - Lattice · Physics 2023-10-06 David Albandea , Luigi Del Debbio , Pilar Hernández , Richard Kenway , Joe Marsh Rossney , Alberto Ramos

Normalizing Flows are a promising new class of algorithms for unsupervised learning based on maximum likelihood optimization with change of variables. They offer to learn a factorized component representation for complex nonlinear data and,…

Machine Learning · Computer Science 2020-02-17 Reuben Feinman , Nikhil Parthasarathy

Normalizing flows are a class of deep generative models that provide a promising route to sample lattice field theories more efficiently than conventional Monte Carlo simulations. In this work we show that the theoretical framework of…

High Energy Physics - Lattice · Physics 2022-07-07 Michele Caselle , Elia Cellini , Alessandro Nada , Marco Panero

Normalising flows are tractable probabilistic models that leverage the power of deep learning to describe a wide parametric family of distributions, all while remaining trainable using maximum likelihood. We discuss how these methods can be…

Machine Learning · Computer Science 2020-07-14 Simon Alexanderson , Gustav Eje Henter

Normalizing flows can transform a simple prior probability distribution into a more complex target distribution. Here, we evaluate the ability and efficiency of generative machine learning methods to sample the Boltzmann distribution of an…

Soft Condensed Matter · Physics 2024-09-16 Gerhard Jung , Giulio Biroli , Ludovic Berthier

We introduce stochastic normalizing flows, an extension of continuous normalizing flows for maximum likelihood estimation and variational inference (VI) using stochastic differential equations (SDEs). Using the theory of rough paths, the…

Machine Learning · Statistics 2020-02-27 Liam Hodgkinson , Chris van der Heide , Fred Roosta , Michael W. Mahoney

Graphical flows add further structure to normalizing flows by encoding non-trivial variable dependencies. Previous graphical flow models have focused primarily on a single flow direction: the normalizing direction for density estimation, or…

Machine Learning · Computer Science 2022-04-27 Jacobie Mouton , Steve Kroon

We present a novel theoretical framework for understanding the expressive power of normalizing flows. Despite their prevalence in scientific applications, a comprehensive understanding of flows remains elusive due to their restricted…

Machine Learning · Computer Science 2025-01-30 Felix Draxler , Stefan Wahl , Christoph Schnörr , Ullrich Köthe

Normalizing Flows (NFs) describe a class of models that express a complex target distribution as the composition of a series of bijective transformations over a simpler base distribution. By limiting the space of candidate transformations…

Machine Learning · Computer Science 2023-09-11 Keegan Kelly , Lorena Piedras , Sukrit Rao , David Roth

Inverse problems of partial differential equations are ubiquitous across various scientific disciplines and can be formulated as statistical inference problems using Bayes' theorem. To address large-scale problems, it is crucial to develop…

Numerical Analysis · Mathematics 2025-12-23 Yang Zhao , Haoyu Lu , Junxiong Jia , Tao Zhou

Normalizing flows model probability distributions by learning invertible transformations that transfer a simple distribution into complex distributions. Since the architecture of ResNet-based normalizing flows is more flexible than that of…

Machine Learning · Computer Science 2022-10-18 Byeongkeun Ahn , Chiyoon Kim , Youngjoon Hong , Hyunwoo J. Kim