English
Related papers

Related papers: Turning Normalizing Flows into Monge Maps with Geo…

200 papers

Normalizing Flows (NFs) are universal density estimators based on Neural Networks. However, this universality is limited: the density's support needs to be diffeomorphic to a Euclidean space. In this paper, we propose a novel method to…

Machine Learning · Computer Science 2022-02-02 Christian Horvat , Jean-Pascal Pfister

We present a novel generative modeling method called diffusion normalizing flow based on stochastic differential equations (SDEs). The algorithm consists of two neural SDEs: a forward SDE that gradually adds noise to the data to transform…

Machine Learning · Computer Science 2021-10-15 Qinsheng Zhang , Yongxin Chen

Normalizing flows are an established approach for modelling complex probability densities through invertible transformations from a base distribution. However, the accuracy with which the target distribution can be captured by the…

Machine Learning · Statistics 2024-02-02 Harry Bevins , Will Handley , Thomas Gessey-Jones

Iterative Gaussianization is a fixed-point iteration procedure that can transform any continuous random vector into a Gaussian one. Based on iterative Gaussianization, we propose a new type of normalizing flow model that enables both…

Machine Learning · Computer Science 2020-03-05 Chenlin Meng , Yang Song , Jiaming Song , Stefano Ermon

Transport maps can ease the sampling of distributions with non-trivial geometries by transforming them into distributions that are easier to handle. The potential of this approach has risen with the development of Normalizing Flows (NF)…

Machine Learning · Statistics 2024-02-20 Louis Grenioux , Alain Durmus , Éric Moulines , Marylou Gabrié

Normalizing Flows are generative models which produce tractable distributions where both sampling and density evaluation can be efficient and exact. The goal of this survey article is to give a coherent and comprehensive review of the…

Machine Learning · Statistics 2020-06-09 Ivan Kobyzev , Simon J. D. Prince , Marcus A. Brubaker

We propose a new Neural Galerkin Normalizing Flow framework to approximate the transition probability density function of a diffusion process by solving the corresponding Fokker-Planck equation with an atomic initial distribution,…

Machine Learning · Computer Science 2026-03-20 Riccardo Saporiti , Fabio Nobile

Deep Gaussian processes (DGPs), a hierarchical composition of GP models, have successfully boosted the expressive power of their single-layer counterpart. However, it is impossible to perform exact inference in DGPs, which has motivated the…

Machine Learning · Computer Science 2021-05-27 Haibin Yu , Dapeng Liu , Yizhou Chen , Bryan Kian Hsiang Low , Patrick Jaillet

Normalizing Flows (NFs) describe a class of models that express a complex target distribution as the composition of a series of bijective transformations over a simpler base distribution. By limiting the space of candidate transformations…

Machine Learning · Computer Science 2023-09-11 Keegan Kelly , Lorena Piedras , Sukrit Rao , David Roth

Modeling real-world distributions can often be challenging due to sample data that are subjected to perturbations, e.g., instrumentation errors, or added random noise. Since flow models are typically nonlinear algorithms, they amplify these…

Machine Learning · Computer Science 2022-10-11 Sameera Ramasinghe , Kasun Fernando , Salman Khan , Nick Barnes

This paper presents a groundbreaking approach to causal inference by integrating continuous normalizing flows (CNFs) with parametric submodels, enhancing their geometric sensitivity and improving upon traditional Targeted Maximum Likelihood…

Machine Learning · Computer Science 2024-02-02 Kaiwen Hou

Normalizing Flows (NFs) have been established as a principled framework for generative modeling. Standard NFs consist of a forward process and a reverse process: the forward process maps data to noise, while the reverse process generates…

Machine Learning · Computer Science 2025-12-12 Yiyang Lu , Qiao Sun , Xianbang Wang , Zhicheng Jiang , Hanhong Zhao , Kaiming He

In the standard formulation of the denoising problem, one is given a probabilistic model relating a latent variable $\Theta \in \Omega \subset \mathbb{R}^m \; (m\ge 1)$ and an observation $Z \in \mathbb{R}^d$ according to: $Z \mid \Theta…

Statistics Theory · Mathematics 2024-10-01 Nicolas Garcia Trillos , Bodhisattva Sen

Fueled by the expressive power of deep neural networks, normalizing flows have achieved spectacular success in generative modeling, or learning to draw new samples from a distribution given a finite dataset of training samples. Normalizing…

Machine Learning · Computer Science 2023-05-05 Yuehaw Khoo , Michael Lindsey , Hongli Zhao

Normalizing Flows (NFs) are a classical family of likelihood-based methods that have received revived attention. Recent efforts such as TARFlow have shown that NFs are capable of achieving promising performance on image modeling tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Tianrong Chen , Jiatao Gu , David Berthelot , Joshua Susskind , Shuangfei Zhai

Normalizing flows (NFs) provide a powerful tool to construct an expressive distribution by a sequence of trackable transformations of a base distribution and form a probabilistic model of underlying data. Rotation, as an important quantity…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Yulin Liu , Haoran Liu , Yingda Yin , Yang Wang , Baoquan Chen , He Wang

Normalizing flows are exact-likelihood generative neural networks which approximately transform samples from a simple prior distribution to samples of the probability distribution of interest. Recent work showed that such generative models…

Machine Learning · Statistics 2020-10-27 Jonas Köhler , Leon Klein , Frank Noé

In this paper, we consider the problem of recovering the $W_2$-optimal transport map T between absolutely continuous measures $\mu,\nu\in\mathcal{P}(\mathbb{R}^n)$ as the flow of a linear-control neural ODE, where the control depends only…

Optimization and Control · Mathematics 2024-12-04 Alessandro Scagliotti , Sara Farinelli

Normalizing flows transform a latent distribution through an invertible neural network for a flexible and pleasingly simple approach to generative modelling, while preserving an exact likelihood. We propose FlowGMM, an end-to-end approach…

Machine Learning · Computer Science 2020-01-01 Pavel Izmailov , Polina Kirichenko , Marc Finzi , Andrew Gordon Wilson

We present a deep generative model, named Monge-Amp\`ere flow, which builds on continuous-time gradient flow arising from the Monge-Amp\`ere equation in optimal transport theory. The generative map from the latent space to the data space…

Machine Learning · Computer Science 2018-09-28 Linfeng Zhang , Weinan E , Lei Wang