English
Related papers

Related papers: Invertible Monotone Operators for Normalizing Flow…

200 papers

Gaussian denoising has emerged as a powerful method for constructing simulation-free continuous normalizing flows for generative modeling. Despite their empirical successes, theoretical properties of these flows and the regularizing effect…

Machine Learning · Statistics 2024-07-10 Yuan Gao , Jian Huang , Yuling Jiao

In this work, we investigate the generalized bathtub model, a nonlocal transport equation for describing network trip flows served by privately operated vehicles inside a road network. First, we establish the well-posedness of the…

Analysis of PDEs · Mathematics 2024-09-04 Kuang Huang , Bangti Jin , Zhi Zhou

A normalizing flow is an invertible mapping between an arbitrary probability distribution and a standard normal distribution; it can be used for density estimation and statistical inference. Computing the flow follows the change of…

Machine Learning · Computer Science 2021-12-10 Derek Onken , Samy Wu Fung , Xingjian Li , Lars Ruthotto

The two key characteristics of a normalizing flow is that it is invertible (in particular, dimension preserving) and that it monitors the amount by which it changes the likelihood of data points as samples are propagated along the network.…

Machine Learning · Computer Science 2023-01-27 Bálint Máté , Samuel Klein , Tobias Golling , François Fleuret

Normalizing Flows (NFs) are a class of generative models distinguished by a mathematically invertible architecture, where the forward pass transforms data into a latent space for density estimation, and the reverse pass generates new…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Yang Chen , Xiaowei Xu , Shuai Wang , Chenhui Zhu , Ruxue Wen , Xubin Li , Tiezheng Ge , Limin Wang

The recent introduction of Machine Learning techniques, especially Normalizing Flows, for the sampling of lattice gauge theories has shed some hope on improving the sampling efficiency of the traditional Hybrid Monte Carlo (HMC) algorithm.…

High Energy Physics - Lattice · Physics 2023-09-21 David Albandea , Luigi Del Debbio , Pilar Hernández , Richard Kenway , Joe Marsh Rossney , Alberto Ramos

Normalizing flows model probability distributions through an expressive tractable density. They transform a simple base distribution, such as a Gaussian, through a sequence of invertible functions, which are referred to as layers. These…

Explicit density learners are becoming an increasingly popular technique for generative models because of their ability to better model probability distributions. They have advantages over Generative Adversarial Networks due to their…

Machine Learning · Computer Science 2025-06-27 Steven Walton , Valeriy Klyukin , Maksim Artemev , Denis Derkach , Nikita Orlov , Humphrey Shi

Normalizing flows learn a diffeomorphic mapping between the target and base distribution, while the Jacobian determinant of that mapping forms another real-valued function. In this paper, we show that the Jacobian determinant mapping is…

Machine Learning · Computer Science 2021-02-18 Huadong Liao , Jiawei He

We present a generative model that is defined on finite sets of exchangeable, potentially high dimensional, data. As the architecture is an extension of RealNVPs, it inherits all its favorable properties, such as being invertible and…

Machine Learning · Computer Science 2019-09-09 Kashif Rasul , Ingmar Schuster , Roland Vollgraf , Urs Bergmann

In this work we compute lower Lipschitz bounds of $\ell_p$ pooling operators for $p=1, 2, \infty$ as well as $\ell_p$ pooling operators preceded by half-rectification layers. These give sufficient conditions for the design of invertible…

Machine Learning · Statistics 2014-03-03 Joan Bruna , Arthur Szlam , Yann LeCun

Due to the success of generative flows to model data distributions, they have been explored in inverse problems. Given a pre-trained generative flow, previous work proposed to minimize the 2-norm of the latent variables as a regularization…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 José A. Chávez

Many components of data analysis in high energy physics and beyond require morphing one dataset into another. This is commonly solved via reweighting, but there are many advantages of preserving weights and shifting the data points instead.…

High Energy Physics - Phenomenology · Physics 2023-11-22 Tobias Golling , Samuel Klein , Radha Mastandrea , Benjamin Nachman , John Andrew Raine

In many scientific applications, the target probability distribution cannot be evaluated in closed form or sampled from directly. Instead, it can often be decomposed into multiple components, some of which are accessible only through…

Methodology · Statistics 2026-03-10 Roxana Darvishi , David C. Stenning , Ted von Hippel , Owen G. Ward

Normalizing Flows are generative models which produce tractable distributions where both sampling and density evaluation can be efficient and exact. The goal of this survey article is to give a coherent and comprehensive review of the…

Machine Learning · Statistics 2020-06-09 Ivan Kobyzev , Simon J. D. Prince , Marcus A. Brubaker

To overcome topological constraints and improve the expressiveness of normalizing flow architectures, Wu, K\"ohler and No\'e introduced stochastic normalizing flows which combine deterministic, learnable flow transformations with stochastic…

Machine Learning · Computer Science 2022-12-02 Paul Hagemann , Johannes Hertrich , Gabriele Steidl

To model manifold data using normalizing flows, we employ isometric autoencoders to design embeddings with explicit inverses that do not distort the probability distribution. Using isometries separates manifold learning and density…

Machine Learning · Computer Science 2023-05-09 Eike Cramer , Felix Rauh , Alexander Mitsos , Raúl Tempone , Manuel Dahmen

The Lipschitz constant of neural networks has been established as a key quantity to enforce the robustness to adversarial examples. In this paper, we tackle the problem of building $1$-Lipschitz Neural Networks. By studying Residual…

Machine Learning · Computer Science 2022-02-02 Laurent Meunier , Blaise Delattre , Alexandre Araujo , Alexandre Allauzen

Normalizing Flows (NF) are powerful likelihood-based generative models that are able to trade off between expressivity and tractability to model complex densities. A now well established research avenue leverages optimal transport (OT) and…

Machine Learning · Computer Science 2023-04-17 Guillaume Morel , Lucas Drumetz , Simon Benaïchouche , Nicolas Courty , François Rousseau

Simulation-free training frameworks have been at the forefront of the generative modelling revolution in continuous spaces, leading to large-scale diffusion and flow matching models. However, such modern generative models suffer from…

Machine Learning · Computer Science 2025-10-31 Danyal Rehman , Oscar Davis , Jiarui Lu , Jian Tang , Michael Bronstein , Yoshua Bengio , Alexander Tong , Avishek Joey Bose