English
Related papers

Related papers: Testing the boundaries: Normalizing Flows for high…

200 papers

Normalizing flows transform a simple base distribution into a complex target distribution and have proved to be powerful models for data generation and density estimation. In this work, we propose a novel type of normalizing flow driven by…

Machine Learning · Computer Science 2021-07-14 Ruizhi Deng , Bo Chang , Marcus A. Brubaker , Greg Mori , Andreas Lehrmann

Continuous Normalizing Flows (CNFs) are a class of generative models that transform a prior distribution to a model distribution by solving an ordinary differential equation (ODE). We propose to train CNFs on manifolds by minimizing…

Normalizing flows are a powerful tool for building expressive distributions in high dimensions. So far, most of the literature has concentrated on learning flows on Euclidean spaces. Some problems however, such as those involving angles,…

Explicit density learners are becoming an increasingly popular technique for generative models because of their ability to better model probability distributions. They have advantages over Generative Adversarial Networks due to their…

Machine Learning · Computer Science 2025-06-27 Steven Walton , Valeriy Klyukin , Maksim Artemev , Denis Derkach , Nikita Orlov , Humphrey Shi

Normalizing flows (NF) recently gained attention as a way to construct generative networks with exact likelihood calculation out of composable layers. However, NF is restricted to dimension-preserving transformations. Surjection VAE…

Machine Learning · Computer Science 2023-11-28 Paul M. Baggenstoss , Felix Govaers

Orbital-free density functional theory (OF-DFT) for real-space systems has historically depended on Lagrange optimization techniques, primarily due to the inability of previously proposed electron density approaches to ensure the…

Chemical Physics · Physics 2024-11-08 Alexandre de Camargo , Ricky T. Q. Chen , Rodrigo A. Vargas-Hernández

The development of safety validation methods is essential for the safe deployment and operation of Automated Driving Systems (ADSs). One of the goals of safety validation is to prospectively evaluate the risk of an ADS dealing with…

Robotics · Computer Science 2025-07-31 Erwin de Gelder , Maren Buermann , Olaf Op den Camp

In this work, we propose a new family of generative flows on an augmented data space, with an aim to improve expressivity without drastically increasing the computational cost of sampling and evaluation of a lower bound on the likelihood.…

Machine Learning · Computer Science 2020-02-19 Chin-Wei Huang , Laurent Dinh , Aaron Courville

Our universe is homogeneous and isotropic, and its perturbations obey translation and rotation symmetry. In this work we develop Translation and Rotation Equivariant Normalizing Flow (TRENF), a generative Normalizing Flow (NF) model which…

Cosmology and Nongalactic Astrophysics · Physics 2022-08-03 Biwei Dai , Uros Seljak

Improvements in computational and experimental capabilities are rapidly increasing the amount of scientific data that is routinely generated. In applications that are constrained by memory and computational intensity, excessively large…

Machine Learning · Computer Science 2023-02-28 Malik Hassanaly , Bruce A. Perry , Michael E. Mueller , Shashank Yellapantula

We propose the NFLikelihood, an unsupervised version, based on Normalizing Flows, of the DNNLikelihood proposed in Ref.[1]. We show, through realistic examples, how Autoregressive Flows, based on affine and rational quadratic spline…

High Energy Physics - Phenomenology · Physics 2024-05-17 Humberto Reyes-Gonzalez , Riccardo Torre

We introduce graph normalizing flows: a new, reversible graph neural network model for prediction and generation. On supervised tasks, graph normalizing flows perform similarly to message passing neural networks, but at a significantly…

Machine Learning · Computer Science 2019-05-31 Jenny Liu , Aviral Kumar , Jimmy Ba , Jamie Kiros , Kevin Swersky

Normalizing flows model complex probability distributions by combining a base distribution with a series of bijective neural networks. State-of-the-art architectures rely on coupling and autoregressive transformations to lift up invertible…

Machine Learning · Computer Science 2021-02-15 Antoine Wehenkel , Gilles Louppe

The present study presents a novel application for normalizing flows for domain adaptation. The study investigates the ability of flow based neural networks to improve signal extraction of $\Lambda$ Hyperons at CLAS12. Normalizing Flows can…

High Energy Physics - Experiment · Physics 2024-03-22 Rowan Kelleher , Matthew McEneaney , Anselm Vossen

Sampling from high-dimensional, multi-modal distributions remains a fundamental challenge across domains such as statistical Bayesian inference and physics-based machine learning. In this paper, we propose Annealing Flow (AF), a method…

Machine Learning · Statistics 2025-05-28 Dongze Wu , Yao Xie

A normalizing flow models a complex probability density as an invertible transformation of a simple base density. Flows based on either coupling or autoregressive transforms both offer exact density evaluation and sampling, but rely on the…

Machine Learning · Statistics 2019-12-03 Conor Durkan , Artur Bekasov , Iain Murray , George Papamakarios

Fueled by the expressive power of deep neural networks, normalizing flows have achieved spectacular success in generative modeling, or learning to draw new samples from a distribution given a finite dataset of training samples. Normalizing…

Machine Learning · Computer Science 2023-05-05 Yuehaw Khoo , Michael Lindsey , Hongli Zhao

Flow-based deep generative models learn data distributions by transforming a simple base distribution into a complex distribution via a set of invertible transformations. Due to the invertibility, such models can score unseen data samples…

Machine Learning · Computer Science 2019-06-18 Maximilian Schmidt , Marko Simic

To better conform to data geometry, recent deep generative modelling techniques adapt Euclidean constructions to non-Euclidean spaces. In this paper, we study normalizing flows on manifolds. Previous work has developed flow models for…

Machine Learning · Statistics 2020-06-19 Aaron Lou , Derek Lim , Isay Katsman , Leo Huang , Qingxuan Jiang , Ser-Nam Lim , Christopher De Sa

This paper introduces a generative model equivariant to Euclidean symmetries: E(n) Equivariant Normalizing Flows (E-NFs). To construct E-NFs, we take the discriminative E(n) graph neural networks and integrate them as a differential…

Machine Learning · Computer Science 2022-01-17 Victor Garcia Satorras , Emiel Hoogeboom , Fabian B. Fuchs , Ingmar Posner , Max Welling