English
Related papers

Related papers: Piecewise Normalizing Flows

200 papers

Normalizing flows are a powerful tool to create flexible probability distributions with a wide range of potential applications in cosmology. Here we are studying normalizing flows which represent cosmological observables at field level,…

Cosmology and Nongalactic Astrophysics · Physics 2021-05-26 Adam Rouhiainen , Utkarsh Giri , Moritz Münchmeyer

Normalizing flows are powerful non-parametric statistical models that function as a hybrid between density estimators and generative models. Current learning algorithms for normalizing flows assume that data points are sampled…

Machine Learning · Computer Science 2023-05-31 Matthias Kirchler , Christoph Lippert , Marius Kloft

Normalizing flows are constructed from a base distribution with a known density and a diffeomorphism with a tractable Jacobian. The base density of a normalizing flow can be parameterised by a different normalizing flow, thus allowing maps…

Machine Learning · Computer Science 2022-11-07 Samuel Klein , John Andrew Raine , Tobias Golling

Normalizing flows are exact-likelihood generative neural networks which approximately transform samples from a simple prior distribution to samples of the probability distribution of interest. Recent work showed that such generative models…

Machine Learning · Statistics 2020-10-27 Jonas Köhler , Leon Klein , Frank Noé

Iterative Gaussianization is a fixed-point iteration procedure that can transform any continuous random vector into a Gaussian one. Based on iterative Gaussianization, we propose a new type of normalizing flow model that enables both…

Machine Learning · Computer Science 2020-03-05 Chenlin Meng , Yang Song , Jiaming Song , Stefano Ermon

Estimating the expectation of a real-valued function of a random variable from sample data is a critical aspect of statistical analysis, with far-reaching implications in various applications. Current methodologies typically assume…

Machine Learning · Computer Science 2026-02-18 Paweł Lorek , Rafał Nowak , Rafał Topolnicki , Tomasz Trzciński , Maciej Zięba , Aleksandra Krystecka

Normalizing flows are a class of generative models that enable exact likelihood evaluation. While these models have already found various applications in particle physics, normalizing flows are not flexible enough to model many of the…

High Energy Physics - Phenomenology · Physics 2022-09-07 Rob Verheyen

Fueled by the expressive power of deep neural networks, normalizing flows have achieved spectacular success in generative modeling, or learning to draw new samples from a distribution given a finite dataset of training samples. Normalizing…

Machine Learning · Computer Science 2023-05-05 Yuehaw Khoo , Michael Lindsey , Hongli Zhao

We present an alternative to reweighting techniques for modifying distributions to account for a desired change in an underlying conditional distribution, as is often needed to correct for mis-modelling in a simulated sample. We employ…

High Energy Physics - Phenomenology · Physics 2023-05-01 Malte Algren , Tobias Golling , Manuel Guth , Chris Pollard , John Andrew Raine

Normalizing flows model probability distributions through an expressive tractable density. They transform a simple base distribution, such as a Gaussian, through a sequence of invertible functions, which are referred to as layers. These…

Normalizing flows are a promising tool for modeling probability distributions in physical systems. While state-of-the-art flows accurately approximate distributions and energies, applications in physics additionally require smooth energies…

Machine Learning · Statistics 2021-12-01 Jonas Köhler , Andreas Krämer , Frank Noé

We present a framework for learning probability distributions on topologically non-trivial manifolds, utilizing normalizing flows. Current methods focus on manifolds that are homeomorphic to Euclidean space, enforce strong structural priors…

Machine Learning · Computer Science 2022-07-12 Dimitris Kalatzis , Johan Ziruo Ye , Alison Pouplin , Jesper Wohlert , Søren Hauberg

Normalising flows are tractable probabilistic models that leverage the power of deep learning to describe a wide parametric family of distributions, all while remaining trainable using maximum likelihood. We discuss how these methods can be…

Machine Learning · Computer Science 2020-07-14 Simon Alexanderson , Gustav Eje Henter

A normalizing flow models a complex probability density as an invertible transformation of a simple base density. Flows based on either coupling or autoregressive transforms both offer exact density evaluation and sampling, but rely on the…

Machine Learning · Statistics 2019-12-03 Conor Durkan , Artur Bekasov , Iain Murray , George Papamakarios

Recently, there has been a surge of interest in incorporating neural networks into particle filters, e.g. differentiable particle filters, to perform joint sequential state estimation and model learning for non-linear non-Gaussian…

Machine Learning · Computer Science 2025-01-07 Xiongjie Chen , Yunpeng Li

In this work, we investigate the use of normalizing flows to model conditional distributions. In particular, we use our proposed method to analyze inverse problems with invertible neural networks by maximizing the posterior likelihood. Our…

Machine Learning · Computer Science 2019-11-07 Zhisheng Xiao , Qing Yan , Yali Amit

Sampling-based motion planning is the predominant paradigm in many real-world robotic applications, but its performance is immensely dependent on the quality of the samples. The majority of traditional planners are inefficient as they use…

Robotics · Computer Science 2020-10-23 Tin Lai , Fabio Ramos

Recent advances in machine learning have led to the development of new methods for enhancing Monte Carlo methods such as Markov chain Monte Carlo (MCMC) and importance sampling (IS). One such method is normalizing flows, which use a neural…

Computation · Statistics 2024-01-12 Charly Andral

Normalizing flows transform a simple base distribution into a complex target distribution and have proved to be powerful models for data generation and density estimation. In this work, we propose a novel type of normalizing flow driven by…

Machine Learning · Computer Science 2021-07-14 Ruizhi Deng , Bo Chang , Marcus A. Brubaker , Greg Mori , Andreas Lehrmann

Bayesian posterior inference is prevalent in various machine learning problems. Variational inference provides one way to approximate the posterior distribution, however its expressive power is limited and so is the accuracy of resulting…

Machine Learning · Computer Science 2018-07-11 Guoqing Zheng , Yiming Yang , Jaime Carbonell