English
Related papers

Related papers: Resampling Base Distributions of Normalizing Flows

200 papers

Bayesian posterior inference is prevalent in various machine learning problems. Variational inference provides one way to approximate the posterior distribution, however its expressive power is limited and so is the accuracy of resulting…

Machine Learning · Computer Science 2018-07-11 Guoqing Zheng , Yiming Yang , Jaime Carbonell

Normalizing flows model probability distributions through an expressive tractable density. They transform a simple base distribution, such as a Gaussian, through a sequence of invertible functions, which are referred to as layers. These…

Normalizing flows model a complex target distribution in terms of a bijective transform operating on a simple base distribution. As such, they enable tractable computation of a number of important statistical quantities, particularly…

Machine Learning · Computer Science 2022-09-01 Chandramouli Shama Sastry , Andreas Lehrmann , Marcus Brubaker , Alexander Radovic

Normalizing flows model probability distributions by learning invertible transformations that transfer a simple distribution into complex distributions. Since the architecture of ResNet-based normalizing flows is more flexible than that of…

Machine Learning · Computer Science 2022-10-18 Byeongkeun Ahn , Chiyoon Kim , Youngjoon Hong , Hyunwoo J. Kim

Normalizing flows are objects used for modeling complicated probability density functions, and have attracted considerable interest in recent years. Many flexible families of normalizing flows have been developed. However, the focus to date…

Methodology · Statistics 2023-01-18 Tin Lok James Ng , Andrew Zammit-Mangion

Normalizing flows are tractable density models that can approximate complicated target distributions, e.g. Boltzmann distributions of physical systems. However, current methods for training flows either suffer from mode-seeking behavior,…

Distribution alignment has many applications in deep learning, including domain adaptation and unsupervised image-to-image translation. Most prior work on unsupervised distribution alignment relies either on minimizing simple non-parametric…

Machine Learning · Computer Science 2020-10-27 Ben Usman , Avneesh Sud , Nick Dufour , Kate Saenko

Using the intuition that out-of-distribution data have lower likelihoods, a common approach for out-of-distribution detection involves estimating the underlying data distribution. Normalizing flows are likelihood-based generative models…

Machine Learning · Computer Science 2025-01-30 Seyedeh Fatemeh Razavi , Mohammad Mahdi Mehmanchi , Reshad Hosseini , Mostafa Tavassolipour

Normalizing flows are a powerful tool for generative modelling, density estimation and posterior reconstruction in Bayesian inverse problems. In this paper, we introduce proximal residual flows, a new architecture of normalizing flows.…

Machine Learning · Computer Science 2023-05-19 Johannes Hertrich

Computing the marginal likelihood (also called the Bayesian model evidence) is an important task in Bayesian model selection, providing a principled quantitative way to compare models. The learned harmonic mean estimator solves the…

Methodology · Statistics 2024-01-22 Alicja Polanska , Matthew A. Price , Alessio Spurio Mancini , Jason D. McEwen

Normalizing flows have recently demonstrated the ability to learn the Boltzmann distribution of the Hubbard model, opening new avenues for generative modeling in condensed matter physics. In this work, we investigate the steps required to…

Strongly Correlated Electrons · Physics 2026-01-27 Janik Kreit , Andrea Bulgarelli , Lena Funcke , Thomas Luu , Dominic Schuh , Simran Singh , Lorenzo Verzichelli

Generative models are a promising tool to address the sampling problem in multi-body and condensed-matter systems in the framework of statistical mechanics. In this work, we show that normalizing flows can be used to learn a transformation…

Computational Physics · Physics 2022-08-23 Alessandro Coretti , Sebastian Falkner , Phillip Geissler , Christoph Dellago

Normalizing flows transform a simple base distribution into a complex target distribution and have proved to be powerful models for data generation and density estimation. In this work, we propose a novel type of normalizing flow driven by…

Machine Learning · Computer Science 2021-07-14 Ruizhi Deng , Bo Chang , Marcus A. Brubaker , Greg Mori , Andreas Lehrmann

In a celebrated paper \cite{noe2019boltzmann}, No\'e, Olsson, K\"ohler and Wu introduced an efficient method for sampling high-dimensional Boltzmann distributions arising in molecular dynamics via normalizing flow approximation of transport…

Machine Learning · Computer Science 2026-03-17 Zia Ur Rehman , Gero Friesecke

In the past few years, deep generative models, such as generative adversarial networks \autocite{GAN}, variational autoencoders \autocite{vaepaper}, and their variants, have seen wide adoption for the task of modelling complex data…

Machine Learning · Statistics 2020-09-02 Guilherme G. P. Freitas Pires , Mário A. T. Figueiredo

Normalizing flows have been successfully modeling a complex probability distribution as an invertible transformation of a simple base distribution. However, there are often applications that require more than invertibility. For instance,…

Machine Learning · Computer Science 2023-04-12 Seongmin Hong , Se Young Chun

The sampling of probability distributions specified up to a normalization constant is an important problem in both machine learning and statistical mechanics. While classical stochastic sampling methods such as Markov Chain Monte Carlo…

Machine Learning · Statistics 2020-10-27 Hao Wu , Jonas Köhler , Frank Noé

This paper presents a parameter scan technique for BSM signal models based on normalizing flow. Normalizing flow is a type of deep learning model that transforms a simple probability distribution into a complex probability distribution as…

Data Analysis, Statistics and Probability · Physics 2024-09-23 Masahiko Saito , Masahiro Morinaga , Tomoe Kishimoto , Junichi Tanaka

Normalizing Flows explicitly maximize a full-dimensional likelihood on the training data. However, real data is typically only supported on a lower-dimensional manifold leading the model to expend significant compute on modeling noise.…

Machine Learning · Computer Science 2024-06-28 Peter Sorrenson , Felix Draxler , Armand Rousselot , Sander Hummerich , Lea Zimmermann , Ullrich Köthe

Modern reinforcement learning (RL) algorithms have found success by using powerful probabilistic models, such as transformers, energy-based models, and diffusion/flow-based models. To this end, RL researchers often choose to pay the price…

Machine Learning · Computer Science 2025-06-05 Raj Ghugare , Benjamin Eysenbach