English
Related papers

Related papers: Densely connected normalizing flows

200 papers

Normalizing flows are a powerful tool for generative modelling, density estimation and posterior reconstruction in Bayesian inverse problems. In this paper, we introduce proximal residual flows, a new architecture of normalizing flows.…

Machine Learning · Computer Science 2023-05-19 Johannes Hertrich

Flow models have rapidly become the go-to method for training and deploying large-scale generators, owing their success to inference-time flexibility via adjustable integration steps. A crucial ingredient in flow training is the choice of…

Normalizing Flows (NFs) are universal density estimators based on Neural Networks. However, this universality is limited: the density's support needs to be diffeomorphic to a Euclidean space. In this paper, we propose a novel method to…

Machine Learning · Computer Science 2022-02-02 Christian Horvat , Jean-Pascal Pfister

To enhance low-light images to normally-exposed ones is highly ill-posed, namely that the mapping relationship between them is one-to-many. Previous works based on the pixel-wise reconstruction losses and deterministic processes fail to…

Image and Video Processing · Electrical Eng. & Systems 2021-09-14 Yufei Wang , Renjie Wan , Wenhan Yang , Haoliang Li , Lap-Pui Chau , Alex C. Kot

Normalizing Flows (NFs) describe a class of models that express a complex target distribution as the composition of a series of bijective transformations over a simpler base distribution. By limiting the space of candidate transformations…

Machine Learning · Computer Science 2023-09-11 Keegan Kelly , Lorena Piedras , Sukrit Rao , David Roth

Normalizing flows are powerful non-parametric statistical models that function as a hybrid between density estimators and generative models. Current learning algorithms for normalizing flows assume that data points are sampled…

Machine Learning · Computer Science 2023-05-31 Matthias Kirchler , Christoph Lippert , Marius Kloft

Normalizing flows have received a great deal of recent attention as they allow flexible generative modeling as well as easy likelihood computation. While a wide variety of flow models have been proposed, there is little formal understanding…

Machine Learning · Computer Science 2020-06-02 Zhifeng Kong , Kamalika Chaudhuri

Normalizing flows are among the most popular paradigms in generative modeling, especially for images, primarily because we can efficiently evaluate the likelihood of a data point. This is desirable both for evaluating the fit of a model,…

Machine Learning · Computer Science 2021-06-29 Frederic Koehler , Viraj Mehta , Andrej Risteski

Fueled by the expressive power of deep neural networks, normalizing flows have achieved spectacular success in generative modeling, or learning to draw new samples from a distribution given a finite dataset of training samples. Normalizing…

Machine Learning · Computer Science 2023-05-05 Yuehaw Khoo , Michael Lindsey , Hongli Zhao

Normalizing flows model complex probability distributions using maps obtained by composing invertible layers. Special linear layers such as masked and 1x1 convolutions play a key role in existing architectures because they increase…

Machine Learning · Computer Science 2022-09-29 Chenlin Meng , Linqi Zhou , Kristy Choi , Tri Dao , Stefano Ermon

Normalizing flows are a class of probabilistic generative models which allow for both fast density computation and efficient sampling and are effective at modelling complex distributions like images. A drawback among current methods is…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Jason J. Yu , Konstantinos G. Derpanis , Marcus A. Brubaker

Normalizing flows are a class of generative models that enable exact likelihood evaluation. While these models have already found various applications in particle physics, normalizing flows are not flexible enough to model many of the…

High Energy Physics - Phenomenology · Physics 2022-09-07 Rob Verheyen

In the past, normalizing generative flows have emerged as a promising class of generative models for natural images. This type of model has many modeling advantages: the ability to efficiently compute log-likelihood of the input data, fast…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Alexander Kolesnikov , André Susano Pinto , Michael Tschannen

To model manifold data using normalizing flows, we employ isometric autoencoders to design embeddings with explicit inverses that do not distort the probability distribution. Using isometries separates manifold learning and density…

Machine Learning · Computer Science 2023-05-09 Eike Cramer , Felix Rauh , Alexander Mitsos , Raúl Tempone , Manuel Dahmen

Normalizing Flows (NFs) are able to model complicated distributions p(y) with strong inter-dimensional correlations and high multimodality by transforming a simple base density p(z) through an invertible neural network under the change of…

Machine Learning · Computer Science 2023-11-14 Christina Winkler , Daniel Worrall , Emiel Hoogeboom , Max Welling

We show that normalising flows become pathological when used to model targets whose supports have complicated topologies. In this scenario, we prove that a flow must become arbitrarily numerically noninvertible in order to approximate the…

Machine Learning · Statistics 2021-04-26 Rob Cornish , Anthony L. Caterini , George Deligiannidis , Arnaud Doucet

Normalizing Flows are generative models which produce tractable distributions where both sampling and density evaluation can be efficient and exact. The goal of this survey article is to give a coherent and comprehensive review of the…

Machine Learning · Statistics 2020-06-09 Ivan Kobyzev , Simon J. D. Prince , Marcus A. Brubaker

The Normalizing Flow (NF) models a general probability density by estimating an invertible transformation applied on samples drawn from a known distribution. We introduce a new type of NF, called Deep Diffeomorphic Normalizing Flow (DDNF).…

Machine Learning · Statistics 2018-11-26 Hadi Salman , Payman Yadollahpour , Tom Fletcher , Kayhan Batmanghelich

We reinterpret multiplicative noise in neural networks as auxiliary random variables that augment the approximate posterior in a variational setting for Bayesian neural networks. We show that through this interpretation it is both efficient…

Machine Learning · Statistics 2017-06-14 Christos Louizos , Max Welling

The two key characteristics of a normalizing flow is that it is invertible (in particular, dimension preserving) and that it monitors the amount by which it changes the likelihood of data points as samples are propagated along the network.…

Machine Learning · Computer Science 2023-01-27 Bálint Máté , Samuel Klein , Tobias Golling , François Fleuret