English
Related papers

Related papers: Flowification: Everything is a Normalizing Flow

200 papers

Generative Flow Networks (GFlowNets) have emerged as an innovative learning paradigm designed to address the challenge of sampling from an unnormalized probability distribution, called the reward function. This framework learns a policy on…

Machine Learning · Computer Science 2024-07-04 Anas Krichel , Nikolay Malkin , Salem Lahlou , Yoshua Bengio

Normalizing Flows (NFs) are emerging as a powerful class of generative models, as they not only allow for efficient sampling, but also deliver, by construction, density estimation. They are of great potential usage in High Energy Physics…

Machine Learning · Statistics 2023-03-01 Humberto Reyes-Gonzalez , Riccardo Torre

Recently, there has been a surge of interest in incorporating neural networks into particle filters, e.g. differentiable particle filters, to perform joint sequential state estimation and model learning for non-linear non-Gaussian…

Machine Learning · Computer Science 2025-01-07 Xiongjie Chen , Yunpeng Li

Normalizing flow is a generative modeling approach with efficient sampling. However, Flow-based models suffer two issues: 1) If the target distribution is manifold, due to the unmatch between the dimensions of the latent target distribution…

Machine Learning · Computer Science 2024-04-24 Qinglong Meng , Chongkun Xia , Xueqian Wang

Based on a natural connection between ResNet and transport equation or its characteristic equation, we propose a continuous flow model for both ResNet and plain net. Through this continuous model, a ResNet can be explicitly constructed as a…

Machine Learning · Computer Science 2017-12-12 Zhen Li , Zuoqiang Shi

Normalizing flows map an independent set of latent variables to their samples using a bijective transformation. Despite the exact correspondence between samples and latent variables, their high level relationship is not well understood. In…

Machine Learning · Statistics 2022-02-16 Edmond Cunningham , Adam Cobb , Susmit Jha

Reinforcement learning policies are typically represented by black-box neural networks, which are non-interpretable and not well-suited for safety-critical domains. To address both of these issues, we propose constrained normalizing flow…

Machine Learning · Computer Science 2024-05-03 Finn Rietz , Erik Schaffernicht , Stefan Heinrich , Johannes A. Stork

Learning neural networks using only few available information is an important ongoing research topic with tremendous potential for applications. In this paper, we introduce a powerful regularizer for the variational modeling of inverse…

Machine Learning · Computer Science 2023-05-17 Fabian Altekrüger , Alexander Denker , Paul Hagemann , Johannes Hertrich , Peter Maass , Gabriele Steidl

Based on the manifold hypothesis, real-world data often lie on a low-dimensional manifold, while normalizing flows as a likelihood-based generative model are incapable of finding this manifold due to their structural constraints. So, one…

Machine Learning · Computer Science 2022-06-08 Seyedeh Fatemeh Razavi , Mohammad Mahdi Mehmanchi , Reshad Hosseini , Mostafa Tavassolipour

We present a computational framework for efficient learning, sampling, and distribution of general Bayesian posterior distributions. The framework leverages a machine learning approach for the construction of normalizing flows for the…

Nuclear Theory · Physics 2023-10-10 Yukari Yamauchi , Landon Buskirk , Pablo Giuliani , Kyle Godbey

Normalizing flows are a powerful class of generative models demonstrating strong performance in several speech and vision problems. In contrast to other generative models, normalizing flows are latent variable models with tractable…

Machine Learning · Computer Science 2021-08-06 Dmitry Baranchuk , Vladimir Aliev , Artem Babenko

Many components of data analysis in high energy physics and beyond require morphing one dataset into another. This is commonly solved via reweighting, but there are many advantages of preserving weights and shifting the data points instead.…

High Energy Physics - Phenomenology · Physics 2023-11-22 Tobias Golling , Samuel Klein , Radha Mastandrea , Benjamin Nachman , John Andrew Raine

Normalising flows offer a flexible way of modelling continuous probability distributions. We consider expressiveness, fast inversion and exact Jacobian determinant as three desirable properties a normalising flow should possess. However,…

Machine Learning · Computer Science 2021-10-27 Yumou Wei

Recently, it has been claimed that some complex networks are self-similar under a convenient renormalization procedure. We present a general method to study renormalization flows in graphs. We find that the behavior of some variables under…

Physics and Society · Physics 2009-11-13 Filippo Radicchi , José Javier Ramasco , Alain Barrat , Santo Fortunato

We introduce `atomic flows': they are graphs obtained from derivations by tracing atom occurrences and forgetting the logical structure. We study simple manipulations of atomic flows that correspond to complex reductions on derivations.…

Logic · Mathematics 2015-07-01 Alessio Guglielmi , Tom Gundersen

Normalizing flows model complex probability distributions using maps obtained by composing invertible layers. Special linear layers such as masked and 1x1 convolutions play a key role in existing architectures because they increase…

Machine Learning · Computer Science 2022-09-29 Chenlin Meng , Linqi Zhou , Kristy Choi , Tri Dao , Stefano Ermon

Normalizing flows are a powerful tool to create flexible probability distributions with a wide range of potential applications in cosmology. Here we are studying normalizing flows which represent cosmological observables at field level,…

Cosmology and Nongalactic Astrophysics · Physics 2021-05-26 Adam Rouhiainen , Utkarsh Giri , Moritz Münchmeyer

Following the growing success of generative neural networks in LHC simulations, the crucial question is how to control the networks and assign uncertainties to their event output. We show how Bayesian normalizing flow or invertible networks…

High Energy Physics - Phenomenology · Physics 2022-12-07 Marco Bellagente , Manuel Haußmann , Michel Luchmann , Tilman Plehn

Normalizing flows and variational autoencoders are powerful generative models that can represent complicated density functions. However, they both impose constraints on the models: Normalizing flows use bijective transformations to model…

Machine Learning · Computer Science 2020-11-02 Didrik Nielsen , Priyank Jaini , Emiel Hoogeboom , Ole Winther , Max Welling

Variational inference relies on flexible approximate posterior distributions. Normalizing flows provide a general recipe to construct flexible variational posteriors. We introduce Sylvester normalizing flows, which can be seen as a…

Machine Learning · Statistics 2019-02-21 Rianne van den Berg , Leonard Hasenclever , Jakub M. Tomczak , Max Welling