English
Related papers

Related papers: Stochastic Normalizing Flows for Inverse Problems:…

200 papers

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

Normalizing flows model probability distributions through an expressive tractable density. They transform a simple base distribution, such as a Gaussian, through a sequence of invertible functions, which are referred to as layers. These…

Normalising Flows are non-parametric statistical models characterised by their dual capabilities of density estimation and generation. This duality requires an inherently invertible architecture. However, the requirement of invertibility…

Machine Learning · Statistics 2024-06-28 Eshant English , Matthias Kirchler , Christoph Lippert

We present a Markov-chain analysis of blockwise-stochastic algorithms for solving partially block-separable optimization problems. Our main contributions to the extensive literature on these methods are statements about the Markov operators…

Optimization and Control · Mathematics 2023-11-01 D. Russell Luke

We present a pseudo-reversible normalizing flow method for efficiently generating samples of the state of a stochastic differential equation (SDE) with different initial distributions. The primary objective is to construct an accurate and…

Numerical Analysis · Mathematics 2023-06-12 Minglei Yang , Pengjun Wang , Diego del-Castillo-Negrete , Yanzhao Cao , Guannan Zhang

Normalizing flows have emerged as an important family of deep neural networks for modelling complex probability distributions. In this note, we revisit their coupling and autoregressive transformation layers as probabilistic graphical…

Machine Learning · Computer Science 2020-06-05 Antoine Wehenkel , Gilles Louppe

We adopt an input-output approach to analyze the effect of persistent white-in-time structured stochastic base flow perturbations on the mean-square properties of the linearized Navier-Stokes equations. Such base flow variations enter the…

Fluid Dynamics · Physics 2022-07-11 Dhanushki Hewawaduge , Armin Zare

Variational inference with normalizing flows (NFs) is an increasingly popular alternative to MCMC methods. In particular, NFs based on coupling layers (Real NVPs) are frequently used due to their good empirical performance. In theory,…

Machine Learning · Statistics 2024-02-27 Daniel Andrade

Recently, there has been a surge of interest in incorporating neural networks into particle filters, e.g. differentiable particle filters, to perform joint sequential state estimation and model learning for non-linear non-Gaussian…

Machine Learning · Computer Science 2025-01-07 Xiongjie Chen , Yunpeng Li

Stochastic processes generated by non-stationary distributions are difficult to represent with conventional models such as Gaussian processes. This work presents Recurrent Autoregressive Flows as a method toward general stochastic process…

Machine Learning · Computer Science 2020-06-20 John Mern , Peter Morales , Mykel J. Kochenderfer

We introduce a method for reconstructing an infinitesimal normalizing flow given only an infinitesimal change to a (possibly unnormalized) probability distribution. This reverses the conventional task of normalizing flows -- rather than…

Machine Learning · Statistics 2020-12-04 David Pfau , Danilo Rezende

Modeling transformations between arbitrary data distributions is a fundamental scientific challenge, arising in applications like drug discovery and evolutionary simulation. While flow matching offers a natural framework for this task, its…

Machine Learning · Computer Science 2025-10-09 Shiye Su , Yuhui Zhang , Linqi Zhou , Rajesh Ranganath , Serena Yeung-Levy

The paper generalizes the construction by stochastic flows of consistent utility processes introduced by M. Mrad and N. El Karoui in (2010). The utilities random fields are defined from a general class of processes denoted by $\GX$. Making…

Computational Finance · Quantitative Finance 2013-04-08 N. El Karoui , Mohamed M'Rad

Stochastic normalizing flows are a class of deep generative models that combine normalizing flows with Monte Carlo updates and can be used in lattice field theory to sample from Boltzmann distributions. In this proceeding, we outline the…

High Energy Physics - Lattice · Physics 2022-10-10 Michele Caselle , Elia Cellini , Alessandro Nada , Marco Panero

A stochastic flow network is a directed graph with incoming edges (inputs) and outgoing edges (outputs), tokens enter through the input edges, travel stochastically in the network, and can exit the network through the output edges. Each…

Information Theory · Computer Science 2012-09-05 Hongchao Zhou , Ho-Lin Chen , Jehoshua Bruck

Normalizing Flows (NFs) have been established as a principled framework for generative modeling. Standard NFs consist of a forward process and a reverse process: the forward process maps data to noise, while the reverse process generates…

Machine Learning · Computer Science 2025-12-12 Yiyang Lu , Qiao Sun , Xianbang Wang , Zhicheng Jiang , Hanhong Zhao , Kaiming He

Normalizing flows, which learn a distribution by transforming the data to samples from a Gaussian base distribution, have proven powerful density approximations. But their expressive power is limited by this choice of the base distribution.…

Machine Learning · Computer Science 2021-07-16 Mike Laszkiewicz , Johannes Lederer , Asja Fischer

We present a computational framework for efficient learning, sampling, and distribution of general Bayesian posterior distributions. The framework leverages a machine learning approach for the construction of normalizing flows for the…

Nuclear Theory · Physics 2023-10-10 Yukari Yamauchi , Landon Buskirk , Pablo Giuliani , Kyle Godbey

We study the consequences of mode-collapse of normalizing flows in the context of lattice field theory. Normalizing flows allow for independent sampling. For this reason, it is hoped that they can avoid the tunneling problem of local-update…

High Energy Physics - Lattice · Physics 2023-11-06 Kim A. Nicoli , Christopher J. Anders , Tobias Hartung , Karl Jansen , Pan Kessel , Shinichi Nakajima

Gravity inversion is a commonly applied data analysis technique in the field of geophysics. While machine learning methods have previously been explored for the problem of gravity inversion, these are deterministic approaches returning a…