English
Related papers

Related papers: Stochastic normalizing flows as non-equilibrium tr…

200 papers

We introduce Projected Latent Markov Chain Monte Carlo (PL-MCMC), a technique for sampling from the high-dimensional conditional distributions learned by a normalizing flow. We prove that a Metropolis-Hastings implementation of PL-MCMC…

Machine Learning · Computer Science 2021-03-01 Chris Cannella , Mohammadreza Soltani , Vahid Tarokh

Continuous normalizing flows (CNFs) learn the probability path between a reference distribution and a target distribution by modeling the vector field generating said path using neural networks. Recently, Lipman et al. (2022) introduced a…

Methodology · Statistics 2024-10-29 Alberto Cabezas , Louis Sharrock , Christopher Nemeth

Tuning of measurement models is challenging in real-world applications of sequential Monte Carlo methods. Recent advances in differentiable particle filters have led to various efforts to learn measurement models through neural networks.…

Artificial Intelligence · Computer Science 2022-03-17 Xiongjie Chen , Yunpeng Li

Normalizing flows model probability distributions through an expressive tractable density. They transform a simple base distribution, such as a Gaussian, through a sequence of invertible functions, which are referred to as layers. These…

We present a specialized scenario generation method that utilizes forecast information to generate scenarios for day-ahead scheduling problems. In particular, we use normalizing flows to generate wind power scenarios by sampling from a…

Optimization and Control · Mathematics 2022-07-12 Eike Cramer , Leonard Paeleke , Alexander Mitsos , Manuel Dahmen

Recent work shows that path gradient estimators for normalizing flows have lower variance compared to standard estimators for variational inference, resulting in improved training. However, they are often prohibitively more expensive from a…

Machine Learning · Computer Science 2024-03-26 Lorenz Vaitl , Ludwig Winkler , Lorenz Richter , Pan Kessel

Continuous normalizing flows (CNFs) construct invertible mappings between an arbitrary complex distribution and an isotropic Gaussian distribution using Neural Ordinary Differential Equations (neural ODEs). It has not been tractable on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shian Du , Yihong Luo , Wei Chen , Jian Xu , Delu Zeng

Normalizing flows are a powerful tool for building expressive distributions in high dimensions. So far, most of the literature has concentrated on learning flows on Euclidean spaces. Some problems however, such as those involving angles,…

In the past few years, deep generative models, such as generative adversarial networks \autocite{GAN}, variational autoencoders \autocite{vaepaper}, and their variants, have seen wide adoption for the task of modelling complex data…

Machine Learning · Statistics 2020-09-02 Guilherme G. P. Freitas Pires , Mário A. T. Figueiredo

Deep generative models have recently garnered significant attention across various fields, from physics to chemistry, where sampling from unnormalized Boltzmann-like distributions represents a fundamental challenge. In particular,…

Machine Learning · Computer Science 2025-06-09 Janik Kreit , Dominic Schuh , Kim A. Nicoli , Lena Funcke

Extracting the maximum amount of cosmological and astrophysical information from upcoming large-scale surveys remains a challenge. This includes evaluating the exact likelihood, parameter inference and generating new diverse synthetic…

Cosmology and Nongalactic Astrophysics · Physics 2022-11-24 Roy Friedman , Sultan Hassan

Monte Carlo simulations of lattice quantum field theories on Lefschetz thimbles are non trivial. We discuss a new Monte Carlo algorithm based on the idea of computing contributions to the functional integral which come from complete flow…

High Energy Physics - Lattice · Physics 2016-11-28 Francesco Di Renzo , Giovanni Eruzzi

We introduce a novel stochastic regularization technique for deep neural networks, which decomposes a layer into multiple branches with different parameters and merges stochastically sampled combinations of the outputs from the branches…

Machine Learning · Computer Science 2019-10-04 Wonpyo Park , Paul Hongsuck Seo , Bohyung Han , Minsu Cho

We introduce an architecture for neural quantum states for many-body quantum-mechanical systems, based on normalizing flows. The use of normalizing flows enables efficient uncorrelated sampling of configurations from the probability…

Quantum Physics · Physics 2024-06-05 Scott Lawrence , Arlee Shelby , Yukari Yamauchi

Flow-based deep generative models learn data distributions by transforming a simple base distribution into a complex distribution via a set of invertible transformations. Due to the invertibility, such models can score unseen data samples…

Machine Learning · Computer Science 2019-06-18 Maximilian Schmidt , Marko Simic

Studying potential BSM effects at the precision frontier requires accurate transfer of information from low-energy measurements to high-energy BSM models. We propose to use normalising flows to construct likelihood functions that achieve…

High Energy Physics - Phenomenology · Physics 2023-09-20 Anja Beck , Méril Reboud , Danny van Dyk

Normalizing flows are a class of deep generative models that are especially interesting for modeling probability distributions in physics, where the exact likelihood of flows allows reweighting to known target energy functions and computing…

Machine Learning · Statistics 2023-11-27 Leon Klein , Andreas Krämer , Frank Noé

Variational inference with normalizing flows (NFs) is an increasingly popular alternative to MCMC methods. In particular, NFs based on coupling layers (Real NVPs) are frequently used due to their good empirical performance. In theory,…

Machine Learning · Statistics 2024-02-27 Daniel Andrade

We present a framework for learning probability distributions on topologically non-trivial manifolds, utilizing normalizing flows. Current methods focus on manifolds that are homeomorphic to Euclidean space, enforce strong structural priors…

Machine Learning · Computer Science 2022-07-12 Dimitris Kalatzis , Johan Ziruo Ye , Alison Pouplin , Jesper Wohlert , Søren Hauberg

Normalizing flows are invertible neural networks with tractable change-of-volume terms, which allow optimization of their parameters to be efficiently performed via maximum likelihood. However, data of interest are typically assumed to live…

Machine Learning · Statistics 2021-11-04 Anthony L. Caterini , Gabriel Loaiza-Ganem , Geoff Pleiss , John P. Cunningham