English
Related papers

Related papers: Detecting and Mitigating Mode-Collapse for Flow-ba…

200 papers

Normalizing Flows are generative models which produce tractable distributions where both sampling and density evaluation can be efficient and exact. The goal of this survey article is to give a coherent and comprehensive review of the…

Machine Learning · Statistics 2020-06-09 Ivan Kobyzev , Simon J. D. Prince , Marcus A. Brubaker

Stochastic normalizing flows are a class of deep generative models that combine normalizing flows with Monte Carlo updates and can be used in lattice field theory to sample from Boltzmann distributions. In this proceeding, we outline the…

High Energy Physics - Lattice · Physics 2022-10-10 Michele Caselle , Elia Cellini , Alessandro Nada , Marco Panero

While deep learning has expanded the possibilities for highly expressive variational families, the practical benefits of these tools for variational inference (VI) are often limited by the minimization of the traditional Kullback-Leibler…

Machine Learning · Statistics 2024-10-18 Roman Soletskyi , Marylou Gabrié , Bruno Loureiro

Normalizing flows model a complex target distribution in terms of a bijective transform operating on a simple base distribution. As such, they enable tractable computation of a number of important statistical quantities, particularly…

Machine Learning · Computer Science 2022-09-01 Chandramouli Shama Sastry , Andreas Lehrmann , Marcus Brubaker , Alexander Radovic

Normalizing flows have recently been applied to the problem of accelerating Markov chains in lattice field theory. We propose a generalization of normalizing flows that allows them to applied to theories with a sign problem. These complex…

High Energy Physics - Lattice · Physics 2022-05-26 Scott Lawrence , Yukari Yamauchi

Recent results have demonstrated that samplers constructed with flow-based generative models are a promising new approach for configuration generation in lattice field theory. In this paper, we present a set of training- and…

Continuous normalizing flows are known to be highly expressive and flexible, which allows for easier incorporation of large symmetries and makes them a powerful computational tool for lattice field theories. Building on previous work, we…

High Energy Physics - Lattice · Physics 2025-12-22 Mathis Gerdes , Pim de Haan , Roberto Bondesan , Miranda C. N. Cheng

Computing the marginal likelihood (also called the Bayesian model evidence) is an important task in Bayesian model selection, providing a principled quantitative way to compare models. The learned harmonic mean estimator solves the…

Methodology · Statistics 2024-01-22 Alicja Polanska , Matthew A. Price , Alessio Spurio Mancini , Jason D. McEwen

Normalizing flows have arisen as a tool to accelerate Monte Carlo sampling for lattice field theories. This work reviews recent progress in applying normalizing flows to 4-dimensional nonabelian gauge theories, focusing on two advancements:…

High Energy Physics - Lattice · Physics 2025-02-04 Ryan Abbott , Denis Boyda , Daniel C. Hackett , Gurtej Kanwar , Fernando Romero-López , Phiala E. Shanahan , Julian M. Urban

Despite their advantages, normalizing flows generally suffer from several shortcomings including their tendency to generate unrealistic data (e.g., images) and their failing to detect out-of-distribution data. One reason for these…

Machine Learning · Statistics 2022-07-13 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

A Markov chain update scheme using a machine-learned flow-based generative model is proposed for Monte Carlo sampling in lattice field theories. The generative model may be optimized (trained) to produce samples from a distribution…

High Energy Physics - Lattice · Physics 2019-09-10 M. S. Albergo , G. Kanwar , P. E. Shanahan

Deep generative models complement Markov-chain-Monte-Carlo methods for efficiently sampling from high-dimensional distributions. Among these methods, explicit generators, such as Normalising Flows (NFs), in combination with the Metropolis…

Machine Learning · Computer Science 2024-05-29 Vikas Kanaujia , Mathias S. Scheurer , Vipul Arora

Estimating the free energy, as well as other thermodynamic observables, is a key task in lattice field theories. Recently, it has been pointed out that deep generative models can be used in this context [1]. Crucially, these models allow…

High Energy Physics - Lattice · Physics 2022-09-21 Kim A. Nicoli , Christopher Anders , Lena Funcke , Tobias Hartung , Karl Jansen , Pan Kessel , Shinichi Nakajima , Paolo Stornati

In theories with topological sectors, such as lattice QCD and four-dimensional SU(N) gauge theories with periodic boundary conditions, conventional update algorithms suffer from topological freezing due to large action barriers separating…

High Energy Physics - Lattice · Physics 2026-04-07 Timo Eichhorn , Gianluca Fuwa , Christian Hoelbling , Lukas Varnhorst

We propose a continuous normalizing flow for sampling from the high-dimensional probability distributions of Quantum Field Theories in Physics. In contrast to the deep architectures used so far for this task, our proposal is based on a…

Machine Learning · Computer Science 2021-11-29 Pim de Haan , Corrado Rainone , Miranda C. N. Cheng , Roberto Bondesan

Normalizing flows are an established approach for modelling complex probability densities through invertible transformations from a base distribution. However, the accuracy with which the target distribution can be captured by the…

Machine Learning · Statistics 2024-02-02 Harry Bevins , Will Handley , Thomas Gessey-Jones

Many problems in the physical sciences, machine learning, and statistical inference necessitate sampling from a high-dimensional, multi-modal probability distribution. Markov Chain Monte Carlo (MCMC) algorithms, the ubiquitous tool for this…

Data Analysis, Statistics and Probability · Physics 2022-05-12 Marylou Gabrié , Grant M. Rotskoff , Eric Vanden-Eijnden

Normalizing flows are generative models that provide tractable density estimation via an invertible transformation from a simple base distribution to a complex target distribution. However, this technique cannot directly model data…

Machine Learning · Statistics 2021-11-15 Brendan Leigh Ross , Jesse C. Cresswell

Non-equilibrium Monte Carlo simulations based on Jarzynski's equality are a well-understood method to compute differences in free energy and also to sample from a target probability distribution without the need to thermalize the system…

High Energy Physics - Lattice · Physics 2024-10-07 Andrea Bulgarelli , Elia Cellini , Alessandro Nada

Normalizing flows have shown great promise for modelling flexible probability distributions in a computationally tractable way. However, whilst data is often naturally described on Riemannian manifolds such as spheres, torii, and hyperbolic…

Machine Learning · Statistics 2020-12-10 Emile Mathieu , Maximilian Nickel