English
Related papers

Related papers: HMC with Normalizing Flows

200 papers

We present a computational framework for efficient learning, sampling, and distribution of general Bayesian posterior distributions. The framework leverages a machine learning approach for the construction of normalizing flows for the…

Nuclear Theory · Physics 2023-10-10 Yukari Yamauchi , Landon Buskirk , Pablo Giuliani , Kyle Godbey

We propose a renormalisation group inspired normalising flow that combines benefits from traditional Markov chain Monte Carlo methods and standard normalising flows to sample lattice field theories. Specifically, we use samples from a…

High Energy Physics - Lattice · Physics 2024-12-18 Marc Bauer , Renzo Kapust , Jan M. Pawlowski , Finn L. Temmen

We propose a sampling algorithm relying on a collective variable (CV) of mid-size dimension modelled by a normalizing flow and using non-equilibrium dynamics to propose full configurational moves from the proposition of a refreshed value of…

Statistical Mechanics · Physics 2024-07-29 Samuel Tamagnone , Alessandro Laio , Marylou Gabrié

Most expressive variational families -- such as normalizing flows -- lack practical convergence guarantees, as their theoretical assurances typically hold only at the intractable global optimum. In this work, we present a general recipe for…

Computation · Statistics 2026-01-06 Zuheng Xu , Trevor Campbell

A Markov chain update scheme using a machine-learned flow-based generative model is proposed for Monte Carlo sampling in lattice field theories. The generative model may be optimized (trained) to produce samples from a distribution…

High Energy Physics - Lattice · Physics 2019-09-10 M. S. Albergo , G. Kanwar , P. E. Shanahan

We generalize the Hamiltonian Monte Carlo algorithm with a stack of neural network layers and evaluate its ability to sample from different topologies in a two dimensional lattice gauge theory. We demonstrate that our model is able to…

High Energy Physics - Lattice · Physics 2021-05-10 Sam Foreman , Xiao-Yong Jin , James C. Osborn

In this paper, we explore the potential of generative machine learning models as an alternative to the computationally expensive Monte Carlo (MC) simulations commonly used by the Large Hadron Collider (LHC) experiments. Our objective is to…

High Energy Physics - Experiment · Physics 2023-11-21 Allison Xu , Shuo Han , Xiangyang Ju , Haichen Wang

We propose a generic construction of Lie group agnostic and gauge covariant neural networks, and introduce constraints to make the neural networks continuous differentiable and invertible. We combine such neural networks and build gauge…

High Energy Physics - Lattice · Physics 2022-03-28 Xiao-Yong Jin

Hamiltonian Monte Carlo (HMC) has become routinely used for sampling from posterior distributions. Its extension Riemann manifold HMC (RMHMC) modifies the proposal kernel through distortion of local distances by a Riemannian metric. The…

Computation · Statistics 2017-02-21 Akihiko Nishimura , David Dunson

Sampling topological quantities in the Monte Carlo simulation of Lattice Gauge Theory becomes challenging as we approach the continuum limit of the theory. In this work, we introduce a Conditional Normalizing Flow (C-NF) model to sample…

High Energy Physics - Lattice · Physics 2023-11-01 Ankur Singha , Dipankar Chakrabarti , Vipul Arora

Hamiltonian Monte Carlo (HMC) is a popular Markov chain Monte Carlo (MCMC) algorithm that generates proposals for a Metropolis-Hastings algorithm by simulating the dynamics of a Hamiltonian system. However, HMC is sensitive to large time…

Machine Learning · Statistics 2016-09-15 Xiaoyu Lu , Valerio Perrone , Leonard Hasenclever , Yee Whye Teh , Sebastian J. Vollmer

The Hamiltonian Monte Carlo method generates samples by introducing a mechanical system that explores the target density. For distributions on manifolds it is not always simple to perform the mechanics as a result of the lack of global…

Computation · Statistics 2019-04-22 Alessandro Barp , Anthony Kennedy , Mark Girolami

We propose a new multimodal variational autoencoder that enables to generate from the joint distribution and conditionally to any number of complex modalities. The unimodal posteriors are conditioned on the Deep Canonical Correlation…

Machine Learning · Statistics 2023-05-22 Agathe Senellart , Clément Chadebec , Stéphanie Allassonnière

We present a trainable framework for efficiently generating gauge configurations, and discuss ongoing work in this direction. In particular, we consider the problem of sampling configurations from a 4D $SU(3)$ lattice gauge theory, and…

High Energy Physics - Lattice · Physics 2023-12-19 Sam Foreman , Xiao-Yong Jin , James C. Osborn

Existing Markov Chain Monte Carlo (MCMC) methods are either based on general-purpose and domain-agnostic schemes which can lead to slow convergence, or hand-crafting of problem-specific proposals by an expert. We propose A-NICE-MC, a novel…

Machine Learning · Statistics 2018-03-16 Jiaming Song , Shengjia Zhao , Stefano Ermon

Normalizing Flows (NFs) are emerging as a powerful class of generative models, as they not only allow for efficient sampling, but also deliver, by construction, density estimation. They are of great potential usage in High Energy Physics…

Machine Learning · Statistics 2023-03-01 Humberto Reyes-Gonzalez , Riccardo Torre

This article introduces the Modified Parameterized Leapfrog Hamiltonian Monte Carlo (MPL-HMC) method, a novel extension of HMC addressing key limitations through tunable integration parameters $\alpha(\delta t)$ and $\beta(\delta t)$,…

Computation · Statistics 2026-02-17 Sourabh Bhattacharya

This notebook tutorial demonstrates a method for sampling Boltzmann distributions of lattice field theories using a class of machine learning models known as normalizing flows. The ideas and approaches proposed in arXiv:1904.12072,…

Lack of standardization and various intrinsic parameters for magnetic resonance (MR) image acquisition results in heterogeneous images across different sites and devices, which adversely affects the generalization of deep neural networks.…

Despite their popularity, to date, the application of normalizing flows on categorical data stays limited. The current practice of using dequantization to map discrete data to a continuous space is inapplicable as categorical data has no…

Machine Learning · Computer Science 2021-01-22 Phillip Lippe , Efstratios Gavves