English
Related papers

Related papers: HMC with Normalizing Flows

200 papers

Continuous normalizing flows (CNFs) construct invertible mappings between an arbitrary complex distribution and an isotropic Gaussian distribution using Neural Ordinary Differential Equations (neural ODEs). It has not been tractable on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shian Du , Yihong Luo , Wei Chen , Jian Xu , Delu Zeng

There has been considerable interest in designing Markov chain Monte Carlo algorithms by exploiting numerical methods for Langevin dynamics, which includes Hamiltonian dynamics as a deterministic case. A prominent approach is Hamiltonian…

Computation · Statistics 2021-06-08 Zexi Song , Zhiqiang Tan

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo (MCMC) algorithm that avoids the random walk behavior and sensitivity to correlated parameters that plague many MCMC methods by taking a series of steps informed by first-order…

Computation · Statistics 2015-03-19 Matthew D. Hoffman , Andrew Gelman

We introduce ImitationFlow, a novel Deep generative model that allows learning complex globally stable, stochastic, nonlinear dynamics. Our approach extends the Normalizing Flows framework to learn stable Stochastic Differential Equations.…

Machine Learning · Computer Science 2020-10-27 Julen Urain , Michelle Ginesi , Davide Tateo , Jan Peters

Value function based reinforcement learning (RL) algorithms, for example, $Q$-learning, learn optimal policies from datasets of actions, rewards, and state transitions. However, when the underlying state transition dynamics are stochastic…

Machine Learning · Computer Science 2022-03-29 Udari Madhushani , Biswadip Dey , Naomi Ehrich Leonard , Amit Chakraborty

Hamiltonian Monte Carlo (HMC) and its dynamic extensions, such as the No-U-Turn Sampler (NUTS), are powerful Markov chain Monte Carlo methods for sampling from complex, high-dimensional probability distributions. Riemannian manifold…

Computation · Statistics 2026-04-16 Miika Kailas , Matti Vihola , Jonas Wallin

General-purpose Markov Chain Monte Carlo sampling algorithms suffer from a dramatic reduction in efficiency as the system being studied is driven towards a critical point. Recently, a series of seminal studies suggested that normalizing…

High Energy Physics - Lattice · Physics 2021-11-24 Luigi Del Debbio , Joe Marsh Rossney , Michael Wilson

We propose an automated analysis of the flow control behaviour from an ensemble of control laws and associated time-resolved flow snapshots. The input may be the rich data base of machine learning control (MLC) optimizing a feedback law for…

Fluid Dynamics · Physics 2020-09-01 Hao Li , Guy Y. Cornejo Maceda , Yiqing Li , Jianguo Tan , Marek Morzyński , Bernd R. Noack

Normalizing flows are invertible neural networks with tractable change-of-volume terms, which allow optimization of their parameters to be efficiently performed via maximum likelihood. However, data of interest are typically assumed to live…

Machine Learning · Statistics 2021-11-04 Anthony L. Caterini , Gabriel Loaiza-Ganem , Geoff Pleiss , John P. Cunningham

Model independent techniques for constructing background data templates using generative models have shown great promise for use in searches for new physics processes at the LHC. We introduce a major improvement to the CURTAINs method by…

High Energy Physics - Phenomenology · Physics 2023-05-09 Debajyoti Sengupta , Samuel Klein , John Andrew Raine , Tobias Golling

A novel framework for closed-loop control of turbulent flows is tested in an experimental mixing layer flow. This framework, called Machine Learning Control (MLC), provides a model-free method of searching for the best function, to be used…

We present computer simulations of a dynamic Monte Carlo algorithm for polymer chains on the FCC lattice which takes explicitly into account the possibility to overcome topological constraints by controlling the rate at which nearby polymer…

Soft Condensed Matter · Physics 2021-12-01 Mattia Alberto Ubertini , Angelo Rosa

Normalizing flows are an essential alternative to GANs for generative modelling, which can be optimized directly on the maximum likelihood of the dataset. They also allow computation of the exact latent vector corresponding to an image…

Machine Learning · Computer Science 2021-08-10 Sandeep Nagar , Marius Dufraisse , Girish Varma

Stochastic normalizing flows are a class of deep generative models that combine normalizing flows with Monte Carlo updates and can be used in lattice field theory to sample from Boltzmann distributions. In this proceeding, we outline the…

High Energy Physics - Lattice · Physics 2022-10-10 Michele Caselle , Elia Cellini , Alessandro Nada , Marco Panero

Whenever invertible generative networks are needed for LHC physics, normalizing flows show excellent performance. In this work, we investigate their performance for fast calorimeter shower simulations with increasing phase space dimension.…

High Energy Physics - Phenomenology · Physics 2025-03-06 Florian Ernst , Luigi Favaro , Claudius Krause , Tilman Plehn , David Shih

Normalizing flows can generate complex target distributions and thus show promise in many applications in Bayesian statistics as an alternative or complement to MCMC for sampling posteriors. Since no data set from the target posterior…

Machine Learning · Statistics 2021-07-19 Marylou Gabrié , Grant M. Rotskoff , Eric Vanden-Eijnden

Many recent Markov chain Monte Carlo (MCMC) samplers leverage continuous dynamics to define a transition kernel that efficiently explores a target distribution. In tandem, a focus has been on devising scalable variants that subsample the…

Statistics Theory · Mathematics 2015-11-03 Yi-An Ma , Tianqi Chen , Emily B. Fox

Hybrid Monte Carlo is a powerful Markov Chain Monte Carlo method for sampling from complex continuous distributions. However, a major limitation of HMC is its inability to be applied to discrete domains due to the lack of gradient signal.…

Machine Learning · Computer Science 2021-03-02 Priyank Jaini , Didrik Nielsen , Max Welling

Learning can be seen as approximating an unknown function by interpolating the training data. Kriging offers a solution to this problem based on the prior specification of a kernel. We explore a numerical approximation approach to kernel…

Machine Learning · Statistics 2019-05-01 Houman Owhadi , Gene Ryan Yoo

In this work, we demonstrate how to reliably estimate epistemic uncertainty while maintaining the flexibility needed to capture complicated aleatoric distributions. To this end, we propose an ensemble of Normalizing Flows (NF), which are…

Machine Learning · Computer Science 2023-10-05 Lucas Berry , David Meger