English
Related papers

Related papers: Sampling from Discrete Energy-Based Models with Qu…

200 papers

Hamiltonian Monte Carlo is a prominent Markov Chain Monte Carlo algorithm, which employs symplectic integrators to sample from high dimensional target distributions in many applications, such as statistical mechanics, Bayesian statistics…

Numerical Analysis · Mathematics 2025-02-13 Geoffrey McGregor , Andy T. S. Wan

Recently there has been a lot of interest in non-autoregressive (non-AR) models for speech synthesis, such as FastSpeech 2 and diffusion models. Unlike AR models, these models do not have autoregressive dependencies among outputs which…

Sound · Computer Science 2023-10-20 Wanli Sun , Zehai Tu , Anton Ragni

Approximate Bayesian computation (ABC) methods can be used to sample from posterior distributions when the likelihood function is unavailable or intractable, as is often the case in biological systems. ABC methods suffer from inefficient…

Machine Learning · Statistics 2019-12-03 Charlie Rogers-Smith , Henri Pesonen , Samuel Kaski

This paper explores an energy-modified leverage sampling strategy for matrix completion in radio map construction. The main goal is to address potential identifiability issues in matrix completion with sparse observations by using a…

Signal Processing · Electrical Eng. & Systems 2024-04-15 Hao Sun , Junting Chen

Distributionally Robust Reinforcement Learning (DR-RL) aims to derive a policy optimizing the worst-case performance within a predefined uncertainty set. Despite extensive research, previous DR-RL algorithms have predominantly favored…

Machine Learning · Computer Science 2024-06-26 Yudan Wang , Shaofeng Zou , Yue Wang

Quasi-stationary distributions (QSDs)arise from stochastic processes that exhibit transient equilibrium behaviour on the way to absorption QSDs are often mathematically intractable and even drawing samples from them is not straightforward.…

Computation · Statistics 2017-01-18 Adam Griffin , Paul A. Jenkins , Gareth O. Roberts , Simon E. F. Spencer

Quantiles and expected shortfalls are usually used to measure risks of stochastic systems, which are often estimated by Monte Carlo methods. This paper focuses on the use of quasi-Monte Carlo (QMC) method, whose convergence rate is…

Numerical Analysis · Mathematics 2020-05-07 Zhijian He , Xiaoqun Wang

In this work, we examine sampling problems with non-smooth potentials. We propose a novel Markov chain Monte Carlo algorithm for sampling from non-smooth potentials. We provide a non-asymptotical analysis of our algorithm and establish a…

Machine Learning · Computer Science 2022-02-11 Jiaming Liang , Yongxin Chen

Sequential Monte Carlo samplers represent a compelling approach to posterior inference in Bayesian models, due to being parallelisable and providing an unbiased estimate of the posterior normalising constant. In this work, we significantly…

Methodology · Statistics 2022-11-24 Samuel Duffield , Sumeetpal S. Singh

An energy-based model (EBM) is a popular generative framework that offers both explicit density and architectural flexibility, but training them is difficult since it is often unstable and time-consuming. In recent years, various training…

Machine Learning · Computer Science 2023-03-07 Hankook Lee , Jongheon Jeong , Sejun Park , Jinwoo Shin

Bayesian modelling and computational inference by Markov chain Monte Carlo (MCMC) is a principled framework for large-scale uncertainty quantification, though is limited in practice by computational cost when implemented in the simplest…

Computation · Statistics 2020-09-21 Colin Fox , Tiangang Cui , Markus Neumayer

This study investigates the effects of Markov chain Monte Carlo (MCMC) sampling in unsupervised Maximum Likelihood (ML) learning. Our attention is restricted to the family of unnormalized probability densities for which the negative log…

Machine Learning · Statistics 2019-12-02 Erik Nijkamp , Mitch Hill , Tian Han , Song-Chun Zhu , Ying Nian Wu

Energy-Based Models (EBMs), also known as non-normalized probabilistic models, specify probability density or mass functions up to an unknown normalizing constant. Unlike most other probabilistic models, EBMs do not place a restriction on…

Machine Learning · Computer Science 2021-02-19 Yang Song , Diederik P. Kingma

We present a quantum Monte Carlo method capable of sampling the full density matrix of a many-particle system at finite temperature. This allows arbitrary reduced density matrix elements and expectation values of complicated non-local…

Computational Physics · Physics 2015-06-15 N. S. Blunt , T. W. Rogers , J. S. Spencer , W. M. C. Foulkes

We consider the problem of simulating loss probabilities and conditional excesses for linear asset portfolios under the t-copula model. Although in the literature on market risk management there are papers proposing efficient variance…

Risk Management · Quantitative Finance 2017-08-07 Halis Sak , İsmail Başoğlu

Markov chain Monte Carlo methods are often deemed too computationally intensive to be of any practical use for big data applications, and in particular for inference on datasets containing a large number $n$ of individual data points, also…

Methodology · Statistics 2015-05-13 Rémi Bardenet , Arnaud Doucet , Chris Holmes

A resampling scheme provides a way to switch low-weight particles for sequential Monte Carlo with higher-weight particles representing the objective distribution. The less the variance of the weight distribution is, the more concentrated…

Computation · Statistics 2023-09-19 Xiongming Dai , Gerald Baumgartner

The Metropolis-Hastings (MH) algorithm is the prototype for a class of Markov chain Monte Carlo methods that propose transitions between states and then accept or reject the proposal. These methods generate a correlated sequence of random…

Computational Physics · Physics 2011-05-12 Albert H. Mao , Rohit V. Pappu

High-quality random samples of quantum states are needed for a variety of tasks in quantum information and quantum computation. Searching the high-dimensional quantum state space for a global maximum of an objective function with many local…

Quantum Physics · Physics 2015-04-28 Jiangwei Shang , Yi-Lin Seah , Hui Khoon Ng , David John Nott , Berthold-Georg Englert

Boltzmann machines (BMs) are powerful energy-based generative models, but their heavy training cost has largely confined practical use to Restricted BMs (RBMs) trained with an efficient learning method called contrastive divergence. More…

Machine Learning · Computer Science 2025-12-03 Kentaro Kubo , Hayato Goto