English
Related papers

Related papers: Learning a Restricted Boltzmann Machine using bias…

200 papers

Recently there have been exciting developments in Monte Carlo methods, with the development of new MCMC and sequential Monte Carlo (SMC) algorithms which are based on continuous-time, rather than discrete-time, Markov processes. This has…

Computation · Statistics 2020-09-29 Paul Fearnhead , Joris Bierkens , Murray Pollock , Gareth O Roberts

This paper proposes a synergy of amortised and particle-based methods for sampling from distributions defined by unnormalised density functions. We state a connection between sequential Monte Carlo (SMC) and neural sequential samplers…

Machine Learning · Computer Science 2025-10-14 Sanghyeok Choi , Sarthak Mittal , Víctor Elvira , Jinkyoo Park , Nikolay Malkin

In this paper we study asymptotic properties of different data-augmentation-type Markov chain Monte Carlo algorithms sampling from mixture models comprising discrete as well as continuous random variables. Of particular interest to us is…

Computation · Statistics 2014-04-04 Randal Douc , Florian Maire , Jimmy Olsson

Optimizing or sampling complex cost functions of combinatorial optimization problems is a longstanding challenge across disciplines and applications. When employing family of conventional algorithms based on Markov Chain Monte Carlo (MCMC)…

Machine Learning · Computer Science 2025-08-15 Dmitrii Dobrynin , Masoud Mohseni , John Paul Strachan

Hamiltonian Monte Carlo (HMC) is widely used for sampling from high dimensional target distributions with densities known up to proportionality. While HMC exhibits favorable scaling properties in high dimensions, it struggles with strongly…

Computation · Statistics 2025-07-30 Joonha Park

In this article we propose a novel MCMC method based on deterministic transformations T: X x D --> X where X is the state-space and D is some set which may or may not be a subset of X. We refer to our new methodology as Transformation-based…

Computation · Statistics 2013-10-21 Somak Dutta , Sourabh Bhattacharya

The availability of data sets with large numbers of variables is rapidly increasing. The effective application of Bayesian variable selection methods for regression with these data sets has proved difficult since available Markov chain…

Computation · Statistics 2019-05-08 Jim Griffin , Krys Latuszynski , Mark Steel

We propose a very fast approximate Markov Chain Monte Carlo (MCMC) sampling framework that is applicable to a large class of sparse Bayesian inference problems, where the computational cost per iteration in several models is of order…

Computation · Statistics 2021-08-17 Yves Atchadé , Liwei Wang

We introduce a new class of sequential Monte Carlo methods which reformulates the essence of the nested sampling method of Skilling (2006) in terms of sequential Monte Carlo techniques. Two new algorithms are proposed, nested sampling via…

We investigate the performance of machine learning algorithms trained exclusively with configurations obtained from importance sampling Monte Carlo simulations of the two-dimensional Ising model with conserved magnetization. For supervised…

Statistical Mechanics · Physics 2021-03-19 Ahmadreza Azizi , Michel Pleimling

We introduce an approach for efficient Markov chain Monte Carlo (MCMC) sampling for challenging high-dimensional distributions in sparse Bayesian learning (SBL). The core innovation involves using hierarchical prior-normalizing transport…

Numerical Analysis · Mathematics 2025-05-30 Jan Glaubitz , Youssef Marzouk

When combined with highly expressive ansatz functions such as neural quantum states, variational Monte Carlo (VMC) constitutes a versatile numerical approach to tackle the quantum many-body problem in and out of equilibrium. However, its…

Quantum Physics · Physics 2026-05-06 Wladislaw Krinitsin , Markus Schmitt

RBM-MPC is a computationally efficient variant of Model Predictive Control (MPC) in which the Random Batch Method (RBM) is used to speed up the finite-horizon optimal control problems at each iteration. In this paper, stability and…

Optimization and Control · Mathematics 2024-03-08 Daniël Veldman , Alexandra Borkowski , Enrique Zuazua

In statistical analysis, Monte Carlo (MC) stands as a classical numerical integration method. When encountering challenging sample problem, Markov chain Monte Carlo (MCMC) is a commonly employed method. However, the MCMC estimator is biased…

Numerical Analysis · Mathematics 2024-11-05 Jiarui Du , Zhijian He

We discuss a Monte Carlo Markov Chain (MCMC) procedure for the random sampling of some one-dimensional lattice paths with constraints, for various constraints. We show that an approach inspired by optimal transport allows us to bound…

Probability · Mathematics 2010-07-28 Lucas Gerin

Sampling from distributions play a crucial role in aiding practitioners with statistical inference. However, in numerous situations, obtaining exact samples from complex distributions is infeasible. Consequently, researchers often turn to…

Computation · Statistics 2024-04-01 Riddhiman Bhattacharya , Tiefeng Jiang

Langevin Monte Carlo (LMC) is an iterative algorithm used to generate samples from a distribution that is known only up to a normalizing constant. The nonasymptotic dependence of its mixing time on the dimension and target accuracy is…

Machine Learning · Statistics 2020-02-26 Niladri S. Chatterji , Jelena Diakonikolas , Michael I. Jordan , Peter L. Bartlett

Variational Monte Carlo (VMC) is a powerful and fast-growing method for optimizing and evolving parameterized many-body wave functions, especially with modern neural-network quantum states. In practice, however, the stochastic estimators…

Strongly Correlated Electrons · Physics 2026-03-20 Zhou-Quan Wan , Roeland Wiersema , Shiwei Zhang

Efficient sampling of complex high-dimensional probability distributions is a central task in computational science. Machine learning methods like autoregressive neural networks, used with Markov chain Monte Carlo sampling, provide good…

Statistical Mechanics · Physics 2021-11-11 Dian Wu , Riccardo Rossi , Giuseppe Carleo

We consider adaptive increasingly rare Markov chain Monte Carlo (MCMC) algorithms, which are adaptive MCMC methods, where the adaptation concerning the "past'' happens less and less frequently over time. Under a contraction assumption with…

Numerical Analysis · Mathematics 2026-02-24 Julian Hofstadler , Krzysztof Latuszynski , Gareth O. Roberts , Daniel Rudolf