English
Related papers

Related papers: Asymptotically Optimal Exact Minibatch Metropolis-…

200 papers

The Markov chain Monte Carlo method (MCMC), especially the Metropolis-Hastings (MH) algorithm, is a widely used technique for sampling from a target probability distribution $P$ on a state space $\Omega$ and applied to various problems such…

Quantum Physics · Physics 2023-03-13 Koichi Miyamoto

Thresholding based iterative algorithms have the trade-off between effectiveness and optimality. Some are effective but involving sub-matrix inversions in every step of iterations. For systems of large sizes, such algorithms can be…

Information Theory · Computer Science 2017-11-08 Zhanjie Song , Shidong Li , Ningning Han

Optimal transport distances have become a classic tool to compare probability distributions and have found many applications in machine learning. Yet, despite recent algorithmic developments, their complexity prevents their direct use on…

Machine Learning · Statistics 2021-01-07 Kilian Fatras , Younes Zine , Szymon Majewski , Rémi Flamary , Rémi Gribonval , Nicolas Courty

Markov Chain Monte Carlo (MCMC) methods are employed to sample from a given distribution of interest, whenever either the distribution does not exist in closed form, or, if it does, no efficient method to simulate an independent sample from…

Computation · Statistics 2008-07-22 Ioana A. Cosma , Masoud Asgharian

Constantine et al. (2016) introduced a Metropolis-Hastings (MH) approach that target the active subspace of a posterior distribution: a linearly projected subspace that is informed by the likelihood. Schuster et al. (2017) refined this…

Methodology · Statistics 2025-01-10 Leonardo Ripoli , Richard G. Everitt

The Markov Chain Monte Carlo method is the dominant paradigm for posterior computation in Bayesian analysis. It is common to control computation time by making approximations to the Markov transition kernel. Comparatively little attention…

Computation · Statistics 2017-08-30 James E. Johndrow , Jonathan C. Mattingly , Sayan Mukherjee , David Dunson

Hamiltonian Monte Carlo (HMC) has been widely adopted in the statistics community because of its ability to sample high-dimensional distributions much more efficiently than other Metropolis-based methods. Despite this, HMC often performs…

Computation · Statistics 2019-11-19 Arya A. Pourzanjani , Linda R. Petzold

Subsampling is an important technique to tackle the computational challenges brought by big data. Many subsampling procedures fall within the framework of importance sampling, which assigns high sampling probabilities to the samples…

Machine Learning · Statistics 2022-03-07 Tieliang Gong , Yuxin Dong , Hong Chen , Bo Dong , Chen Li

This paper develops the use of Dirichlet forms to deliver proofs of optimal scaling results for Markov chain Monte Carlo algorithms (specifically, Metropolis-Hastings random walk samplers) under regularity conditions which are substantially…

Probability · Mathematics 2017-04-07 Giacomo Zanella , Wilfrid S. Kendall , Mylène Bédard

Pseudo-marginal Markov chain Monte Carlo methods for sampling from intractable distributions have gained recent interest and have been theoretically studied in considerable depth. Their main appeal is that they are exact, in the sense that…

Computation · Statistics 2015-03-25 Felipe J. Medina-Aguayo , Anthony Lee , Gareth O. Roberts

This short note is a self-contained and basic introduction to the Metropolis-Hastings algorithm, this ubiquitous tool used for producing dependent simulations from an arbitrary distribution. The document illustrates the principles of the…

Computation · Statistics 2016-01-28 Christian P. Robert

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo (MCMC) algorithm that avoids the random walk behavior and sensitivity to correlated parameters that plague many MCMC methods by taking a series of steps informed by first-order…

Computation · Statistics 2015-03-19 Matthew D. Hoffman , Andrew Gelman

Online prediction methods are typically presented as serial algorithms running on a single processor. However, in the age of web-scale prediction problems, it is increasingly common to encounter situations where a single processor cannot…

Machine Learning · Computer Science 2012-02-01 Ofer Dekel , Ran Gilad-Bachrach , Ohad Shamir , Lin Xiao

Markov Chain Monte Carlo (MCMC) algorithms are essential tools in computational statistics for sampling from unnormalised probability distributions, but can be fragile when targeting high-dimensional, multimodal, or complex target…

Mini-batch optimization has proven to be a powerful paradigm for large-scale learning. However, the state of the art parallel mini-batch algorithms assume synchronous operation or cyclic update orders. When worker nodes are heterogeneous…

Optimization and Control · Mathematics 2015-05-20 Hamid Reza Feyzmahdavian , Arda Aytekin , Mikael Johansson

The use of heuristics to assess the convergence and compress the output of Markov chain Monte Carlo can be sub-optimal in terms of the empirical approximations that are produced. Typically a number of the initial states are attributed to…

In this work, we propose a first-order sampling method called the Metropolis-adjusted Preconditioned Langevin Algorithm for approximate sampling from a target distribution whose support is a proper convex subset of $\mathbb{R}^{d}$. Our…

Computation · Statistics 2025-02-27 Vishwak Srinivasan , Andre Wibisono , Ashia Wilson

We study the optimal batch-regret tradeoff for batch linear contextual bandits. For any batch number $M$, number of actions $K$, time horizon $T$, and dimension $d$, we provide an algorithm and prove its regret guarantee, which, due to…

Machine Learning · Computer Science 2022-10-18 Zihan Zhang , Xiangyang Ji , Yuan Zhou

A Kernel Adaptive Metropolis-Hastings algorithm is introduced, for the purpose of sampling from a target distribution with strongly nonlinear support. The algorithm embeds the trajectory of the Markov chain into a reproducing kernel Hilbert…

Machine Learning · Statistics 2014-06-16 Dino Sejdinovic , Heiko Strathmann , Maria Lomeli Garcia , Christophe Andrieu , Arthur Gretton

We consider batch size selection for a general class of multivariate batch means variance estimators, which are computationally viable for high-dimensional Markov chain Monte Carlo simulations. We derive the asymptotic mean squared error…

Statistics Theory · Mathematics 2019-07-18 Ying Liu , Dootika Vats , James M. Flegal