中文
相关论文

相关论文: Minimax Mixing Time of the Metropolis-Adjusted Lan…

200 篇论文

We examine the behaviour of the pseudo-marginal random walk Metropolis algorithm, where evaluations of the target density for the accept/reject probability are estimated rather than computed precisely. Under relatively general conditions on…

统计计算 · 统计学 2014-12-31 Chris Sherlock , Alexandre H. Thiery , Gareth O. Roberts , Jeffrey S. Rosenthal

In this paper, we study the problem of sampling from log-concave distributions supported on convex, compact sets, with a particular focus on the randomized midpoint discretization of both vanilla and kinetic Langevin diffusions in this…

机器学习 · 统计学 2025-05-27 Yifeng Yu , Lu Yu

The multiple-try Metropolis (MTM) algorithm is an extension of the Metropolis-Hastings (MH) algorithm by selecting the proposed state among multiple trials according to some weight function. Although MTM has gained great popularity owing to…

统计方法学 · 统计学 2022-10-17 Hyunwoong Chang , Changwoo J. Lee , Zhao Tang Luo , Huiyan Sang , Quan Zhou

We introduce new Gaussian proposals to improve the efficiency of the standard Hastings-Metropolis algorithm in Markov chain Monte Carlo (MCMC) methods, used for the sampling from a target distribution in large dimension $d$. The improved…

For sampling from a log-concave density, we study implicit integrators resulting from $\theta$-method discretization of the overdamped Langevin diffusion stochastic differential equation. Theoretical and algorithmic properties of the…

机器学习 · 统计学 2021-07-13 Liam Hodgkinson , Robert Salomone , Fred Roosta

Markov chain Monte Carlo (MCMC) samplers are numerical methods for drawing samples from a given target probability distribution. We discuss one particular MCMC sampler, the MALA-within-Gibbs sampler, from the theoretical and practical…

统计计算 · 统计学 2020-03-19 X. T. Tong , M. Morzfeld , Y. M. Marzouk

A new (unadjusted) Langevin Monte Carlo (LMC) algorithm with improved rates in total variation and in Wasserstein distance is presented. All these are obtained in the context of sampling from a target distribution $\pi$ that has a density…

统计理论 · 数学 2019-10-18 Sotirios Sabanis , Ying Zhang

We propose an adaptive Metropolis-Hastings algorithm in which sampled data are used to update the proposal distribution. We use the samples found by the algorithm at a particular step to form the information-theoretically optimal mean-field…

其他凝聚态物理 · 物理学 2007-05-23 David H. Wolpert , Chiu Fan Lee

This paper investigates the computational and statistical limits in clustering matrix-valued observations. We propose a low-rank mixture model (LrMM), adapted from the classical Gaussian mixture model (GMM) to treat matrix-valued…

统计理论 · 数学 2023-06-08 Zhongyuan Lyu , Dong Xia

In the field of sampling algorithms, MCMC (Markov Chain Monte Carlo) methods are widely used when direct sampling is not possible. However, multimodality of target distributions often leads to slow convergence and mixing. One common…

机器学习 · 计算机科学 2023-04-05 Holden Lee , Zeyu Shen

Existing works on distributed consensus explore linear iterations based on reversible Markov chains, which contribute to the slow convergence of the algorithms. It has been observed that by overcoming the diffusive behavior of reversible…

信息论 · 计算机科学 2016-11-18 Wenjun Li , Yanbing Zhang , Huaiyu Dai

The Multi-Reference Alignment (MRA) problem aims at the recovery of an unknown signal from repeated observations under the latent action of a group of cyclic isometries, in the presence of additive noise of high intensity $\sigma$. It is a…

统计理论 · 数学 2023-12-14 Subhro Ghosh , Soumendu Sundar Mukherjee , Jing Bin Pan

In this paper, we study the problem of sampling from a given probability density function that is known to be smooth and strongly log-concave. We analyze several methods of approximate sampling based on discretizations of the (highly…

统计理论 · 数学 2024-02-26 Arnak S. Dalalyan , Avetik G. Karagulyan

New sampling algorithms based on simulating continuous-time stochastic processes called piece-wise deterministic Markov processes (PDMPs) have shown considerable promise. However, these methods can struggle to sample from multi-modal or…

统计方法学 · 统计学 2022-05-31 Matthew Sutton , Robert Salomone , Augustin Chevallier , Paul Fearnhead

The problem of sampling from the stationary distribution of a Markov chain finds widespread applications in a variety of fields. The time required for a Markov chain to converge to its stationary distribution is known as the classical…

量子物理 · 物理学 2022-09-14 Shantanav Chakraborty , Kyle Luh , Jérémie Roland

LoRa is a promising technology in the current Internet of Things market, which operates in un-licensed bands achieving long-range communications and with ultra power devices. In this work we capitalize on the idea introduced in [1], i.e.…

信号处理 · 电气工程与系统科学 2023-07-31 Francesca Cuomo , Manuel Campo , Enrico Bassetti , Lorenzo Cartella , Federica Sole , Giuseppe Bianchi

In this paper we study the ergodicity properties of some adaptive Markov chain Monte Carlo algorithms (MCMC) that have been recently proposed in the literature. We prove that under a set of verifiable conditions, ergodic averages calculated…

概率论 · 数学 2016-08-16 Christophe Andrieu , Éric Moulines

We study the adaptation properties of the multivariate log-concave maximum likelihood estimator over three subclasses of log-concave densities. The first consists of densities with polyhedral support whose logarithms are piecewise affine.…

Various Markov chain Monte Carlo (MCMC) methods are studied to improve upon random walk Metropolis sampling, for simulation from complex distributions. Examples include Metropolis-adjusted Langevin algorithms, Hamiltonian Monte Carlo, and…

统计计算 · 统计学 2020-05-19 Zexi Song , Zhiqiang Tan

Bayesian Additive Regression Trees (BART) is a popular Bayesian non-parametric regression algorithm. The posterior is a distribution over sums of decision trees, and predictions are made by averaging approximate samples from the posterior.…

机器学习 · 统计学 2022-10-19 Omer Ronen , Theo Saarinen , Yan Shuo Tan , James Duncan , Bin Yu