English
Related papers

Related papers: Fast Mixing Markov Chains for Strongly Rayleigh Me…

200 papers

Delayed-acceptance Markov chain Monte Carlo (DA-MCMC) samples from a probability distribution via a two-stages version of the Metropolis-Hastings algorithm, by combining the target distribution with a "surrogate" (i.e. an approximate and…

We give conditions under which a Markov chain constructed via parallel or simulated tempering is guaranteed to be rapidly mixing, which are applicable to a wide range of multimodal distributions arising in Bayesian statistical inference and…

Probability · Mathematics 2009-06-15 Dawn B. Woodard , Scott C. Schmidler , Mark Huber

Computing optimal conditional reachability probabilities in Markov decision processes (MDPs) is tractable by a reduction to reachability probabilities. Yet, this reduction yields cyclic, challenging MDPs that are often notoriously hard to…

Logic in Computer Science · Computer Science 2026-05-14 Milan Češka , Sebastian Junges , Luko van der Maas , Filip Macák , Tim Quatmann

This paper studies a Markov chain for phylogenetic reconstruction which uses a popular transition between tree topologies known as subtree pruning-and-regrafting (SPR). We analyze the Markov chain in the simpler setting that the generating…

Populations and Evolution · Quantitative Biology 2015-03-13 Daniel Stefankovic , Eric Vigoda

Markov chain Monte Carlo (MCMC) methods asymptotically sample from complex probability distributions. The pseudo-marginal MCMC framework only requires an unbiased estimator of the unnormalized probability distribution function to construct…

Computation · Statistics 2016-05-25 Iain Murray , Matthew M. Graham

Markov chain Monte Carlo (MCMC) is a sampling-based method for estimating features of probability distributions. MCMC methods produce a serially correlated, yet representative, sample from the desired distribution. As such it can be…

Computation · Statistics 2019-12-10 Dootika Vats , Nathan Robertson , James M Flegal , Galin L Jones

Training energy-based probabilistic models is confronted with apparently intractable sums, whose Monte Carlo estimation requires sampling from the estimated probability distribution in the inner loop of training. This can be approximately…

Machine Learning · Computer Science 2016-06-13 Taesup Kim , Yoshua Bengio

In this paper we consider parameter estimation for discretely observed diffusion processes. In particular, we focus on data that are observed at low frequency and methodology that can estimate parameters with uncertainty quantification.…

Computation · Statistics 2026-05-01 Jingning Yao , Ajay Jasra , Sheng Jiang

We consider mixture models where location parameters are a priori encouraged to be well separated. We explore a class of determinantal point process (DPP) mixture models, which provide the desired notion of separation or repulsion. Instead…

Methodology · Statistics 2017-05-16 Ilaria Bianchini , Alessandra Guglielmi , Fernando A. Quintana

Given a fixed $n\times d$ matrix $\mathbf{X}$, where $n\gg d$, we study the complexity of sampling from a distribution over all subsets of rows where the probability of a subset is proportional to the squared volume of the parallelepiped…

Machine Learning · Computer Science 2019-02-25 Michał Dereziński

Convergence analysis of Markov chain Monte Carlo methods in high-dimensional statistical applications is increasingly recognized. In this paper, we develop general mixing time bounds for Metropolis-Hastings algorithms on discrete spaces by…

Computation · Statistics 2025-07-29 Hyunwoong Chang , Quan Zhou

A joint degree matrix (JDM) specifies the number of connections between nodes of given degrees in a graph, for all degree pairs and uniquely determines the degree sequence of the graph. We consider the space of all balanced realizations of…

Combinatorics · Mathematics 2015-07-14 Péter L. Erdős , István Miklós , Zoltán Toroczkai

Accurate estimates of long-term risk probabilities and their gradients are critical for many stochastic safe control methods. However, computing such risk probabilities in real-time and in unseen or changing environments is challenging.…

Systems and Control · Electrical Eng. & Systems 2024-08-20 Zhuoyuan Wang , Yorie Nakahira

This article provides the first procedure for computing a fully data-dependent interval that traps the mixing time $t_{\text{mix}}$ of a finite reversible ergodic Markov chain at a prescribed confidence level. The interval is computed from…

Machine Learning · Computer Science 2015-11-04 Daniel Hsu , Aryeh Kontorovich , Csaba Szepesvári

We present a novel Bayesian inference tool that uses a neural network to parameterise efficient Markov Chain Monte-Carlo (MCMC) proposals. The target distribution is first transformed into a diagonal, unit variance Gaussian by a series of…

Cosmology and Nongalactic Astrophysics · Physics 2020-06-03 Adam Moss

In finite mixture models, apart from underlying mixing measure, true kernel density function of each subpopulation in the data is, in many scenarios, unknown. Perhaps the most popular approach is to choose some kernel functions that we…

Statistics Theory · Mathematics 2017-09-26 Nhat Ho , XuanLong Nguyen , Ya'acov Ritov

Markov chain Monte Carlo (MCMC) methods generate samples that are asymptotically distributed from a target distribution of interest as the number of iterations goes to infinity. Various theoretical results provide upper bounds on the…

Computation · Statistics 2019-10-30 Niloy Biswas , Pierre E. Jacob , Paul Vanetti

We study the mixing time of two popular discrete-time Markov chains in continuous space, the Unadjusted Langevin Algorithm and the Proximal Sampler, which are discretizations of the Langevin dynamics. We extend mixing time analyses for…

Statistics Theory · Mathematics 2025-02-13 Siddharth Mitra , Andre Wibisono

Markov chains are one of the well-known tools for modeling and analyzing stochastic systems. At the same time, they are used for constructing random walks that can achieve a given stationary distribution. This paper is concerned with…

Information Theory · Computer Science 2025-01-07 Saber Jafarizadeh

Adaptive Markov chains are an important class of Monte Carlo methods for sampling from probability distributions. The time evolution of adaptive algorithms depends on past samples, and thus these algorithms are non-Markovian. Although there…

Probability · Mathematics 2014-10-02 Natesh S. Pillai , Aaron Smith
‹ Prev 1 8 9 10 Next ›