English
Related papers

Related papers: Concentration of measure and mixing for Markov cha…

200 papers

We present a novel approach to detecting and utilizing symmetries in probabilistic graphical models with two main contributions. First, we present a scalable approach to computing generating sets of permutation groups representing the…

Artificial Intelligence · Computer Science 2014-08-12 Mathias Niepert

We present a novel approach to detecting and utilizing symmetries in probabilistic graphical models with two main contributions. First, we present a scalable approach to computing generating sets of permutation groups representing the…

Artificial Intelligence · Computer Science 2012-06-29 Mathias Niepert

We investigate absorption, i.e., almost sure convergence to an absorbing state, in time-varying (non-homogeneous) discrete-time Markov chains with finite state space. We consider systems that can switch among a finite set of transition…

Systems and Control · Electrical Eng. & Systems 2020-08-18 Yasin Yazicioglu

We consider the irreducibility of switch-based Markov chains for the approximate uniform sampling of Hamiltonian cycles in a given undirected dense graph on $n$ vertices. As our main result, we show that every pair of Hamiltonian cycles in…

Combinatorics · Mathematics 2020-11-20 Pieter Kleer , Viresh Patel , Fabian Stroh

We prove an invariance principle for non-stationary random processes and establish a rate of convergence under a new type of mixing condition. The dependence is exponentially decaying in the gap between the past and the future and is…

Probability · Mathematics 2024-12-23 Ion Grama , Émile Le Page , Marc Peigné

Markov chain Monte Carlo algorithms are invaluable tools for exploring stationary properties of physical systems, especially in situations where direct sampling is unfeasible. Common implementations of Monte Carlo algorithms employ…

Statistical Mechanics · Physics 2016-04-27 Marija Vucelja

We study probability measures induced by set functions with constraints. Such measures arise in a variety of real-world settings, where prior knowledge, resource limitations, or other pragmatic considerations impose constraints. We consider…

Machine Learning · Statistics 2017-01-10 Chengtao Li , Stefanie Jegelka , Suvrit Sra

Focusing on stochastic systems arising in mean-field models, the systems under consideration belong to the class of switching diffusions, in which continuous dynamics and discrete events coexist and interact. The discrete events are modeled…

Probability · Mathematics 2019-01-18 Son L. Nguyen , George Yin , Tuan A. Hoang

The goal of this expository paper is to describe conditions which guarantee a central limit theorem for functionals of general state space Markov chains. This is done with a view towards Markov chain Monte Carlo settings and hence the focus…

Probability · Mathematics 2007-06-13 Galin L. Jones

We consider the Markov chain approximations for singular stable-like processes. First we obtain properties of some Markov chains. Then we construct the approximating Markov chains and give a necessary condition for weak convergence of these…

Probability · Mathematics 2012-10-11 Fangjun Xu

We propose a Markov chain simulation method to generate simple connected random graphs with a specified degree sequence and level of clustering. The networks generated by our algorithm are random in all other respects and can thus serve as…

Discrete Mathematics · Computer Science 2010-02-09 Shweta Bansal , Shashank Khandelwal , Lauren Ancel Meyers

Adaptive Markov chains are an important class of Monte Carlo methods for sampling from probability distributions. The time evolution of adaptive algorithms depends on past samples, and thus these algorithms are non-Markovian. Although there…

Probability · Mathematics 2014-10-02 Natesh S. Pillai , Aaron Smith

Questions are posed regarding the influence that the column sums of the transition probabilities of a stochastic matrix (with row sums all one) have on the stationary distribution, the mean first passage times and the Kemeny constant of the…

Probability · Mathematics 2014-03-05 Jeffrey J. Hunter

A family $\{Q_{\beta}\}_{\beta \geq 0}$ of Markov chains is said to exhibit $\textit{metastable mixing}$ with $\textit{modes}$ $S_{\beta}^{(1)},\ldots,S_{\beta}^{(k)}$ if its spectral gap (or some other mixing property) is very close to the…

Probability · Mathematics 2021-07-01 Oren Mangoubi , Natesh S. Pillai , Aaron Smith

There is a well-established theory linking certain semi-Markov chains and continuous-time random walks to time-fractional equations and anomalous diffusion. In this work, we go beyond the semi-Markov framework by considering some…

Probability · Mathematics 2026-02-27 Lorenzo Facciaroni , Costantino Ricciuti , Enrico Scalas

We investigate the problem of quantifying contraction coefficients of Markov transition kernels in Kantorovich ($L^1$ Wasserstein) distances. For diffusion processes, relatively precise quantitative bounds on contraction rates have recently…

Probability · Mathematics 2018-08-22 Andreas Eberle , Mateusz B. Majka

This paper is concerned with the study of the stability of dynamical systems evolving on time scales. We first {formalize the notion of matrix measures on time scales, prove some of their key properties and make use of this notion to study…

Dynamical Systems · Mathematics 2022-06-10 Giovanni Russo , Fabian Wirth

The paper is devoted to studies of perturbed Markov chains commonly used for description of information networks. In such models, the matrix of transition probabilities for the corresponding Markov chain is usually regularised by adding a…

Let $\gS=(V,E)$ be a finite, $d$-regular bipartite graph. For any $\lambda>0$ let $\pi_\lambda$ be the probability measure on the independent sets of $\gS$ in which the set $I$ is chosen with probability proportional to $\lambda^{|I|}$…

Combinatorics · Mathematics 2012-06-15 David Galvin , Prasad Tetali

We consider pairwise Markov random fields which have a number of important applications in statistical physics, image processing and machine learning such as Ising model and labeling problem to name a couple. Our own motivation comes from…

Discrete Mathematics · Computer Science 2016-11-29 Konstantin Avrachenkov , Lenar Iskhakov , Maksim Mironov