English
Related papers

Related papers: Recurrence of Markov chain traces

200 papers

We start by introducing avoidance coupling of Markov chains, with an overview of existing results. We then introduce and motivate a new notion, uniform avoidance coupling. We show that the only Markovian avoidance coupling on a cycle is of…

Probability · Mathematics 2016-10-12 Ewa J. Infeld

This paper is a survey of various proofs of the so called {\em fundamental theorem of Markov chains}: every ergodic Markov chain has a unique positive stationary distribution and the chain attains this distribution in the limit independent…

Probability · Mathematics 2022-04-05 Somenath Biswas

It is shown that the path of a simple random walk on any graph, consisting of all vertices visited and edges crossed by the walk, is almost surely a recurrent subgraph.

Probability · Mathematics 2008-08-05 Itai Benjamini , Ori Gurel-Gurevich

The problem of efficiently sampling from a set of(undirected) graphs with a given degree sequence has many applications. One approach to this problem uses a simple Markov chain, which we call the switch chain, to perform the sampling. The…

Data Structures and Algorithms · Computer Science 2014-12-18 Catherine Greenhill

In the present paper we show that for any given digraph $\mathbb{G} =([n], \vec{E})$, i.e. an oriented graph without self-loops and 2-cycles, one can construct a 1-dependent Markov chain and $n$ identically distributed hitting times $T_1,…

Probability · Mathematics 2020-12-01 Emilio De Santis

Let T be an infinite homogenous tree of homogeneity $q+1$. Attaching to each edge the conductance $1$, the tree will became an electric network. The reversible Markov chain associated to this network is the simple random walk on the…

Probability · Mathematics 2010-07-28 Alice Vatamanelu

Markov chains are a class of probabilistic models that have achieved widespread application in the quantitative sciences. This is in part due to their versatility, but is compounded by the ease with which they can be probed analytically.…

Machine Learning · Computer Science 2023-12-18 Eddie Seabrook , Laurenz Wiskott

Consider a transient near-critical (1,2) random walk on the positive half line. We give a criteria for the finiteness of the number of the skipped points (the points never visited) by the random walk. This result generalizes (partially) the…

Probability · Mathematics 2017-07-21 Hua-Ming Wang

The approximate uniform sampling of graph realizations with a given degree sequence is an everyday task in several social science, computer science, engineering etc. projects. One approach is using Markov chains. The best available current…

Combinatorics · Mathematics 2024-01-09 Péter L. Erdős , Tamás Róbert Mezei , István Miklós

We study the recurrence/transience phase transition for Markov chains on $\mathbb{R}_+$, $\mathbb{R}$, and $\mathbb{R}^2$ whose increments have heavy tails with exponent in $(1,2)$ and asymptotically zero mean. This is the infinite-variance…

Probability · Mathematics 2019-06-24 Nicholas Georgiou , Mikhail V. Menshikov , Dimitri Petritis , Andrew R. Wade

Suppose X and Y are two independent irreducible Markov chains on n states. We consider the intersection time, which is the first time their trajectories intersect. We show for reversible and lazy chains that the total variation mixing time…

Probability · Mathematics 2014-12-30 Yuval Peres , Thomas Sauerwald , Perla Sousi , Alexandre Stauffer

We study a generalisation of the one-dimensional Rademacher random walk introduced in Bhattacharya and Volkov (2023) to $\mathbb{Z}^2$ (for $d\ge 3$, the Rademacher random walk is always transient, as follows from Theorem 8.8 in Englander…

Probability · Mathematics 2026-02-16 Satyaki Bhattacharya , Stanislav Volkov

We develop a criterion for transience for a general model of branching Markov chains. In the case of multi-dimensional branching random walk in random environment (BRWRE) this criterion becomes explicit. In particular, we show that…

Probability · Mathematics 2008-11-12 Sebastian Müller

Many applications in network analysis require algorithms to sample uniformly at random from the set of all graphs with a prescribed degree sequence. We present a Markov chain based approach which converges to the uniform distribution of all…

Discrete Mathematics · Computer Science 2010-03-05 Annabell Berger , Matthias Müller-Hannemann

We develop Markov chain mixing time estimates for a class of Markov chains with restricted transitions. We assume transitions may occur along a cycle of $n$ nodes and on $n^\gamma$ additional edges, where $\gamma < 1$. We find that the…

Probability · Mathematics 2015-06-26 Balázs Gerencsér

For i.i.d. random vectors $(M_{1},Q_{1}),(M_{2},Q_{2}),\ldots$ such that $M>0$ a.s., $Q\geq 0$ a.s. and $\mathbb{P}(Q=0)<1$, the random difference equation $X_{n}=M_{n}X_{n-1}+Q_{n}$, $n=1,2,\ldots$, is studied in the critical case when the…

Probability · Mathematics 2021-05-12 Gerold Alsmeyer , Alexander Iksanov

We fix $d \geq 2$ and denote $\mathcal S$ the semi-group of $d \times d$ matrices with non negative entries. We consider a sequence $(A_n, B_n)_{n \geq 1} $ of i. i. d. random variables with values in $\mathcal S\times \mathbb R_+^d$ and…

Probability · Mathematics 2020-03-23 Sara Brofferio , Marc Peigné , Thi Da Cam Pham

A one-dimensional confined Nonlinear Random Walk is a tuple of $N$ diffeomorphisms of the unit interval driven by a probabilistic Markov chain. For generic such walks, we obtain a geometric characterization of their ergodic stationary…

Dynamical Systems · Mathematics 2016-07-19 Victor Kleptsyn , Denis Volk

A $\phi$-irreducible and aperiodic Markov chain with stationary probability distribution will converge to its stationary distribution from almost all starting points. The property of Harris recurrence allows us to replace ``almost all'' by…

Probability · Mathematics 2007-05-23 Gareth O. Roberts , Jeffrey S. Rosenthal

Consider a probability measure on a Hilbert space defined via its density with respect to a Gaussian. The purpose of this paper is to demonstrate that an appropriately defined Markov chain, which is reversible with respect to the measure in…

Statistics Theory · Mathematics 2014-04-21 Natesh S. Pillai , Andrew M. Stuart , Alexandre H. Thiery