English
Related papers

Related papers: Path decompositions for Markov chains

200 papers

The main goal of the paper is to develop an estimate for the conditional probability function of random stationary ergodic symbolic sequences with elements belonging to a finite alphabet. We elaborate a decomposition procedure for the…

Data Analysis, Statistics and Probability · Physics 2017-08-09 S. S. Melnik , O. V. Usatenko

We present a detailed study of a simple quantum stochastic process, the quantum phase space Brownian motion, which we obtain as the Markovian limit of a simple model of open quantum system. We show that this physical description of the…

Mathematical Physics · Physics 2015-05-27 Michel Bauer , Denis Bernard

General characterizations of ergodic Markov chains have been developed in considerable detail. In this paper, we study the transience for discrete-time Markov chains on general state spaces, including the geometric transience and algebraic…

Probability · Mathematics 2013-01-08 Yong-Hua Mao , Yan-Hong Song

The main topic of these notes are Markov loops, studied in the context of continuous time Markov chains on discrete state spaces. We refer to [1] and [2] for the short "history" of the subject. In contrast with these references, symmetry is…

Probability · Mathematics 2014-02-06 Yinshan Chang , Yves Le Jan

We construct Poisson structures for Ermakov systems, using the Ermakov invariant as the Hamiltonian. Two classes of Poisson structures are obtained, one of them degenerate, in which case we derive the Casimir functions. In some situations,…

Mathematical Physics · Physics 2009-11-07 F. Haas

We describe generalized Brownian motion related to parabolic equation systems from a logical point of view, i.e., as a generalization of Anderson's random walk. The connection to classical spaces is based on the Loeb measure. It seems that…

Probability · Mathematics 2012-01-09 Joerg Kampen

The standard kinetic path integral for all spatially closed Brownian paths (loops) of duration t weighted by the product mn is evaluated, where m and n are the linking numbers of the Brownian loop with two arbitrary curves in 3D space. The…

Statistical Mechanics · Physics 2020-01-08 J. H. Hannay

We raise a question on whether a dynamical system driven by Markov process is Markovian, for which we are able to propose a criterion and examples of positive case. This investigation leads us to develop (i) a general construction of…

Probability · Mathematics 2019-08-22 Motoya Machida

We give a proof of a result on the growth of the number of particles along chosen paths in a branching Brownian motion. The work follows the approach of classical large deviations results, in which paths in $C[0,1]$ are rescaled onto…

Probability · Mathematics 2010-04-22 Simon Harris , Matthew Roberts

Aldous and Pitman (1994) studied asymptotic distributions, as n tends to infinity, of various functionals of a uniform random mapping of a set of n elements, by constructing a mapping-walk and showing these mapping-walks converge weakly to…

Probability · Mathematics 2007-05-23 David Aldous , Jim Pitman

We relate the combinatorics of periodic generalized Dyck and Motzkin paths to the cluster coefficients of particles obeying generalized exclusion statistics, and obtain explicit expressions for the counting of paths with a fixed number of…

Mathematical Physics · Physics 2022-10-17 Li Gan , Stéphane Ouvry , Alexios P. Polychronakos

We extend the conductance and canonical paths methods to the setting of general finite Markov chains, including non-reversible non-lazy walks. The new path method is used to show that a known bound for mixing time of a lazy walk on a Cayley…

Combinatorics · Mathematics 2019-02-20 Ravi Montenegro

We establish in this paper the existence of weak solutions of infinite-dimensional shift invariant stochastic differential equations driven by a Brownian term. The drift function is very general, in the sense that it is supposed to be…

Probability · Mathematics 2015-09-01 David Dereudre , Sylvie Roelly

We consider two types of discrete-time Markov chains where the state space is a graded poset and the transitions are taken along the covering relations in the poset. The first type of Markov chain goes only in one direction, either up or…

Probability · Mathematics 2016-08-06 Kimmo Eriksson , Markus Jonsson , Jonas Sjöstrand

In this article we study decreasing and increasing factorisations of the cycle, which are decompositions of the cycle $(1~2\dots n)$ into a product of $n-1$ transpositions satisfying monotonicity conditions. We explicit a bijection between…

Probability · Mathematics 2022-04-21 Etienne Bellin

In this paper, we study a class of quasi-invariant measures on paths generated by discrete dynamical systems. Our main result characterizes the subfamily of these measures which admit a certain desintegration. This is a desintegration with…

Classical Analysis and ODEs · Mathematics 2007-10-25 Dorin Ervin Dutkay , Palle E. T. Jorgensen

In a recent paper, Shah [arXiv:2502.03073] derived an explicit expression for the distribution of occupancy times for a two-state Markov chain, using a method based on enumerating sample paths. We consider here the more general problem of…

Probability · Mathematics 2025-04-01 Phil Pollett

For a stochastically monotone Markov chain taking values in a Polish space, we present a number of conditions for existence and for uniqueness of its stationary regime, as well as for closeness of its transient trajectories. In particular,…

Probability · Mathematics 2026-04-02 Sergey Foss , Michael Scheutzow

The paper deals with the problem of large-time behaviour of trajectories for discrete-time dynamical systems driven by a random noise. Assuming that the phase space is finite-dimensional and compact, and the noise is a Markov process with a…

Probability · Mathematics 2025-07-15 Sergei Kuksin , Armen Shirikyan

Brownian motion is a Gaussian process described by the central limit theorem. However, exponential decays of the positional probability density function $P(X,t)$ of packets of spreading random walkers, were observed in numerous situations…

Statistical Mechanics · Physics 2020-02-18 Eli Barkai , Stanislav Burov
‹ Prev 1 3 4 5 6 7 10 Next ›