English
Related papers

Related papers: Path decompositions for Markov chains

200 papers

We consider Markov chains on partially ordered sets that generalize the success-runs and remaining life chains in reliability theory. We find conditions for recurrence and transience and give simple expressions for the invariant…

Probability · Mathematics 2010-04-08 Kyle Siegrist

Random walks (or Markov chains) are models extensively used in theoretical computer science. Several tools, including analysis of quantities such as hitting and mixing times, are helpful for devising randomized algorithms. A notable example…

Quantum Physics · Physics 2023-07-12 Lorenzo Laneve , Francesco Tacchino , Ivano Tavernelli

We introduce "book links" as a generalization of braids in open book decompositions; this new class of objects includes both braids and plats as special cases. We then prove a version of Markov's theorem in this general setting by extending…

Geometric Topology · Mathematics 2024-11-18 Roman Aranda , Fraser Binns , Margaret Doig

We compare discrete-time quantum walks on graphs to their natural classical equivalents, which we argue are lifted Markov chains, that is, classical Markov chains with added memory. We show that these can simulate quantum walks, allowing us…

Quantum Physics · Physics 2018-09-26 Simon Apers , Alain Sarlette , Francesco Ticozzi

In the present paper, we consider a class of Markov processes on the discrete circle which has been introduced by K\"onig, O'Connell and Roch. These processes describe movements of exchangeable interacting particles and are discrete…

Probability · Mathematics 2026-01-01 Anna Ben-Hamou , Pierre Tarrago

We investigate quantum walks in multiple dimensions with different quantum coins. We augment the model by assuming that at each step the amplitudes of the coin state are multiplied by random phases. This model enables us to study in detail…

Quantum Physics · Physics 2009-11-13 Jozef Kosik , Vladimir Buzek , Mark Hillery

The depolarization channel is usually modelled as a quantum operation that destroys all input information, replacing it by a completely chaotic state. For qubits this has a quite intuitive interpretation as a shrinking of the Bloch sphere.…

Quantum Physics · Physics 2015-05-13 A. B. Klimov , L. L. Sanchez-Soto

We prove pathwise large-deviation principles of switching Markov processes by exploiting the connection to associated Hamilton-Jacobi equations, following Jin Feng's and Thomas Kurtz's method. In the limit that we consider, we show how the…

Probability · Mathematics 2021-06-08 Mark A. Peletier , Mikola C. Schlottke

We are interested in path decompositions of a perturbed reflecting Brownian motion (PRBM) at the hitting times and at the minimum. Our study relies on the loop soups developed by Lawler and Werner [10] and Le Jan [13]-[14], in particular on…

Probability · Mathematics 2021-07-06 Elie Aïdékon , Yueyun Hu , Zhan Shi

We show how to construct a topological Markov map of the interval whose invariant probability measure is the stationary law of a given stochastic chain of infinite order. In particular we caracterize the maps corresponding to stochastic…

Probability · Mathematics 2015-06-05 Pierre Collet , Antonio Galves

We give an exact solution to the generalized Langevin equation of motion of a charged Brownian particle in a uniform magnetic field that is driven internally by an exponentially-correlated stochastic force. A strong dissipation regime is…

Statistical Mechanics · Physics 2008-02-13 Francis N. C. Paraan , Mikhail P. Solon , J. P. Esguerra

A classical approach for the analysis of the longtime behavior of Markov processes is to consider suitable Lyapunov functionals like the variance or more generally $\Phi$-entropies. Via purely analytic arguments it can be shown that these…

Probability · Mathematics 2023-07-26 Benedikt Jahnel , Jonas Köppl

We perform, with the help of cloud computing resources, extensive Langevin simulations which provide compelling evidence in favor of a general markovian framework for unbiased polymer translocation. Our statistical analysis consists of…

Statistical Mechanics · Physics 2015-06-04 Felipe Mondaini , L. Moriconi

We consider the irreducibility of switch-based Markov chains for the approximate uniform sampling of Hamiltonian cycles in a given undirected dense graph on $n$ vertices. As our main result, we show that every pair of Hamiltonian cycles in…

Combinatorics · Mathematics 2020-11-20 Pieter Kleer , Viresh Patel , Fabian Stroh

We present a novel method for computing reachability probabilities of parametric discrete-time Markov chains whose transition probabilities are fractions of polynomials over a set of parameters. Our algorithm is based on two key…

Software Engineering · Computer Science 2014-03-28 Nils Jansen , Florian Corzilius , Matthias Volk , Ralf Wimmer , Erika Ábrahám , Joost-Pieter Katoen , Bernd Becker

In this note, we give an original convergence result for products of independent random elements of motion group. Then we consider dynamic random walks which are inhomogeneous Markov chains whose transition probability of each step is, in…

Probability · Mathematics 2010-03-04 C. R. E. Raja , R. Schott

We prove the existence of limiting distributions for a large class of Markov chains on a general state space in a random environment. We assume suitable versions of the standard drift and minorization conditions. In particular, the system…

Probability · Mathematics 2020-12-04 Attila Lovas , Miklós Rásonyi

We consider the orthogonalisation of the signature of a stochastic process as the analogue of orthogonal polynomials on path-space. Under an infinite radius of convergence assumption, we prove density of linear functions on the signature in…

Probability · Mathematics 2026-02-24 Ilya Chevyrev , Emilio Ferrucci , Darrick Lee , Terry Lyons , Harald Oberhauser , Nikolas Tapia

We consider additive functionals of stationary Markov processes and show that under Kipnis-Varadhan type conditions they converge in rough path topology to a Stratonovich Brownian motion, with a correction to the Levy area that can be…

Probability · Mathematics 2019-12-23 Jean-Dominique Deuschel , Tal Orenshtein , Nicolas Perkowski

We prove a functional limit theorem for Markov chains that, in each step, move up or down by a possibly state dependent constant with probability $1/2$, respectively. The theorem entails that the law of every one-dimensional regular…

Probability · Mathematics 2020-05-13 Stefan Ankirchner , Thomas Kruse , Mikhail Urusov