English
Related papers

Related papers: Invariant Distributions in Nonlinear Markov Chains…

200 papers

The recent book by T. Piketty (Capital in the Twenty-First Century) promoted the important issue of wealth inequality. In the last twenty years, physicists and mathematicians developed models to derive the wealth distribution using discrete…

Probability · Mathematics 2021-07-19 Bertram Düring , Nicos Georgiou , Enrico Scalas

The expansion of global production networks has raised many important questions about the interdependence among countries and how future changes in the world economy are likely to affect the countries' positioning in global value chains. We…

General Economics · Economics 2020-05-20 Olivera Kostoska , Viktor Stojkoski , Ljupco Kocarev

We consider a continuous-time Markov chain (CTMC) whose state space is partitioned into aggregates, and each aggregate is assigned a probability measure. A sufficient condition for defining a CTMC over the aggregates is presented as a…

Discrete Mathematics · Computer Science 2013-03-21 Arnab Ganguly , Tatjana Petrov , Heinz Koeppl

The conventional perspective on Markov chains considers decision problems concerning the probabilities of temporal properties being satisfied by traces of visited states. However, consider the following query made of a stochastic system…

Logic in Computer Science · Computer Science 2024-06-24 Rajab Aghamov , Christel Baier , Toghrul Karimov , Joris Nieuwveld , Joël Ouaknine , Jakob Piribauer , Mihir Vahanwala

Stochastic processes with multiplicative noise have been studied independently in several different contexts over the past decades. We focus on the regime, found for a generic set of control parameters, in which stochastic processes with…

Statistical Mechanics · Physics 2015-06-25 D. Sornette

In this work, we characterise the statistics of Markov chains by constructing an associated sequence of periodic differential operators. Studying the density of states of these operators reveals the absolutely continuous invariant measure…

Dynamical Systems · Mathematics 2025-09-22 Bryn Davies , Angelica Yu Xiao

Markov chains are a class of probabilistic models that have achieved widespread application in the quantitative sciences. This is in part due to their versatility, but is compounded by the ease with which they can be probed analytically.…

Machine Learning · Computer Science 2023-12-18 Eddie Seabrook , Laurenz Wiskott

We study single commodity network flows with suitable robustness and efficiency specs. An original use of a maximum entropy problem for distributions on the paths of the graph turns this problem into a steering problem for Markov chains…

Mathematical Physics · Physics 2017-09-28 Yongxin Chen , Tryphon T. Georgiou , Michele Pavon , Allen Tannenbaum

We examine reaction networks (CRNs) through their associated continuous-time Markov processes. Studying the dynamics of such networks is in general hard, both analytically and by simulation. In particular, stationary distributions of…

Probability · Mathematics 2022-03-28 Linard Hoessly

Positive dependencies have been compared in the literature under rather strong assumptions such as equality of conditional distributions, exchangeability, or stationarity. We establish supermodular ordering results for distributions that…

Statistics Theory · Mathematics 2025-11-11 Jonathan Ansari , Moritz Ritter

We consider the problem of average consensus in a distributed system comprising a set of nodes that can exchange information among themselves. We focus on a class of algorithms for solving such a problem whereby each node maintains a state…

Multiagent Systems · Computer Science 2024-03-12 Christoforos N. Hadjicostis , Alejandro D. Dominguez-Garcia

A discrete time stochastic model for a multiagent system given in terms of a large collection of interacting Markov chains is studied. The evolution of the interacting particles is described through a time inhomogeneous transition…

Probability · Mathematics 2011-06-17 Amarjit Budhiraja , Pierre Del Moral , Sylvain Rubenthaler

We investigate nonequilibrium steady-state dynamics in both continuous- and discrete-state stochastic processes. Our analysis focuses on planar diffusion dynamics and their coarse-grained approximations by discrete-state Markov chains.…

Statistical Mechanics · Physics 2026-05-12 Ramón Nartallo-Kaluarachchi , Renaud Lambiotte , Alain Goriely

We study discrete time Markov processes with periodic or open boundary conditions and with inhomogeneous rates in the bulk. The Markov matrices are given by the inhomogeneous transfer matrices introduced previously to prove the…

Statistical Mechanics · Physics 2015-10-30 N. Crampe , K. Mallick , E. Ragoucy , M. Vanicat

We propose certain conditions which are sufficient for the functional law of the iterated logarithm (the Strassen invariance principle) for some general class of non-stationary Markov-Feller chains. This class may be briefly specified by…

Probability · Mathematics 2020-12-07 Dawid Czapla , Katarzyna Horbacz , Hanna Wojewódka-Ściążko

In this work, we are concerned with existence and uniqueness of invariant measures for path-dependent random diffusions and their time discretizations. The random diffusion here means a diffusion process living in a random environment…

Probability · Mathematics 2017-06-20 Jianhai Bao , Jinghai Shao , Chenggui Yuan

Markov chain Monte Carlo (MCMC) algorithms are based on the construction of a Markov chain with transition probabilities leaving invariant a probability distribution of interest. In this work, we look at these transition probabilities as…

Probability · Mathematics 2024-10-01 Rocco Caprio , Adam M. Johansen

We consider a branching model in discrete time where each individual has a trait in some general state space. Both the reproduction law and the trait inherited by the offsprings may depend on the trait of the mother and the environment. We…

Probability · Mathematics 2013-11-26 Vincent Bansaye

This paper consider a highly general dissemination model that keeps track of the stochastic evolution of the distribution of wealth over a set of agents. There are two types of events: (i) units of wealth externally arrive, and (ii) units…

Probability · Mathematics 2022-07-12 K. M. D. Chan , M. R. H. Mandjes

We establish sufficient conditions for exponential convergence to a unique quasi-stationary distribution in the total variation norm. These conditions also ensure the existence and exponential ergodicity of the Q-process, the process…

Probability · Mathematics 2023-08-01 Aurélien Velleret