Related papers: Dynamical equivalence classes for Markov jump proc…

Ancestral graphs can encode conditional independence relations that arise in directed acyclic graph (DAG) models with latent and selection variables. However, for any ancestral graph, there may be several other graphs to which it is Markov…

In causal inference on directed acyclic graphs, the orientation of edges is in general only recovered up to Markov equivalence classes. We study Markov equivalence classes of uniformly random directed acyclic graphs. Using a tower…

In modern life insurance, Markov processes in continuous time on a finite or at least countable state space have been over the years an important tool for the modelling of the states of an insured. Motivated by applications in disability…

In this note, we give an original convergence result for products of independent random elements of motion group. Then we consider dynamic random walks which are inhomogeneous Markov chains whose transition probability of each step is, in…

We derive a universal thermodynamic bound constraining directional transport in both discrete and continuous nonequilibrium systems. For continuous-time Markov jump processes and overdamped diffusions governed by Fokker--Planck equations,…

Speed limit for classical stochastic Markov processes with discrete states is studied. We find that a trade-off inequality exists between the speed of the state transformation and the entropy production. The dynamical activity determines…

We study a one-dimensional Markov modulated random walk with jumps. It is assumed that amplitudes of jumps as well as a chosen velocity regime are random and depend on a time spent by the process at a previous state of the underlying Markov…

We study the dynamics of an asymmetric simple exclusion process with open boundaries and local interactions using a pair approximation which generalizes the 2-node cluster mean field theory and the Markov chain approach to kinetics and…

We introduce a new random graph model motivated by biological questions relating to speciation. This random graph is defined as the stationary distribution of a Markov chain on the space of graphs on $\{1, \ldots, n\}$. The dynamics of this…

For controlled discrete-time stochastic processes we introduce a new class of dynamic risk measures, which we call process-based. Their main features are that they measure risk of processes that are functions of the history of a base…

We prove exponential decay of pair correlations for 1D stationary point processes when spacings satisfy a Markov condition, geometric ergodicity, and a condition on exponential moments. The conditions are phrased for stationary sequences of…

We study a Markov process with two components: the first component evolves according to one of finitely many underlying Markovian dynamics, with a choice of dynamics that changes at the jump times of the second component. The second…

We review the concept of dynamical ensembles in nonequilibrium statistical mechanics as specified from an action functional or Lagrangian on spacetime. There, under local detailed balance, the breaking of time-reversal invariance is…

Markov models are widely used to describe processes of stochastic dynamics. Here, we show that Markov models are a natural consequence of the dynamical principle of Maximum Caliber. First, we show that when there are different possible…

Piecewise-deterministic Markov processes form a general class of non-diffusion stochastic models that involve both deterministic trajectories and random jumps at random times. In this paper, we state a new characterization of the jump rate…

In the absence of acceleration, the velocity formula gives "distance travelled equals speed multiplied by time". For a broad class of Markov chains such as circulant Markov chains or random walk on complete graphs, we prove a probabilistic…

We compare the fluctuations in the velocity and in the fraction of time spent at a given position for minimal models of a passive and an active particle: an asymmetric random walker and a run-and-tumble particle in continuous time and on a…

This paper is concerned with stability analysis and synthesis for discrete-time linear systems with stochastic dynamics. Equivalence is first proved for three stability notions under some key assumptions on the randomness behind the…

We distinguish a mechanical representation of the world in terms of point masses with positions and momenta and the chemical representation of the world in terms of populations of different individuals, each with intrinsic stochasticity,…

In this paper, we consider the gradual-impulse control problem of continuous-time Markov decision processes, where the system performance is measured by the expectation of the exponential utility of the total cost. We prove, under very…