Related papers: On Function of Evolution of Distribution for Time …

We consider a nonequilibrium process on a timeline with discrete sites which evolves by a non-Markovian update rule in such a way that an active site at time t activates one or several sites in the future at time t+dt. The time intervals dt…

This paper is devoted to the study of propagation dynamics for a large class of non-monotone evolution systems. In two directions of the spatial variable, such a system has two limiting systems admitting the spatial translation invariance.…

This paper is devoted to the study of a stochastic process obtained by random switching between a finite collection of vector fields. Such processes have recently been the focus of much attention in the case where the switching times are…

The emergence of labor division in multi-agent system is analyzed by the method of statistical physics. Considering a system consists of N homogeneous agents. Their behaviors are determined by the returns from their production. Using the…

A block Markov chain is a Markov chain whose state space can be partitioned into a finite number of clusters such that the transition probabilities only depend on the clusters. Block Markov chains thus serve as a model for Markov chains…

We propose a novel measure valued process which models the behaviour of chemical reaction networks in spatially heterogeneous systems. It models reaction dynamics between different molecular species and continuous movement of molecules in…

We propose a unifying theoretical framework for the analysis of first-passage time distributions in two important classes of stochastic processes in which the diffusivity of a particle evolves randomly in time. In the first class of…

Phylogenetics uses alignments of molecular sequence data to learn about evolutionary trees relating species. Along branches, sequence evolution is modelled using a continuous-time Markov process characterised by an instantaneous rate…

This paper establishes a relation between scale-free networks and Markov chains, and proposes a computation framework for degree distributions of scale-free networks. We first find that, under the BA model, the degree evolution of…

In this paper, we abstract a kind of stochastic processes from evolving processes of growing networks, this process is called growing network Markov chains. Thus the existence and the formulas of degree distribution are transformed to the…

We consider Markov processes, which describe e.g. queueing network processes, in a random environment which influences the network by determining random breakdown of nodes, and the necessity of repair thereafter. Starting from an explicit…

In this work, we focus on the stationary analysis of a specific class of continuous time Markov-modulated reflected random walks in the quarter plane with applications in the modelling of two-node Markov-modulated queueing networks with…

By generating the specifics of a network structure only when needed (on-the-fly), we derive a simple stochastic process that exactly models the time evolution of susceptible-infectious dynamics on finite-size networks. The small number of…

For a Markovian dynamics on discrete states, the logarithmic ratio of waiting-time distributions between two successive, instantaneous transitions in forward and backward direction is a measure of time-irreversibility. It thus serves as an…

In this study, we consider sequences drawn from time-homogeneous Markov chains and introduce a novel approach for estimating first hitting-time distributions to specified terminal states. Our method- ology is based on the…

Markov Decision Processes (MDPs) have been used to formulate many decision-making problems in science and engineering. The objective is to synthesize the best decision (action selection) policies to maximize expected rewards (or minimize…

Many analyses of resource-allocation problems employ simplistic models of the population. Using the example of a resource-allocation problem of Marecek et al. [arXiv:1406.7639], we introduce rather a general behavioural model, where the…

Many of the biological, social and man-made networks around us are inherently dynamic, with their links switching on and off over time. The evolution of these networks is often non-Markovian, and the dynamics of their links correlated.…

Among the main actors of organism development there are morphogens, which are signaling molecules diffusing in the developing organism and acting on cells to produce local responses. Growth is thus determined by the distribution of such…

A novel class of non-reversible Markov chain Monte Carlo schemes relying on continuous-time piecewise-deterministic Markov Processes has recently emerged. In these algorithms, the state of the Markov process evolves according to a…