Related papers: A Probabilistic Look at Conservative Growth-Fragme…
The computation of the probability of the first-passage time through a given threshold of a stochastic process is a classic problem that appears in many branches of physics. When the stochastic dynamics is markovian, the probability admits…
We show the variational convergence of an irreversible Markov jump process describing a finite stochastic particle system to the solution of a countable infinite system of deterministic time-inhomogeneous quadratic differential equations…
We derive the exact evolution equation for the probability density function of particle displacements generated by arbitrary Gaussian velocity processes, when neither Markovianity and nor stationarity are assumed. Starting from the…
Computational procedures for the stationary probability distribution, the group inverse of the Markovian kernel and the mean first passage times of an irreducible Markov chain, are developed using perturbations. The derivation of these…
We study closed systems of particles that are subject to stochastic forces in addition to the conservative forces. The stochastic equations of motion are set up in such a way that the energy is strictly conserved at all times. To ensure…
Order-preserving couplings are elegant tools for obtaining robust estimates of the time-dependent and stationary distributions of Markov processes that are too complex to be analyzed exactly. The starting point of this paper is to study…
The focus of this article is on entropy and Markov processes. We study the properties of functionals which are invariant with respect to monotonic transformations and analyze two invariant "additivity" properties: (i) existence of a…
We are interested in the long-time asymptotic behavior of growth-fragmentation equations with a nonlinear growth term. We present examples for which we can prove either the convergence to a steady state or conversely the existence of…
We study the evolution of probability distribution functions of returns, from the tick data of the Korean treasury bond (KTB) futures and the S$&$P 500 stock index, which can be described by means of the Fokker-Planck equation. We show that…
This article contains new tools for studying the shape of the stationary distribution of sizes in a dynamic economic system in which units experience random multiplicative shocks and are occasionally reset. Each unit has a Markov-switching…
We consider continuous--time Markov kinetics with a finite number of states and a given positive equilibrium distribution P*. For an arbitrary probability distribution $P$ we study the possible right hand sides, dP/dt, of the Kolmogorov…
Motivated by applications in systems biology, we seek a probabilistic framework based on Markov processes to represent intracellular processes. We review the formal relationships between different stochastic models referred to in the…
The goal of this paper is to analyze distributional Markov Decision Processes as a class of control problems in which the objective is to learn policies that steer the distribution of a cumulative reward toward a prescribed target law,…
In the context of Markov evolution, we present two original approaches to obtain Generalized Fluctuation-Dissipation Theorems (GFDT), by using the language of stochastic derivatives and by using a family of exponential martingales…
A general model of age-structured population dynamics is developed and the fundamental properties of its solutions are analyzed. The model is a semilinear partial differential equation with a nonlinear nonlocal boundary condition.…
We study convergence in variation of probability solutions of nonlinear Fokker-Planck-Kolmogorov equations to stationary solutions. We obtain sufficient conditions for the exponential convergence of solutions to the stationary solution in…
We consider Markov chains on partially ordered sets that generalize the success-runs and remaining life chains in reliability theory. We find conditions for recurrence and transience and give simple expressions for the invariant…
We study a class of Markov processes that combine local dynamics, arising from a fixed Markov process, with regenerations arising at a state-dependent rate. We give conditions under which such processes possess a given target distribution…
We consider a Markovian jumping process which is defined in terms of the jump-size distribution and the waiting-time distribution with a position-dependent frequency, in the diffusion limit. We assume the power-law form for the frequency.…
The purpose of this paper is to study a Markovian metapopulation model on a directed graph with edge-supported transfers and deterministic intra-nodal population dynamics. We first state tractable stability conditions for two typical…