Related papers: Stochastic averaging for multiscale Markov process…
This PhD thesis deals with the Markov picture of developed turbulence from the theoretical point of view. The thesis consists of two parts. The first part introduces stochastic thermodynamics, the second part aims at transferring the…
Markov processes restarted or reset at random times to a fixed state or region in space have been actively studied recently in connection with random searches, foraging, and population dynamics. Here we study the large deviations of…
In this article, we consider McKean stochastic differential equations, as well as their corresponding McKean-Vlasov partial differential equations, which admit a unique stationary state, and we study the linearized It\^o diffusion process…
We introduce a general formulation of the fluctuation-dissipation relations (FDR) holding also in far-from-equilibrium stochastic dynamics. A great advantage of this version of the FDR is that it does not require the explicit knowledge of…
We construct a constant size population model allowing for general selective interactions and extreme reproductive events. It generalizes the idea of (Krone and Neuhauser 1997) who represented the selection by allowing individuals to sample…
For Markov chains and Markov processes exhibiting a form of stochastic monotonicity (larger states shift up transition probabilities in terms of stochastic dominance), stability and ergodicity results can be obtained using order-theoretic…
Stochastic Thermodynamics uses Markovian jump processes to model random transitions between observable mesoscopic states. Physical currents are obtained from anti-symmetric jump observables defined on the edges of the graph representing the…
We approximate stochastic processes in finite dimension by dynamical systems. We provide trajectorial estimates which are uniform with respect to the initial condition for a well chosen distance. This relies on some non-expansivity property…
The entropy rates of the Wright-Fisher process, the Moran process, and generalizations are computed and used to compare these processes and their dependence on standard evolutionary parameters. Entropy rates are measures of the variation…
Markov chains are fundamental models for stochastic dynamics, with applications in a wide range of areas such as population dynamics, queueing systems, reinforcement learning, and Monte Carlo methods. Estimating the transition matrix and…
We extend the work of Kurchan on the Gallavotti-Cohen fluctuation theorem, which yields a symmetry property of the large deviation function, to general Markov processes. These include jump processes describing the evolution of stochastic…
In the paper we consider a stochastic model which called Markov Q-processes that forms a continuous-time Markov population system. Markov Q-processes are defined as stochastic Markov branching processes with trajectories continuing in the…
The objective of this paper is to study the filtering problem for a system of partially observable processes $(X, Y)$, where $X$ is a non-Markovian pure-jump process representing the signal and $Y$ is a general jump-diffusion which provides…
We consider stochastic thermodynamics as a theory of statistical inference for experimentally observed fluctuating time-series. To that end, we introduce a general framework for quantifying the knowledge about the dynamical state of the…
The Integral Fluctuation Theorem for entropy production (IFT) is among the few equalities that are known to be valid for physical systems arbitrarily driven far from equilibrium. Microscopically, it can be understood as an inherent symmetry…
Markov automata combine non-determinism, probabilistic branching, and exponentially distributed delays. This compositional variant of continuous-time Markov decision processes is used in reliability engineering, performance evaluation and…
We prove under mild conditions that the Fleming-Viot process selects the minimal quasi-stationary distribution for Markov processes with soft killing on non-compact state spaces. Our results are applied to multi-dimensional birth and death…
We study ergodic properties of Markovian multiclass many-server queues which are uniform over scheduling policies, as well as the size n of the system. The system is heavily loaded in the Halfin-Whitt regime, and the scheduling policies are…
In this paper, we establish the law of the iterated logarithm for a wide class of non-stationary, continuous-time Markov processes evolving on Polish spaces. Specifically, our result applies to certain additive functionals of processes…
Based on some recent work of the author on stochastic approximation in non-markovian environments, the situation when the driving random process is non-ergodic in addition to being non-markovian is considered. Using this, we propose an…