Related papers: Random Switching between Vector Fields Having a Co…

We consider the recursive equation ``x(n+1)=A(n)x(n)'' where x(n+1) and x(n) are column vectors of size k and where A(n) is an irreducible random matrix of size k x k. The matrix-vector multiplication in the (max,+) algebra is defined by…

We introduce Mean Field Markov games with $N$ players, in which each individual in a large population interacts with other randomly selected players. The states and actions of each player in an interaction together determine the…

Motivated by some recent potential theoretic results on subordinate killed L\'evy processes in open subsets of the Euclidean space, we study processes in an open set $D\subset {\mathbb R}^d$ defined via Dirichlet forms with jump kernels of…

We study weak convergence of empirical processes of dependent data $(X_i)_{i\geq0}$, indexed by classes of functions. Our results are especially suitable for data arising from dynamical systems and Markov chains, where the central limit…

Markov models are widely used to describe processes of stochastic dynamics. Here, we show that Markov models are a natural consequence of the dynamical principle of Maximum Caliber. First, we show that when there are different possible…

We fix $d \geq 2$ and denote $\mathcal S$ the semi-group of $d \times d$ matrices with non negative entries. We consider a sequence $(A_n, B_n)_{n \geq 1} $ of i. i. d. random variables with values in $\mathcal S\times \mathbb R_+^d$ and…

We consider (max,+)-algebra products of random matrices, which arise from performance evaluation of acyclic fork-join queueing networks. A new algebraic technique to examine properties of the product and investigate its limiting behaviour…

We establish a local martingale $M$ associate with $f(X,Y)$ under some restrictions on $f$, where $Y$ is a process of bounded variation (on compact intervals) and either $X$ is a jump diffusion (a special case being a L\'evy process) or $X$…

We consider a general piecewise deterministic Markov process (PDMP) $X=\{X_t\}_{t\geqslant 0}$ with measure-valued generator $\mathcal{A}$, for which the conditional distribution function of the inter-occurrence time is not necessarily…

We present general results for the contact process by a method which applies to all transitive graphs of bounded degree, including graphs of exponential growth. The model's infection rates are varied through a control parameter, for which…

This paper deals with control of partially observable discrete-time stochastic systems. It introduces and studies Markov Decision Processes with Incomplete Information and with semi-uniform Feller transition probabilities. The important…

This paper considers a class of non-Markovian discrete-time random processes on a finite state space {1,...,d}. The transition probabilities at each time are influenced by the number of times each state has been visited and by a fixed a…

The largest Lyapunov exponent of an ergodic Hamiltonian system is the rate of exponential growth of the norm of a typical vector in the tangent space. For an N-particle Hamiltonian system, with a smooth Hamiltonian of the type p^2 + v(q),…

We study the Markov chain $x_{n+1}=ax_n+b_n$ on a finite field $\mathbb{F}_p$, where $a \in \mathbb{F}_p$ is fixed and $b_n$ are independent and identically distributed random variables in $\mathbb{F}_p$. Conditionally on the Riemann…

Let $\Psi_n$ be a product of $n$ independent, identically distributed random matrices $M$, with the properties that $\Psi_n$ is bounded in $n$, and that $M$ has a deterministic (constant) invariant vector. Assuming that the probability of…

We extend Hoeffding's lemma to general-state-space and not necessarily reversible Markov chains. Let $\{X_i\}_{i \ge 1}$ be a stationary Markov chain with invariant measure $\pi$ and absolute spectral gap $1-\lambda$, where $\lambda$ is…

We consider an epidemic SIS model described by a multitype birth-and-death process in a randomly switched environment. That is, the infection and cure rates of the process depend on the state of a finite Markov jump process (the…

We consider the maximum process of a random walk with additive independent noise in form of $\max_{i=1,\dots,n}(S_i+Y_i)$. The random walk may have dependent increments, but its sample path is assumed to converge weakly to a fractional…

We consider a general class of Markovian models describing the growth in a randomly fluctuating environment of a clonal biological population having several phenotypes related by stochastic switching. Phenotypes differ e.g. by the level of…

We consider a continuous-time Bienaym\'e-Galton-Watson process with logistic competition in a regime of weak competition, or equivalently of a large carrying capacity. Individuals reproduce at random times independently of each other but…