Related papers: Qualitative properties of certain piecewise determ…
Random dynamical systems with countably many maps which admit countable Markov partitions on complete metric spaces such that the resulting Markov systems are uniformly continuous and contractive are considered. A non-degeneracy and a…
We study a one-dimensional exclusion process with a fixed jump length $I \ge 1$ in which a particle may advance or retreat $I$ sites provided all intermediate sites are vacant, with hopping rates of Arrhenius type depending on the local…
It is shown that piecewise deterministic dissipative quantum dynamics in a vector space with indefinite metric can lead to well defined, positive probabilities. The case of quantum jumps on the Poincar'e disk is studied in details,…
In this paper, we consider a class of inhomogeneous semi-Markov processes directly based on intensity processes for marked point processes. We show that this class satisfies the semi-Markov properties defined elsewhere in the literature. We…
The paper deals with a certain class of random evolutions. We develop a construction that yields an invariant measure for a continuous-time Markov process with random transitions. The approach is based on a particular way of constructing…
This article is concerned with stability analysis and stabilization of randomly switched nonlinear systems. These systems may be regarded as piecewise deterministic stochastic systems: the discrete switches are triggered by a stochastic…
We explore a class of hybrid (piecewise deterministic) systems characterized by a large number of individuals inhabiting an environment whose state is described by a set of continuous variables. We use analytical and numerical methods from…
We consider zero-range processes in ${\mathbb{Z}}^d$ with site dependent jump rates. The rate for a particle jump from site $x$ to $y$ in ${\mathbb{Z}}^d$ is given by $\lambda_xg(k)p(y-x)$, where $p(\cdot)$ is a probability in…
We propose a piecewise deterministic Markovian jump process in Hilbert space such that the covariance matrix of this stochastic process solves the thermodynamic quantum master equation. The proposed stochastic process is particularly simple…
In this paper, we investigate a nonparametric approach to provide a recursive estimator of the transition density of a non-stationary piecewise-deterministic Markov process, from only one observation of the path within a long time. In this…
We consider a class of discrete time Markov chains with state space [0,1] and the following dynamics. At each time step, first the direction of the next transition is chosen at random with probability depending on the current location. Then…
We review some developments concerning Markov and Feller processes with jumps in geometric settings. These include stochastic differential equations in Markus canonical form, the Courr\`{e}ge theorem on Lie groups, and invariant Markov…
In this paper, we study discrete-time absorbing Markov Decision Processes (MDP) with measurable state space and Borel action space with a given initial distribution. For such models, solutions to the characteristic equation that are not…
We study the problem of exponential mixing and large deviations for discrete-time Markov processes associated with a class of random dynamical systems. Under some dissipativity and regularisation hypotheses for the underlying deterministic…
Let $E$ be a finite set, $\{F^i\}_{i \in E}$ a family of vector fields on $\mathbb{R}^d$ leaving positively invariant a compact set $M$ and having a common zero $p \in M.$ We consider a piecewise deterministic Markov process $(X,I)$ on $M…
We consider a time inhomogeneous jump Markov process $X = (X_t)_t$ with state dependent jump intensity, taking values in $R^d . $ Its infinitesimal generator is given by \begin{multline*} L_t f (x) = \sum_{i=1}^d \frac{\partial f}{\partial…
We propose a numerical method to approximate the value function for the optimal stopping problem of a piecewise deterministic Markov process (PDMP). Our approach is based on quantization of the post jump location---inter-arrival time Markov…
We consider a class of continuous time Markov chains on a compact metric space that admit an invariant measure strictly positive on open sets together with absorbing states. We prove the joint large deviation principle for the empirical…
This article aims to investigate sufficient conditions for the stability of stochastic differential equations with a random structure, particularly in contexts involving the presence of concentration points. The proof of asymptotic…
We study systems of particles on a line which have a maximum, are locally finite and evolve with independent increments. ``Quasi-stationary states'' are defined as probability measures, on the \sigma-algebra generated by the gap variables,…