Related papers: Stochastic derivatives and generalized h-transform…

Markov Chains with variable length are useful stochastic models for data compression that avoid the curse of dimensionality faced by that full Markov Chains. In this paper we introduce a Variable Length Markov Chain whose transition…

Introduced by Bean and O'Reilly (2014), a stochastic fluid-fluid process is a Markov processes $\{X_t, Y_t, \varphi_t\}_{t \geq 0}$, where the first fluid $X_t$ is driven by the Markov chain $\varphi_t$, and the second fluid $Y_t$ is driven…

Particle Markov Chain Monte Carlo methods are used to carry out inference in non-linear and non-Gaussian state space models, where the posterior density of the states is approximated using particles. Current approaches usually perform…

In his 2011 work, Maas has shown that the law of any time-reversible continuous-time Markov chain with finite state space evolves like a gradient flow of the relative entropy with respect to its stationary distribution. In this work we show…

The infinitesimal transition probability operator for a continuous-time discrete-state Markov process, $\mathcal{Q}$, can be decomposed into a symmetric and a skew-symmetric parts. As recently shown for the case of diffusion processes,…

In the field of Markov models for image generation, the main idea is to learn how non-trivial images are gradually destroyed by a trivial forward Markov dynamics over the large time window $[0,t]$ converging towards pure noise for $t \to +…

For discrete-time stochastic processes, there is a close connection between return/waiting times and entropy. Such a connection cannot be straightforwardly extended to the continuous-time setting. Contrarily to the discrete-time case one…

As is well known, the fundamental matrix $(I - P + e \pi)^{-1}$ plays an important role in the performance analysis of Markov systems, where $P$ is the transition probability matrix, $e$ is the column vector of ones, and $\pi$ is the row…

We present an efficient finite difference method for the computation of parameter sensitivities that is applicable to a wide class of continuous time Markov chain models. The estimator for the method is constructed by coupling the perturbed…

We consider a class of piecewise-deterministic Markov processes where the state evolves according to a linear dynamical system. This continuous time evolution is interspersed by discrete events that occur at random times and change (reset)…

Traditional thermodynamic trade-off relations usually apply to quantities that depend linearly on probability distributions. In contrast, many important information-theoretic measures, such as entropies, are nonlinear and therefore…

The purpose of this article is to lay the mathematical foundations of a well known numerical approach in computational statistical physics and molecular dynamics, namely the parallel replica dynamics introduced by A.F. Voter. The aim of the…

We consider additive functionals of Markov processes in continuous time with general (metric) state spaces. We derive concentration bounds for their exponential moments and moments of finite order. Applications include diffusions,…

Let $D\subset R^d$ be a bounded domain and denote by $\mathcal P(D)$ the space of probability measures on $D$. Let \begin{equation*} L=\frac12\nabla\cdot a\nabla +b\nabla \end{equation*} be a second order elliptic operator. Let…

K. It\^{o} characterised in \cite{ito} zero-mean stationary Gauss Markov-processes evolving on a class of infinite-dimensional spaces. In this work we extend the work of It\^{o} in the case of Hilbert spaces: Gauss-Markov families that are…

For an infinite system of particles arriving in and departing from a habitat $X$ -- a locally compact Polish space with a positive Radon measure $\chi$ -- a Markov process is constructed in an explicit way. Along with its location $x\in X$,…

This article describes an accurate procedure for computing the mean first passage times of a finite irreducible Markov chain and a Markov renewal process. The method is a refinement to the Kohlas, Zeit fur Oper Res, 30,197-207, (1986)…

We study a class of Markov processes with finite state space and continuous time that have product form stationary distributions. We obtain a number of examples that can generate conjectures for diffusions with inert drift.

Finding the correct encoding for a generic dynamical system's trajectory is a complicated task: the symbolic sequence needs to preserve the invariant properties from the system's trajectory. In theory, the solution to this problem is found…

We build on a previous statistical model for distributed systems and formulate it in a way that the deterministic and stochastic processes within the system are clearly separable. We show how internal fluctuations can be analysed in a…