Related papers: Markov additive friendships
The Wiener-Hopf equations are a Toeplitz system of linear equations that naturally arise in several applications in time series. These include the update and prediction step of the stationary Kalman filter equations and the prediction of…
Certain Markov processes, or deterministic evolution equations, have the property that they are dual to a stochastic process that exhibits extinction versus unbounded growth, i.e., the total mass in such a process either becomes zero, or…
We consider the convergence of a continuous-time Markov chain approximation X^h, h>0, to an R^d-valued Levy process X. The state space of X^h is an equidistant lattice and its Q-matrix is chosen to approximate the generator of X. In…
Up to now, the nonparametric analysis of multidimensional continuous-time Markov processes has focussed strongly on specific model choices, mostly related to symmetry of the semigroup. While this approach allows to study the performance of…
Here we propose a different perspective of the deep factorisation in Kyprianou (2015) based on determining potentials. Indeed, we factorise the inverse of the MAP-exponent associated to a stable process via the Lamperti-Kiu transform. Here…
By studying an admissible family of branching mechanisms introduced in Li (2014), we obtain a pruning procedure on L\'evy trees. Then we could construct a decreasing L\'evy-CRT-valued process $\{{\mathcal T}_t\}$ by pruning L\'evy trees and…
We consider the following Markovian dynamic on point processes: at constant rate and with equal probability, either the rightmost atom of the current configuration is removed, or a new atom is added at a random distance from the rightmost…
In this paper we show that a non-local operator of certain type extends to the generator of a strong Markov process, admitting the transition probability density. For this transition probability density we construct the intrinsic upper and…
The Wiener-Hopf factorization is obtained in closed form for a phase type approximation to the CGMY L\'{e}vy process. This allows, for the approximation, exact computation of first passage times to barrier levels via Laplace transform…
We consider additive functionals of Markov processes in continuous time with general (metric) state spaces. We derive concentration bounds for their exponential moments and moments of finite order. Applications include diffusions,…
We review some developments concerning Markov and Feller processes with jumps in geometric settings. These include stochastic differential equations in Markus canonical form, the Courr\`{e}ge theorem on Lie groups, and invariant Markov…
For topologically mixing locally conformal semigroup actions generated by a finite collection of $C^{1+\alpha}$ conformal local diffeomorphisms, we provide a countable Markov partition satisfying the finite images and the finite cycle…
In this paper we consider an additive functional of an observable $V(x)$ of a Markov jump process. We assume that the law of the expected jump time $t(x)$ under the invariant probability measure $\pi$ of the skeleton chain belongs to the…
Let $f$ be the density function associated to a matrix-exponential distribution of parameters $(\alpha, T,s)$. By exponentially tilting $f$, we find a probabilistic interpretation which generalises the one associated to phase-type…
We introduce a novel approach to hierarchical reinforcement learning for Linearly-solvable Markov Decision Processes (LMDPs) in the infinite-horizon average-reward setting. Unlike previous work, our approach allows learning low-level and…
In this paper we develop a Malliavin-Skorohod type calculus for additive processes in the $L^0$ and $L^1$ settings, extending the probabilistic interpretation of the Malliavin-Skorohod operators to this context. We prove calculus rules and…
Variational inference is a popular technique to approximate a possibly intractable Bayesian posterior with a more tractable one. Recently, boosting variational inference has been proposed as a new paradigm to approximate the posterior by a…
We consider natural exponential families of Levy processes with randomized parameter. Such processes are Markov, and under suitable assumptions, pairs of such processes with shared randomization can be stitched together into a single…
This work introduces and studies a new family of velocity jump Markov processes directly amenable to exact simulation with the following two properties: i) trajectories converge in law when a time-step parameter vanishes towards a given…
Bayesian analysis for Markov jump processes is a non-trivial and challenging problem. Although exact inference is theoretically possible, it is computationally demanding thus its applicability is limited to a small class of problems. In…