Related papers: An increment type set-indexed Markov property
In this paper the relations between independence preserving (IP) involutions and reversible Markov kernels are investigated. We introduce an involutive augmentation H = (f, g_f) of a measurable function f and relate the IP property of H to…
We give a necessary and sufficient condition for a homogeneous Markov process taking values in $\R^n$ to enjoy the time-inversion property of degree $\alpha$. The condition sets the shape for the semigroup densities of the process and…
Conditional independence and Markov properties are powerful tools allowing expression of multidimensional probability distributions by means of low-dimensional ones. As multidimensional possibilistic models have been studied for several…
Multi-type Markov point processes offer a flexible framework for modelling complex multi-type point patterns where it is pertinent to capture both interactions between points as well as large scale trends depending on observed covariates.…
We discuss a Markov jump process regarded as a variant of the CIR (Cox-Ingersoll-Ross) model and its infinite-dimensional extension. These models belong to a class of measure-valued branching processes with immigration, whose jump…
Monotone L\'evy processes with additive increments are defined and studied. It is shown that these processes have a natural Markov structure and their Markov transition semigroups are characterized using the monotone L\'evy-Khintchine…
In the paper we consider some piecewise deterministic Markov process whose continuous component evolves according to semiflows, which are switched at the jump times of a Poisson process. The associated Markov chain describes the states of…
Understanding the fluctuations by which phenomenological evolution equations with thermodynamic structure can be enhanced is the key to a general framework of nonequilibrium statistical mechanics. These fluctuations provide an idealized…
We revisit, in a self contained way, the Markov property on planar maps and decorated planar maps from three perspectives. First, we characterize the laws on these planar maps that satisfy both the Markov property and rerooting invariance,…
This work defines two classes of processes, that we term {\it tempered fractional multistable motion} and {\it tempered multifractional stable motion}. They are extensions of fractional multistable motion and multifractional stable motion,…
General purpose intelligent learning agents cycle through (complex,non-MDP) sequences of observations, actions, and rewards. On the other hand, reinforcement learning is well-developed for small finite state Markov Decision Processes…
We provide a systematic study of the notion of duality of Markov processes with respect to a function. We discuss the relation of this notion with duality with respect to a measure as studied in Markov process theory and potential theory…
Comparison results for Markov processes w.r.t. function class induced (integral) stochastic orders have a long history. The most general results so far for this problem have been obtained based on the theory of evolution systems on Banach…
We study two equivalent characterizations of the strong Feller property for a Markov process and of the associated sub-Markovian semigroup. One is described in terms of locally uniform absolute continuity, whereas the other uses local…
In this article almost semi-continuous processes with stationary independent increments on a finite irreducible Markov chain are considered. For these processes the components of matrix factorization identity are concretely defined. On the…
Markov processes are popular mathematical models, studied by theoreticians for their intriguing properties, and applied by practitioners for their flexible structure. With this book we teach how to model and analyze Markov processes. We…
Continuous-time Markov chains are mathematical models that are used to describe the state-evolution of dynamical systems under stochastic uncertainty, and have found widespread applications in various fields. In order to make these models…
In this paper we study a family of nonlinear (conditional) expectations that can be understood as a diffusion with uncertain local characteristics. Here, the differential characteristics are prescribed by a set-valued function. We establish…
We prove that the Markov operator associated to an iterated function system consisting of phi-max-contractions with probabilities has a unique invariant measure whose support is the attractor of the system.
We develop a model for credit rating migration that accounts for the impact of economic state fluctuations on default probabilities. The joint process for the economic state and the rating is modelled as a time-homogeneous Markov chain.…