Related papers: Some thoughts on multiparameter stochastic process…
Stochastic processes find applications in modelling systems in a variety of disciplines. A large number of stochastic models considered are Markovian in nature. It is often observed that higher order Markov processes can model the data…
Multi-type Markov point processes offer a flexible framework for modelling complex multi-type point patterns where it is pertinent to capture both interactions between points as well as large scale trends depending on observed covariates.…
We study a class of multi-stage stochastic programs, which incorporate modeling features from Markov decision processes (MDPs). This class includes structured MDPs with continuous action and state spaces. We extend policy graphs to include…
The stochastic properties of a Langevin-type Markov process can be extracted from a given time series by a Markov analysis. Also processes that obey a stochastically forced second order differential equation can be analyzed this way by…
We introduce multi-kangaroo Markov processes and provide a general procedure for evaluating a certain type of stochastic functionals. We calculate analytically the large deviation properties. Applications include zero-crossing statistics…
In the development of stochastic integration and the theory of semimartingales, Markov processes have been a constant source of inspiration. Despite this historical interweaving, it turned out that semimartingales should be considered the…
We study integrodifferential operators and regularity estimates for solutions to integrodifferential equations. Our emphasis is on kernels with a critically low singularity which does not allow for standard scaling. For example, we treat…
Stochastic processes on manifolds over non-Archimedean fields and with transition measures having values in the field $\bf C$ of complex numbers are defined and investigated. The analogs of Markov, Poisson and Wiener processes are studied.…
Markov processes are used in a wide range of disciplines, including finance. The transition densities of these processes are often unknown. However, the conditional characteristic functions are more likely to be available, especially for…
Piecewise Deterministic Markov Processes (PDMPs) are studied in a general framework. First, different constructions are proven to be equivalent. Second, we introduce a coupling between two PDMPs following the same differential flow which…
Pseudo-differential operator equations with parameter are studied. Uniform separability properties and resolvent estimates are obtained in terms of fractional derivatives. Moreover, maximal regularity properties of the pseudo-differential…
We introduce Markov Neural Processes (MNPs), a new class of Stochastic Processes (SPs) which are constructed by stacking sequences of neural parameterised Markov transition operators in function space. We prove that these Markov transition…
In this paper pseudo-differential operators with negative definite symbols are used to construct time- and space-inhomogeneous Markov processes. This is achieved by using the Markov evolution system associated with the fundamental solution…
Stochastic processes on topological vector spaces over non-Archimedean fields and with transition measures having values in non-Archimedean fields are defined and investigated. For this the non-Archimedean analog of the Kolmogorov theorem…
In this paper we study a family of nonlinear (conditional) expectations that can be understood as a stochastic process with uncertain parameters. We develop a general framework which can be seen as a version of the martingale problem method…
Markov decision processes (MDPs) are a popular model for performance analysis and optimization of stochastic systems. The parameters of stochastic behavior of MDPs are estimates from empirical observations of a system; their values are not…
For a series of Markov processes we prove stochastic duality relations with duality functions given by orthogonal polynomials. This means that expectations with respect to the original process (which evolves the variable of the orthogonal…
Markov automata combine non-determinism, probabilistic branching, and exponentially distributed delays. This compositional variant of continuous-time Markov decision processes is used in reliability engineering, performance evaluation and…
This paper focuses on time-varying delayed stochastic differential systems with stochastically switching parameters formulated by a unified switching behavior combining a discrete adapted process and a Cox process. Unlike prior studies…
A hidden Markov process is a well known concept in information theory and is used for a vast range of applications such as speech recognition and error correction. We bridge between two disciplines, experimental physics and advanced…