Related papers: Optimal prediction for positive self-similar Marko…
We consider a piecewise deterministic Markov decision process, where the expected exponential utility of total (nonnegative) cost is to be minimized. The cost rate, transition rate and post-jump distributions are under control. The state…
In this paper we discuss the question how to bound supremum of a stochastic process with the index set of a product type. There is a tempting idea to approach the question by the analysis of the process on each of the marginal index spaces…
We provide an alternative proof of the recent result by Park and Pham (2022) on the expected suprema of positive selector and empirical processes. We extend it to positive infinitely divisible processes.
In this paper we study the semi-global (approximate) state feedback stabilization of an infinite dimensional quantum stochastic system towards a target state. A discrete-time Markov chain on an infinite-dimensional Hilbert space is used to…
This paper explicitly computes the transition densities of a spectrally negative stable process with index greater than one, reflected at its infimum. First we derive the forward equation using the theory of sun-dual semigroups. The…
We consider the Markov chain approximations for singular stable-like processes. First we obtain properties of some Markov chains. Then we construct the approximating Markov chains and give a necessary condition for weak convergence of these…
Suppose $X$ is a Markov process on the real line (or some interval). Do the distributions of its first passage times downwards (fptd) determine its law? In this paper we treat some special cases of this question. We prove that if the fptd…
This paper is devoted to the problem of sample path large deviations for the Markov processes on R_+^N having a constant but different transition mechanism on each boundary set {x:x_i=0 for i\notin\Lambda, x_i>0 for i\in\Lambda}. The global…
The aim of this note is to give a straightforward proof of a general version of the Ciesielski-Taylor identity for positive self-similar Markov processes of the spectrally negative type which umbrellas all previously known Ciesielski-Taylor…
In the first part of this thesis, we study a Markov chain on $\mathbb{R}_+ \times S$, where $\mathbb{R}_+$ is the non-negative real numbers and $S$ is a finite set, in which when the $\mathbb{R}_+$-coordinate is large, the $S$-coordinate of…
In the L\'evy construction of Brownian motion, a Haar-derived basis of functions is used to form a finite-dimensional process $W^{N}$ and to define the Wiener process as the almost sure path-wise limit of $W^{N}$ when $N$ tends to infinity.…
We construct a family of self-similar Markov martingales with given marginal distributions. This construction uses the self-similarity and Markov property of a reference process to produce a family of Markov processes that possess the same…
In this work, we investigate the optimal control problem for continuous-time Markov decision processes with the random impact of the environment. We provide conditions to show the existence of optimal controls under finite-horizon criteria.…
When the number of particles is finite, the noncolliding Brownian motion (the Dyson model) and the noncolliding squared Bessel process are determinantal diffusion processes for any deterministic initial configuration $\xi=\sum_{j \in…
We show the existence of a broad class of affine Markov processes in the cone of positive self-adjoint Hilbert-Schmidt operators. Such processes are well-suited as infinite dimensional stochastic volatility models. The class of processes we…
In this paper, we consider a class of inhomogeneous semi-Markov processes directly based on intensity processes for marked point processes. We show that this class satisfies the semi-Markov properties defined elsewhere in the literature. We…
Given a field $\{B(x)\}_{x\in\mathbf{Z}^d}$ of independent standard Brownian motions, indexed by $\mathbf{Z}^d$, the generator of a suitable Markov process on $\mathbf{Z}^d,\,\,\mathcal{G},$ and sufficiently nice function…
We prove precise stability results for overshoots of Markov additive processes (MAPs) with finite modulating space. Our approach is based on the Markovian nature of overshoots of MAPs whose mixing and ergodic properties are investigated in…
We consider fragmentation processes with values in the space of marked partitions of $\mathbb{N}$, i.e. partitions where each block is decorated with a nonnegative real number. Assuming that the marks on distinct blocks evolve as…
We consider the following Markov Reachability decision problems that view Markov Chains as Linear Dynamical Systems: given a finite, rational Markov Chain, source and target states, and a rational threshold, does the probability of reaching…