Related papers: Occupation densities in solving exit problems for …
We develop several efficient algorithms for the classical \emph{Matrix Scaling} problem, which is used in many diverse areas, from preconditioning linear systems to approximation of the permanent. On an input $n\times n$ matrix $A$, this…
In this note we re-visit the fundamental question of the strong law of large numbers and central limit theorem for processes in continuous time with conditional stationary and independent increments. For convenience we refer to them as…
Countably infinite systems of linear ODEs arise as forward equations for many continuous-time Markov processes. The standard recipe -- truncate to a finite cap N and exponentiate -- pays cubic cost in N and a time-growing boundary-feedback…
We consider an absorbing Markov decision process with Borel state and action spaces. We study conditions under which the MDP is uniformly absorbing and the set of occupation measures of the MDP is compact in the usual weak topology. These…
Let $f$ be the density function associated to a matrix-exponential distribution of parameters $(\alpha, T,s)$. By exponentially tilting $f$, we find a probabilistic interpretation which generalises the one associated to phase-type…
The paper deals with a family of jump Markov process defined in a medium with a periodic or locally periodic microstructure. We assume that the generator of the process is a zero order convolution type operator with rapidly oscillating…
The scale functions were defined for spectrally negative L\'evy processes and other strong Markov processes with no positive jumps, and have been used to characterize their behavior. In particular, I defined the scale functions for standard…
In this paper we investigate several geometric properties of the set of occupancy measures. In particular, we analyse the structure of the faces generated by a given occupancy measure, together with their relative algebraic interior. We…
In this paper we find the Laplace transforms of the weighted occupation times for a spectrally negative L\'evy surplus process to spend below its running maximum up to the first exit times. The results are expressed in terms of generalized…
For a spectrally negative L\'evy process $X$, we study the following distribution: $$ \mathbb{E}_x \left[ \mathrm{e}^{- q \int_0^t \mathbf{1}_{(a,b)} (X_s) \mathrm{d}s } ; X_t \in \mathrm{d}y \right], $$ where $-\infty \leq a < b < \infty$,…
This paper concerns an optimal stopping problem driven by the running maximum of a spectrally negative Levy process X. More precisely, we are interested in capped versions of the American lookback optimal stopping problem, which has its…
We consider product of expansive Markov maps on an interval with hole which is conjugate to a subshift of finite type. For certain class of maps, it is known that the escape rate into a given hole does not just depend on its size but also…
We recall four open problems concerning constructing high-order matrix-exponential approximations for the infimum of a spectrally negative Levy process (with applications to first-passage/ruin probabilities, the waiting time distribution in…
In this paper, we develop a new mathematical technique which allows us to express the joint distribution of a Markov process and its running maximum (or minimum) through the marginal distribution of the process itself. This technique is an…
This article is a direct continuation of [1] where we begun the study of the transfer matrix spectral problem for the cyclic representations of the trigonometric 6-vertex reflection algebra associated to the Bazhanov-Stroganov Lax operator.…
We study the existence of densities for distributions of piecewise deterministic Markov processes. We also obtain relationships between invariant densities of the continuous time process and that of the process observed at jump times. In…
We consider a general multivariate affine stochastic recursion and the associated Markov chain on $\mathbb R^{d}$. We assume a natural geometric condition which implies existence of an unbounded stationary solution and we show that the…
In this paper, we study discrete-time absorbing Markov Decision Processes (MDP) with measurable state space and Borel action space with a given initial distribution. For such models, solutions to the characteristic equation that are not…
The concepts of probability, statistics and stochastic theory are being successfully used in structural engineering. Markov Chain modelling is a simple stochastic process model that has found its application in both describing stochastic…
Markov chains are a class of probabilistic models that have achieved widespread application in the quantitative sciences. This is in part due to their versatility, but is compounded by the ease with which they can be probed analytically.…