Related papers: Occupation densities in solving exit problems for …
In this paper, we consider a subshift of finite type with Markov measure. By considering a union of cylinders as holes, we investigate the exponential growth rate of measure of points whose orbits do not escape into the hole over a fixed…
The numerical solution of stochastic partial differential equations (SPDE) presents challenges not encountered in the simulation of PDEs or SDEs. Indeed, the roughness of the noise in conjunction with nonlinearities in the drift typically…
We consider the problem of estimating the scale matrix $\Sigma$ of the additif model $Y_{p\times n} = M + \mathcal{E}$, under a theoretical decision point of view. Here, $ p $ is the number of variables, $ n$ is the number of observations,…
The passivity index, a quantitative measure of a system's passivity deficiency or excess, has been widely used in stability analysis and control. Existing studies mostly rely on scalar forms of indices, which are restrictive for…
In this paper, we consider a Markov decision process (MDP) with a Borel state space $\textbf{X}\cup\{\Delta\}$, where $\Delta$ is an absorbing state (cemetery), and a Borel action space $\textbf{A}$. We consider the space of finite…
We study the relation between escape rates and pressure in general dynamical systems with holes, where pressure is defined to be the difference between entropy and the sum of positive Lyapunov exponents. Central to the discussion is the…
We consider off-policy evaluation (OPE) in Partially Observable Markov Decision Processes, where the evaluation policy depends only on observable variables but the behavior policy depends on latent states (Tennenholtz et al. (2020a)). Prior…
A spectral method is described for solving coupled elliptic problems on an interior and an exterior domain. The method is formulated and tested on the two-dimensional interior Poisson and exterior Laplace problems, whose solutions and their…
Under appropriate conditions, we obtain smoothness and convexity properties of $q$-scale functions for spectrally negative L\'evy processes. Our method appeals directly to very recent developments in the theory of potential analysis of…
We give an interpretation of the bilateral exit problem for L\'{e}vy processes via the study of an elementary Markov chain. We exhibit a strong connection between this problem and Krein's theory on strings. For instance, for symmetric…
We prove precise stability results for overshoots of Markov additive processes (MAPs) with finite modulating space. Our approach is based on the Markovian nature of overshoots of MAPs whose mixing and ergodic properties are investigated in…
We consider discrete-time Markov chains and study large deviations of the pair empirical occupation measure, which is useful to compute fluctuations of pure-additive and jump-type observables. We provide an exact expression for the…
Decomposition of large matrix inequalities for matrices with chordal sparsity graph has been recently used by Kojima et al.\ \cite{kim2011exploiting} to reduce problem size of large scale semidefinite optimization (SDO) problems and thus…
The estimation of absorption time distributions of Markov jump processes is an important task in various branches of statistics and applied probability. While the time-homogeneous case is classic, the time-inhomogeneous case has recently…
The availability of data sets with large numbers of variables is rapidly increasing. The effective application of Bayesian variable selection methods for regression with these data sets has proved difficult since available Markov chain…
We obtain an upper escape rate function for a continuous time minimal symmetric Markov chain, defined on a locally finite weighted graph. This upper rate function is given in terms of volume growth with respect to an adapted path metric and…
Asymptotic properties of Markov Processes, such as steady state probabilities or hazard rate for absorbing states can be efficiently calculated by means of linear algebra even for large-scale problems. This paper discusses the methods for…
Following from recent developments by Hubalek and Kyprianou, the objective of this paper is to provide further methods for constructing new families of scale functions for spectrally negative L\'evy processes which are completely explicit.…
We consider Vlasov-type scaling for Markov evolution of birth-and-death type in continuum, which is based on a proper scaling of corresponding Markov generators and has an algorithmic realization in terms of related hierarchical chains of…
Up to now, the nonparametric analysis of multidimensional continuous-time Markov processes has focussed strongly on specific model choices, mostly related to symmetry of the semigroup. While this approach allows to study the performance of…