Related papers: Submartingale Condition for Weak Convergence for S…
We consider the problem of finding the transition rates of a continuous-time homogeneous Markov chain under the empirical condition that the state changes at most once during a time interval of unit length. It is proven that this…
The martingale comparison method is extended to derive comparison results for path-independent functions for general semimartingales. Our approach allows to dismiss with the Markovian assumption on one of the processes made in previous…
For a strictly stationary sequence of $\mathbb{R}_{+}^{d}$--valued random vectors we derive functional convergence of partial maxima stochastic processes under joint regular variation and weak dependence conditions. The limit process is an…
The problem of constrained Markov decision process is considered. An agent aims to maximize the expected accumulated discounted reward subject to multiple constraints on its costs (the number of constraints is relatively small). A new dual…
Deciding in an efficient way weak probabilistic bisimulation in the context of Probabilistic Automata is an open problem for about a decade. In this work we close this problem by proposing a procedure that checks in polynomial time the…
Semi-Markov processes are a generalization of Markov processes since the exponential distribution of time intervals is replaced with an arbitrary distribution. This paper provides an integro-differential form of the Kolmogorov's backward…
This paper explores the well known approximation approach to decide weak bisimilarity of Basic Parallel Processes. We look into how different refinement functions can be used to prove weak bisimilarity decidable for certain subclasses. We…
A convergence theorem for martingales with c\`adl\`ag trajectories (right continuous with left limits everywhere) is obtained in the sense of the weak dual topology on Hilbert space, under conditions that are much weaker than those required…
By using Lyapunov conditions, weak Poincar\'e inequalities are established for some probability measures on a manifold $(M,g)$. These results are further applied to the convolution of two probability measures on $\R^d$. Along with explicit…
We introduce a general algorithm for the computation of the scale functions of a spectrally negative L\'evy process $X$, based on a natural weak approximation of $X$ via upwards skip-free continuous-time Markov chains with stationary…
Motivated by entropic optimal transport, time reversal of diffusion processes is revisited. An integration by parts formula is derived for the carr\'e du champ of a Markov process in an abstract space. It leads to a time reversal formula…
We are interested in the rate of convergence of a subordinate Markov process to its invariant measure. Given a subordinator and the corresponding Bernstein function (Laplace exponent) we characterize the convergence rate of the subordinate…
In the paper, we study a new rate of convergence estimate for homogeneous discrete-time nonlinear Markov chains based on the Markov-Dobrushin condition. This result generalizes the convergence estimates for any positive number of transition…
We give a substitute to Feller property for semigroups of time-changed processes; under some conditions this leads to establish sufficient (new) conditions for the semigroups to be Feller. Moreover, given a standard process and a sequence…
A common statistical task lies in showing asymptotic normality of certain statistics. In many of these situations, classical textbook results on weak convergence theory suffice for the problem at hand. However, there are quite some…
In this paper, we consider the discounted continuous-time Markov decision process (CTMDP) with a lower bounding function. In this model, the negative part of each cost rate is bounded by the drift function, say $w$, whereas the positive…
A financial market model where agents trade using realistic combinations of buy-and-hold strategies is considered. Minimal assumptions are made on the discounted asset-price process - in particular, the semimartingale property is not…
A semi-Markov process method for obtaining general counting statistics for open quantum systems is extended to the scenario of resetting. The simultaneous presence of random resets and wave function collapses means that the quantum jump…
In this paper we investigate jump-diffusion processes in random environments which are given as the weak solutions to SDE's. We formulate conditions ensuring existence and uniqueness in law of solutions. We investigate Markov property. To…
This paper studies some analytical properties of weak solutions of 3D stochastic primitive equations with periodic boundary conditions. The martingale problem associated to this model is shown to have a family of solutions satisfying the…