Related papers: Semiflow selection and Markov selection theorems
We extend the Ruzhansky-Turunen theory of pseudo differential operators on compact Lie groups into a tool that can be used to investigate group-valued Markov processes in the spirit of the work in Euclidean spaces of N.Jacob and…
We consider a time inhomogeneous strong Markov process $(\xi_t)_{t\ge 0}$ taking values in a Polish state space whose semigroup has a $T$-periodic structure. We give simple conditions which imply ergodicity of the grid chain…
We prove existence of invariant measures for the Markovian semigroup generated by the solution to a parabolic semilinear stochastic PDE whose nonlinear drift term satisfies only a kind of symmetry condition on its behavior at infinity, but…
We study the properties of a subclass of stochastic processes called discrete time nonlinear Markov chains with an aggregator, which naturally appear in various topics such as strategic queueing systems, inventory dynamics, opinion…
The collective properties of small material systems considered as semidynamical systems revealing the Markov-type irreversible evolution, are investigated. It is shown that these material systems admit their treatment as thermodynamic…
We study asymptotic behavior of a Markov semigroup on a von-Neumann algebra by exploring a maximal von-Neumann subalgebra where the Markov semigroup is an automorphism. This enables us to prove that strong mixing is equivalent to ergodic…
In this paper we introduce a new approach to discrete-time semi-Markov decision processes based on the sojourn time process. Different characterizations of discrete-time semi-Markov processes are exploited and decision processes are…
We show a decomposition into the sum of a martingale and a deterministic quantity for time averages of the solutions to non-autonomous SDEs and for discrete-time Markov processes. In the SDE case the martingale has an explicit…
We address the problem of community detection in networks by introducing a general definition of Markov stability, based on the difference between the probability fluxes of a Markov chain on the network at different time scales. The…
The theory of ``Markov-up'' processes is being developed. This is a new class of stochastic processes with ``partial'' markovian features; it could also be called ``one-sided Markov''. Such a behavior may be found in the real world and in…
Consider a filtering process associated to a hidden Markov model with densities for which both the state space and the observation space are complete, separable, metric spaces. If the underlying, hidden Markov chain is strongly ergodic and…
We consider the problem of conditioning a Markov process on a rare event and of representing this conditioned process by a conditioning-free process, called the effective or driven process. The basic assumption is that the rare event used…
We present a Markov-chain analysis of blockwise-stochastic algorithms for solving partially block-separable optimization problems. Our main contributions to the extensive literature on these methods are statements about the Markov operators…
We study Markov processes associated with stochastic differential equations, whose non-linearities are gradients of convex functionals. We prove a general result of existence of such Markov processes and a priori estimates on the transition…
In this paper, we extend the results of Elliott and Yang \cite{elliott3} and discuss the control of a stochastic process for which the driving noise is provided by a martingale associated with a semi-Markov Chain. An existence and a…
It is proved that a general non-differentiable skew convolution semigroup associated with a strongly continuous semigroup of linear operators on a real separable Hilbert space can be extended to a differentiable one on the entrance space of…
This paper investigates natural conditions for the existence of optimal policies for a Markov decision process with incomplete information (MDPII) and with expected total costs. The MDPII is the classic model of a controlled stochastic…
We define the concept of an `open' Markov process, a continuous-time Markov chain equipped with specified boundary states through which probability can flow in and out of the system. External couplings which fix the probabilities of…
When we are interested in the long-term behaviour of solutions to linear evolution equations, a large variety of techniques from the theory of $C_0$-semigroups is at our disposal. However, if we consider for instance parabolic equations…
We construct a four-parameter family of Markov processes on infinite Gelfand-Tsetlin schemes that preserve the class of central (Gibbs) measures. Any process in the family induces a Feller Markov process on the infinite-dimensional boundary…