相关论文: Long Time Behavior of General Markov Additive Proc…
We study asymptotic stability of continuous-time systems with mode-dependent guaranteed dwell time. These systems are reformulated as special cases of a general class of mixed (discrete-continuous) linear switching systems on graphs, in…
We study the asymptotic behaviour of the time-changed stochastic process $\vphantom{X}^f\!X(t)=B(\vphantom{S}^f\!S (t))$, where $B$ is a standard one-dimensional Brownian motion and $\vphantom{S}^f\!S$ is the (generalized) inverse of a…
Whereas classical invariance principles for ergodic Markov chains address the situation in which the time horizon of observations is much larger than the mixing time, the quality of approximation is questionable when this is not the case…
We introduce and study a family of Markov processes on partitions. The processes preserve the so-called z-measures on partitions previously studied in connection with harmonic analysis on the infinite symmetric group. We show that the…
Calculating optimal policies is known to be computationally difficult for Markov decision processes (MDPs) with Borel state and action spaces. This paper studies finite-state approximations of discrete time Markov decision processes with…
We prove a large deviation principle on path space for a class of discrete time Markov processes whose state space is the intersection of a regular domain $\L\subset \R^d$ with some lattice of spacing $\e$. Transitions from $x$ to $y$ are…
We present metrics for measuring state similarity in Markov decision processes (MDPs) with infinitely many states, including MDPs with continuous state spaces. Such metrics provide a stable quantitative analogue of the notion of…
We consider some special classes of L\'evy processes with no gaussian component whose L\'evy measure is of the type $\pi(dx)=e^{\gamma x}\nu(e^x-1) dx$, where $\nu$ is the density of the stable L\'evy measure and $\gamma$ is a positive…
Extensions of Kemeny's constant, as derived for irreducible finite Markov chains in discrete time, to Markov renewal processes and Markov chains in continuous time are discussed. Three alternative Kemeny's functions and their variants are…
We consider temporal models of rapidly changing Markovian networks modulated by time-evolving spatially dependent kernels that define rates for edge formation and dissolution. Alternatively, these can be viewed as Markovian networks with…
We show that the scaled cumulant generating and large deviation function, associated to a two-state Markov process involving two processes, obey a symmetry relation reminiscent of the fluctuation theorem, independent from any conditions on…
We prove a sample path Large Deviation Principle (LDP) for a class of jump processes whose rates are not uniformly Lipschitz continuous in phase space. Building on it we further establish the corresponding Wentzell-Freidlin (W-F) (infinite…
We present metrics for measuring the similarity of states in a finite Markov decision process (MDP). The formulation of our metrics is based on the notion of bisimulation for MDPs, with an aim towards solving discounted infinite horizon…
We develop a martingale approximation approach to studying the limiting behavior of quadratic forms of Markov chains. We use the technique to examine the asymptotic behavior of lag-window estimators in time series and we apply the results…
Predictability of behavior has emerged an an important characteristic in many fields including biology, medicine, and marketing. Behavior can be recorded as a sequence of actions performed by an individual over a given time period. This…
We study the asymptotic behavior of complex discrete evolution equations of Ginzburg- Landau type. Depending on the nonlinearity and the data of the problem, we find different dynamical behavior ranging from global existence of solutions…
Bisimulation is a concept that captures behavioural equivalence of states in a variety of types of transition systems. It has been widely studied in discrete-time settings where a key notion is the bisimulation metric which quantifies "how…
An infinite system of point particles placed in $\mathds{R}^d$ is studied. The particles are of two types; they perform random walks in the course of which those of distinct types repel each other. The interaction of this kind induces an…
Let $N(t)$ be the collection of particles alive at time $t$ in a branching Brownian motion in $\mathbb{R}^d$, and for $u\in N(t)$, let $\mathbf{X}_u(t)$ be the position of particle $u$ at time $t$. For $\theta\in \mathbb{R}^d$, we define…
A stochastic approach to the quantum dynamics randomly modulated in time by a discrete state non-Markovian noise, which possesses an arbitrary non-exponential distribution of the residence times, is developed. The formally exact expression…