Related papers: Practical Criterion for Uniqueness of $Q$-processe…
The explicit criteria for several types of ergodicity of one-dimensional diffusions or birth-death processes have been found out recently in a surprisingly short period. One of the criteria is for exponential ergodicity of birth-death…
We address a class of Markov jump linear systems that are characterized by the underlying Markov process being time-inhomogeneous with a priori unknown transition probabilities. Necessary and sufficient conditions for uniform stochastic…
A possibly time-dependent transition intensity matrix or generator $(Q(t))$ characterizes the law of a Markov jump process (MP). For a time homogeneous MP, the transition probability matrix (TPM) can be expressed as a matrix exponential of…
Identifying causal order from restricted projective data is generally nontrivial. When two quantum players interact only through an unobserved environment, the available local measurement statistics are typically not tomographically…
Regime-switching processes contain two components: continuous component and discrete component, which can be used to describe a continuous dynamical system in a random environment. Such processes have many different properties than general…
This work investigates the almost sure stabilization of a class of regime-switching systems based on discrete-time observations of both continuous and discrete components. It develops Shao's work [SIAM J. Control Optim., 55(2017), pp.…
We study the problem of characterizing the expected hitting times for a robust generalization of continuous-time Markov chains. This generalization is based on the theory of imprecise probabilities, and the models with which we work…
We establish a sufficient condition for the tightness of a sequence of stochastic processes. Our condition makes it possible to study processes with accumulations of fixed times of discontinuity. Our motivation comes from the study of…
To make sense of the world around us, we develop models, constructed to enable us to replicate, describe, and explain the behaviours we see. Focusing on the broad case of sequences of correlated random variables, i.e., classical stochastic…
We establish a new Bernstein-type deviation inequality for general (non-reversible) discrete-time Markov chains via an elementary approach. More robust than existing works in the literature, our result only requires the Markov chain to…
We analyze the multitime statistics associated with pure dephasing systems repeatedly probed with sharp measurements, and search for measurement protocols whose statistics satisfies the Kolmogorov consistency conditions possibly up to a…
The theory of causal fermion systems is a recent approach to fundamental physics. Giving quantum mechanics, general relativity and quantum field theory as limiting cases, it is a candidate for a unified physical theory. The dynamics is…
In this paper, we derive a simple drift condition for the stability of a class of two-dimensional Markov processes, for which one of the coordinates (also referred to as the {\em phase} for convenience) has a well understood behaviour…
We study unconstrained control of a two-level quantum system and analyse critical points of the objective functional which represents quantum average of system observable at some final time $T$. In Proc. Steklov Inst. Math. 285, 233-240…
Consider a Markov process $\{\Phi(t) : t\geq 0\}$ evolving on a Polish space ${\sf X}$. A version of the $f$-Norm Ergodic Theorem is obtained: Suppose that the process is $\psi$-irreducible and aperiodic. For a given function $f\colon{\sf…
The paper studies the time-homogeneous two-state Markov chains; the states are assumed to be binary symbols 0 and 1. The higher-order absolute differences taken from progressive states of a given chain are considered. A discrete capacity of…
The theory of ``Markov-up'' processes is being developed. This is a new class of stochastic processes with ``partial'' markovian features; it could also be called ``one-sided Markov''. Such a behavior may be found in the real world and in…
In the paper we consider some piecewise deterministic Markov process whose continuous component evolves according to semiflows, which are switched at the jump times of a Poisson process. The associated Markov chain describes the states of…
Non-Markovian quantum processes exhibit different memory effects when measured in different ways; an unambiguous characterization of memory length requires accounting for the sequence of instruments applied to probe the system dynamics.…
We present an approach for testing for the existence of continuous generators of discrete stochastic transition matrices. Typically, the known approaches to ascertain the existence of continuous Markov processes are based in the assumption…