相关论文: Microcanonical conditioning of Markov processes on…
We consider Markov processes in continuous time with state space $\posint^N$ and provide two sufficient conditions and one necessary condition for the existence of moments $E(\|X(t)\|^r)$ of all orders $r \in \nat$ for all $t \geq 0$. The…
A time-changed mixed fractional Brownian motion is an iterated process constructed as the superposition of mixed fractional Brownian motion and other process. In this paper we consider mixed fractional Brownian motion of parameters a, b and…
In this work, we investigate the optimal control problem for continuous-time Markov decision processes with the random impact of the environment. We provide conditions to show the existence of optimal controls under finite-horizon criteria.…
The paper deals with the problem of large-time behaviour of trajectories for discrete-time dynamical systems driven by a random noise. Assuming that the phase space is finite-dimensional and compact, and the noise is a Markov process with a…
We present a detailed study of a simple quantum stochastic process, the quantum phase space Brownian motion, which we obtain as the Markovian limit of a simple model of open quantum system. We show that this physical description of the…
A $p$-adic Brownian motion is a continuous time stochastic process in a $p$-adic state space that has a Vladimirov operator as its infinitesimal generator. The current work shows that any such process is the scaling limit of a discrete time…
We establish a new Bernstein-type deviation inequality for general (non-reversible) discrete-time Markov chains via an elementary approach. More robust than existing works in the literature, our result only requires the Markov chain to…
Recently, in ["The coin-turning walk and its scaling limit", Electronic Journal of Probability, 25 (2020)], the ``coin-turning walk'' was introduced on ${\mathbb Z}$. It is a non-Markovian process where the steps form a (possibly)…
Aggregation transitions in disordered mesoscopic systems play an important role in several areas of knowledge, from materials science to biology. The lack of a thermodynamic limit in systems that are intrinsically finite makes the…
A continuous Markovian model for truncated Levy random walks is proposed. It generalizes the approach developed previously by Lubashevsky et al. Phys. Rev. E 79, 011110 (2009); 80, 031148 (2009), Eur. Phys. J. B 78, 207 (2010) allowing for…
Owing to the Chapman-Kolmogorov equation for Markovian dynamics,any equilibrium trajectory of a Brownian particle in a solvent fluid can be viewed as the superposition of an uncountable number of non-equilibrium states. This property…
A central task in many applications is reasoning about processes that change in a continuous time. The mathematical framework of Continuous Time Markov Processes provides the basic foundations for modeling such systems. Recently, Nodelman…
In this paper, we study one dimensional Markov processes with spatial delay. Since the seminal work of Feller, we know that virtually any one dimensional, strong, homogeneous, continuous Markov process can be uniquely characterized via its…
General upper bounds on fluctuations of trajectory observables were recently obtained. It turned out that the size of fluctuations of dynamical observable is limited from below and from above. For the moment generating function of general…
When the limiting compensator of a sequence of martingales is continuous, we obtain a weak convergence theorem for the martingales; the limiting process can be written as a Brownian motion evaluated at the compensator and we find sufficient…
We study a class of multitype branching L\'evy processes, where particles move according to type-dependent L\'evy processes, switch types via an irreducible Markov chain, and branch according to type-dependent laws. This framework…
We introduce a framework for approximate dynamic programming that we apply to discrete time chains on $\mathbb{Z}_+^d$ with countable action sets. Our approach is grounded in the approximation of the (controlled) chain's generator by that…
The thermodynamic uncertainty relation, which establishes a universal trade-off between the relative fluctuation of arbitrary currents and the dissipation, has been found for various Markovian systems. However, this relation has not been…
This paper focuses on optimizing probabilities of events of interest defined over general controlled discrete-time Markov processes. It is shown that the optimization over a wide class of $\omega$-regular properties can be reduced to the…
A novel framework for the analysis of observation statistics on time discrete linear evolutions in Banach space is presented. The model differs from traditional models for stochastic processes and, in particular, clearly distinguishes…