Related papers: Markov-modulated Ornstein-Uhlenbeck processes

Using a coupling for the weighted sum of independent random variables and the explicit expression of the transition semigroup of Ornstein-Uhlenbeck processes driven by compound Poisson processes, we establish the existence of a successful…

We consider an ensemble of Ornstein-Uhlenbeck processes featuring a population of relaxation times and a population of noise amplitudes that characterize the heterogeneity of the ensemble. We show that the centre-of-mass like variable…

The model of partially observed linear stochastic differential equations depending on some unknown parameters is considered. An proximation of the unobserved component is proposed. This approximation is realized in three steps. First an…

In electricity markets, it is sensible to use a two-factor model with mean reversion for spot prices. One of the factors is an Ornstein-Uhlenbeck (OU) process driven by a Brownian motion and accounts for the small variations. The other…

The relaxation of a dissipative system to its equilibrium state often shows a multiexponential pattern with relaxation rates, which are typically considered to be independent of the initial condition. The rates follow from the spectrum of a…

We study general Markov additive processes when the state space of the modulator is a Polish space. Under some regularity assumptions, our main result is the characterization of the long-time behavior of the ordinate in terms of the…

We consider $M/Ph/n+M$ queueing systems in steady state. We prove that the Wasserstein distance between the stationary distribution of the normalized system size process and that of a piecewise Ornstein-Uhlenbeck (OU) process is bounded by…

This article establishes cutoff thermalization (also known as the cutoff phenomenon) for a class of generalized Ornstein-Uhlenbeck systems $(X^\varepsilon_t(x))_{t\geqslant 0}$ with $\varepsilon$-small additive L\'evy noise and initial…

This paper provides several statistical estimators for the drift and volatility parameters of an Ornstein-Uhlenbeck process driven by fractional Brownian motion, whose observations can be made either continuously or at discrete time…

In this article we study the asymptotic behaviour of the realized quadratic variation of a process $\int_{0}^{t}u_{s}dY_{s}^{(1)}$% , where $u$ is a $\beta$-H\"older continuous process with $\beta > 1-H$ and…

Learning is a fundamental property of intelligent systems, observed across biological organisms and engineered systems. While modern intelligent systems typically rely on gradient descent for learning, the need for exact gradients and…

A stochastic process is at thermodynamic equilibrium if it obeys time-reversal symmetry; forward and reverse time are statistically indistinguishable at steady state. Non-equilibrium processes break time-reversal symmetry by maintaining…

Fractional Ornstein-Uhlenbeck process of the second kind $(\text{fOU}_{2})$ is solution of the Langevin equation $\mathrm{d}X_t = -\theta X_t\,\mathrm{d}t+\mathrm{d}Y_t^{(1)}, \ \theta >0$ with driving noise $ Y_t^{(1)} := \int^t_0 e^{-s}…

We consider finite model approximations of discrete-time partially observed Markov decision processes (POMDPs) under the discounted cost criterion. After converting the original partially observed stochastic control problem to a fully…

Markov decision processes (MDPs) is viewed as an optimization of an objective function over certain linear operators over general function spaces. A new existence result is established for the existence of optimal policies in general MDPs,…

We study a least squares estimator $\hat {\theta}_T$ for the Ornstein-Uhlenbeck process, $dX_t=\theta X_t dt+\sigma dB^H_t$, driven by fractional Brownian motion $B^H$ with Hurst parameter $H\ge \frac12$. We prove the strong consistence of…

We review the probabilistic properties of Ornstein-Uhlenbeck processes in Hilbert spaces driven by L\'{e}vy processes. The emphasis is on the different contexts in which these processes arise, such as stochastic partial differential…

A stochastic process $X$ becomes occupied when it is enlarged with its occupation flow $\mathcal{O}$ that tracks the time spent by the path at each level. When $X$ is Markov, the occupied process $(\mathcal{O},X)$ enjoys a Markov structure…

Markov Decision Processes (MDPs) are stochastic optimization problems that model situations where a decision maker controls a system based on its state. Partially observed Markov decision processes (POMDPs) are generalizations of MDPs where…

We consider Markov Decision Processes (MDPs) where the rewards are unknown and may change in an adversarial manner. We provide an algorithm that achieves state-of-the-art regret bound of $O( \sqrt{\tau (\ln|S|+\ln|A|)T}\ln(T))$, where $S$…