Related papers: Markov-modulated generalized Ornstein-Uhlenbeck pr…
In this paper we study a reflected Markov-modulated Brownian motion with a two sided reflection in which the drift, diffusion coefficient and the two boundaries are (jointly) modulated by a finite state space irreducible continuous time…
In this paper, we consider the extended stochastic Navier-Stokes equations with Caputo derivative driven by fractional Brownian motion. We firstly derive the pathwise spatial and temporal regularity of the generalized Ornstein-Uhlenbeck…
We introduce a general framework for Markov decision problems under model uncertainty in a discrete-time infinite horizon setting. By providing a dynamic programming principle we obtain a local-to-global paradigm, namely solving a local,…
In this paper we investigate the problem of detecting a change in the drift parameters of a generalized Ornstein-Uhlenbeck process which is defined as the solution of $dX_t=(L(t)-\alpha X_t) dt + \sigma dB_t$, and which is observed in…
In this work, we consider, in a general setting, multiparameter multidimensional Markov processes that are time-changed by an independent additive subordinator. By extending Phillips theorem, we show that the resulting process is a Feller…
In this paper we introduce a general stochastic representation for an important class of processes with resetting. It allows to describe any stochastic process intermittently terminated and restarted from a predefined random or non-random…
Markov decision processes (MDP) are a well-established model for sequential decision-making in the presence of probabilities. In robust MDP (RMDP), every action is associated with an uncertainty set of probability distributions, modelling…
Uncertain partially observable Markov decision processes (uPOMDPs) allow the probabilistic transition and observation functions of standard POMDPs to belong to a so-called uncertainty set. Such uncertainty, referred to as epistemic…
It was recently proven that the correlation function of the stationary version of a reflected L\'evy process is nonnegative, nonincreasing and convex. In another branch of the literature it was established that the mean value of the…
We are concerned with the asymptotics of the Markov chain given by the post-jump locations of a certain piecewise-deterministic Markov process with a state-dependent jump intensity. We provide sufficient conditions for such a model to…
We refer by threshold Ornstein-Uhlenbeck to a continuous-time threshold autoregressive process. It follows the Ornstein-Uhlenbeck dynamics when above or below a fixed level, yet at this level (threshold) its coefficients can be…
In this paper we present elementary computations for some Markov modulated counting processes, also called counting processes with regime switching. Regime switching has become an increasingly popular concept in many branches of science. In…
We propose solution methods for previously-unsolved constrained MDPs in which actions can continuously modify the transition probabilities within some acceptable sets. While many methods have been proposed to solve regular MDPs with large…
The multivariate Ornstein-Uhlenbeck process is used in many branches of science and engineering to describe the regression of a system to its stationary mean. Here we present an $O(N)$ Bayesian method to estimate the drift and diffusion…
We consider in this paper a general two-sided jump-diffusion risk model that allows for risky investments as well as for correlation between the two Brownian motions driving insurance risk and investment return. We first introduce the model…
In this paper, a general stochastic model with controls applied at the moments when the random process hits the boundary of a given subset of the state set is proposed and studied. The general concept of the model is formulated and its…
The method of potential solutions of Fokker-Planck equations is used to develop a transport equation for the joint probability of N stochastic variables with Lochner's generalized Dirichlet distribution (R.H. Lochner, A Generalized…
We collect, scattered through literature, as well as we prove some new properties of two Markov processes that in many ways resemble Wiener and Ornstein--Uhlenbeck processes. Although processes considered in this paper were defined either…
We present a stochastic volatility market model where volatility is correlated with return and is represented by an Ornstein-Uhlenbeck process. With this model we exactly measure the leverage effect and other stylized facts, such as mean…
This paper studies Langevin equation with random damping due to multiplicative noise and its solution. Two types of multiplicative noise, namely the dichotomous noise and fractional Gaussian noise are considered. Their solutions are…