Related papers: Markov-modulated generalized Ornstein-Uhlenbeck pr…
We consider a piecewise deterministic Markov decision process, where the expected exponential utility of total (nonnegative) cost is to be minimized. The cost rate, transition rate and post-jump distributions are under control. The state…
We present an elementary state augmentation method for a class of static risk measure applied to the total cost for both Markov decision processes and stochastic optimal control, such that dynamic programming equations can be derived on the…
The steady state of the Fokker-Planck equation corresponding to a density dependent one-step process is approximated by a suitable normal distribution. Starting from the master equations of the process, written in terms of the time…
We study necessary and sufficient criteria for global survival of discrete or continuous-time branching Markov processes. We relate these to several definitions of generalised principle eigenvalues for elliptic operators due to Berestycki…
Reciprocal processes are acausal generalizations of Markov processes introduced by Bernstein in 1932. In the literature, a significant amount of attention has been focused on developing dynamical models for reciprocal processes. In this…
The theory of ``Markov-up'' processes is being developed. This is a new class of stochastic processes with ``partial'' markovian features; it could also be called ``one-sided Markov''. Such a behavior may be found in the real world and in…
A general method to construct recombinant tree approximations for stochastic volatility models is developed and applied to the Heston model for stock price dynamics. In this application, the resulting approximation is a four tuple Markov…
We study gradient drift-diffusion processes on a probability simplex set with finite state Wasserstein metrics, namely finite state Wasserstein common noises. A fact is that the Kolmogorov transition equation of finite reversible Markov…
We model the time evolution of single win odds in Japanese horse racing as a stochastic process, deriving an Ornstein--Uhlenbeck process by analyzing the probability dynamics of vote shares and the empirical time series of odds movements.…
A new multi-factor short rate model is presented which is bounded from below by a real-valued function of time. The mean-reverting short rate process is modeled by a sum of pure-jump Ornstein--Uhlenbeck processes such that the related bond…
We consider the problem of minimizing a certainty equivalent of the total or discounted cost over a finite and an infinite time horizon which is generated by a Partially Observable Markov Decision Process (POMDP). The certainty equivalent…
ODE solvers with randomly sampled timestep sizes appear in the context of chaotic dynamical systems, differential equations with low regularity, and, implicitly, in stochastic optimisation. In this work, we propose and study the stochastic…
Markovian diffusion processes yield a system of conservation laws which couple various conditional expectation values (local moments). Solutions of that closed system of deterministic partial differential equations stand for a regular…
Markov jump processes are continuous-time stochastic processes with a wide range of applications in both natural and social sciences. Despite their widespread use, inference in these models is highly non-trivial and typically proceeds via…
In this paper we show that Hilbert space-valued stochastic models are robust with respect to perturbation, due to measurement or approximation errors, in the underlying volatility process. Within the class of stochastic volatility modulated…
Firstly, the Markovian stochastic Schr\"odinger equations are presented, together with their connections with the theory of measurements in continuous time. Moreover, the stochastic evolution equations are translated into a simulation…
Birth and death Markov processes can model stochastic physical systems from percolation to disease spread and, in particular, wildfires. We introduce and analyze a birth-death-suppression Markov process as a model of controlled culling of…
Recent empirical studies suggest that the volatility of an underlying price process may have correlations that decay slowly under certain market conditions. In this paper, the volatility is modeled as a stationary process with long-range…
This paper proposes a stochastic approach to model temperature dynamic and study related risk measures. The dynamic of temperatures can be modelled by a mean-reverting process such as an Ornstein-Uhlenbeck one. In this study, we estimate…
This paper develops a new stochastic volatility model for the temperature that is a natural extension of the Ornstein-Uhlenbeck model proposed by Benth and Benth (2007). This model allows to be more conservative regarding extreme events…