Related papers: Stochastic control for Backward Stochastic Differe…
In this paper we discuss existence and uniqueness for a one-dimensional time inhomogeneous stochastic differential equation directed by an $\mathbb{F}$-semimartingale $M$ and a finite cubic variation process $\xi$ which has the structure…
Stochastic approximation (SA) is a fundamental iterative framework with broad applications in reinforcement learning and optimization. Classical analyses typically rely on martingale difference or Markov noise with bounded second moments,…
We consider a stochastic delay differential equation driven by a general Levy process. Both, the drift and the noise term may depend on the past, but only the drift term is assumed to be linear. We show that the segment process is…
In this paper we study the asymptotic behavior of a stochastic approximation scheme on two timescales with set-valued drift functions and in the presence of non-additive iterate-dependent Markov noise. It is shown that the recursion on each…
We introduce a class of Markov chains, that contains the model of stochastic approximation by averaging and non-averaging. Using martingale approximation method, we establish various deviation inequalities for separately Lipschitz functions…
By analogy with the theory of Backward Stochastic Differential Equations, we define Backward Stochastic Difference Equations on spaces related to discrete time, finite state processes. This paper considers these processes as constructions…
We study a fairly general class of time-homogeneous stochastic evolutions driven by noises that are not white in time. As a consequence, the resulting processes do not have the Markov property. In this setting, we obtain constructive…
In this paper, we study the problem of how to optimally steer the state covariance of a general continuous-time linear stochastic system over a finite time interval subject to additive noise. Optimality here means reaching a target state…
In this paper we introduce a model, the stochastic fractional delay differential equation (SFDDE), which is based on the linear stochastic delay differential equation and produces stationary processes with hyperbolically decaying…
We consider a stochastic control problem which is composed of a controlled stochastic differential equation, and whose associated cost functional is defined through a controlled backward stochastic differential equation. Under appropriate…
The paper considers a stabilizing stochastic control which can be applied to a variety of unstable and even chaotic maps. Compared to previous methods introducing control by noise, we relax assumptions on the class of maps, as well as…
We present a new approach to noncommutative stochastic calculus that is, like the classical theory, based primarily on the martingale property. Using this approach, we introduce a general theory of stochastic integration and quadratic…
We consider a stochastic process which is (a) described by a continuous-time Markov chain on only short time-scales and (b) constrained to conserve a number of hidden quantities on long time-scales. We assume that the transition matrix of…
We solve the problem of mean-variance hedging for general semimartingale models via stochastic control methods. After proving that the value process of the associated stochastic control problem has a quadratic structure, we characterize its…
This paper introduces a backward stochastic differential equation driven by both Brownian motion and a Markov chain (BSDEBM). Regime-switching is also incorporated through its driver. The existence and uniqueness of the solution of the…
In this paper, we study a class of stochastic partial differential equations (SPDEs) driven by space-time fractional noises. Our method consists in studying first the nonlocal SPDEs and showing then the convergence of the family of these…
The purpose of the paper is twofold. Firstly, we want to present a Meta Theorem to show the existence of a martingale solution for coupled systems of non-linear stochastic differential equations. The idea is first to split the system by…
Stochastic systems have a control-theoretic interpretation in which noise plays the role of control. In the weak-noise limit, relevant at low temperatures or in large populations, this leads to a precise mathematical mapping: the most…
Motivated by a problem of optimal harvesting of natural resources, we study a control problem for Volterra type dynamics driven by time-changed L\'evy noises, which are in general not Markovian. To exploit the nature of the noise, we make…
In this paper we will show that the solution of 1D stochastic parabolic equation with additive noise converges to a martingale (independent upon space variable) when we rescale noise at the extremum points of the process.