Related papers: Progressively Enlargement of Filtrations and Contr…
In this paper we study stochastic optimal control problems of general fully coupled forward-backward stochastic differential equations (FBSDEs). In Li and Wei [8] the authors studied two cases of diffusion coefficients $\sigma$ of FSDEs, in…
In this paper we study the stochastic control problem of partially observed (multi-dimensional) stochastic system driven by both Brownian motions and fractional Brownian motions. In the absence of the powerful tool of Girsanov…
The paper is concerned with optimal control of backward stochastic differential equation (BSDE) driven by Teugel's martingales and an independent multi-dimensional Brownian motion, where Teugel's martingales are a family of pairwise…
In this paper we present a novel sampling-based numerical scheme designed to solve a certain class of stochastic optimal control problems, utilizing forward and backward stochastic differential equations (FBSDEs). By means of a nonlinear…
In this paper we obtain a martingale representation theorem in the progressive enlargement $\mathbb{G}$ by a random time $\tau$ of the filtration $\mathbb{F}^L$ generated by a L\'evy process $L$. The assumptions on the random time are that…
Discrete time control systems whose dynamics and observations are described by stochastic equations are common in engineering, operations research, health care, and economics. For example, stochastic filtering problems are usually defined…
This paper build on our recent work where we presented a dual stochastic optimal control formulation of the nonlinear filtering problem [1]. The constraint for the dual problem is a backward stochastic differential equations (BSDE). The…
We address a general optimal switching problem over finite horizon for a stochastic system described by a differential equation driven by Brownian motion. The main novelty is the fact that we allow for infinitely many modes (or regimes,…
In this review/tutorial article, we present recent progress on optimal control of partially observed Markov Decision Processes (POMDPs). We first present regularity and continuity conditions for POMDPs and their belief-MDP reductions, where…
We present a particle filtering algorithm for stochastic models on infinite dimensional state space, making use of Girsanov perturbations to nudge the ensemble of particles into regions of higher likelihood. We argue that the optimal…
This paper deals with a nonlinear filtering problem in which a multi-dimensional signal process is additively affected by a process $\nu$ whose components have paths of bounded variation. The presence of the process $\nu$ prevents from…
Since Peng (1993) established a local maximum principle for a general stochastic control problem governed by forward-backward stochastic differential equations (FBSDEs), the corresponding partial differential equation (PDE) characterization…
Stochastic maximum principle of nonlinear controlled forward-backward systems, where the set of strict (classical) controls need not be convex and the diffusion coefficient depends explicitly on the variable control, is an open problem…
Particle filters (PFs) are recursive Monte Carlo algorithms for Bayesian tracking and prediction in state space models. This paper addresses continuous-discrete filtering problems, where the hidden state evolves as an It\^o stochastic…
In this paper, we assume that the filtration $\bb F$ is generated by a $d$-dimensional Brownian motion $W=(W_1,\cdots,W_d)'$ as well as an integer-valued random measure $\mu(du,dy)$. The random variable $\ttau$ is the default time and $L$…
This paper is devoted to an optimal control problem of fully coupled forward-backward stochastic differential equations driven by sub-diffusion, whose solutions are not Markov processes. The stochastic maximum principle is obtained, where…
This work establishes two versions of the Pontryagin-type maximum principles for partially observed optimal control of coupled forward stochastic partial differential equations (FSPDEs) and backward stochastic differential equations (BSDEs)…
We consider an Ito stochastic differential equation with delay, driven by brownian motion, whose solution, by an appropriate reformulation, defines a Markov process $X$ with values in a space of continuous functions $\mathbf C$, with…
In this paper, we consider a class of continuous-time, continuous-space stochastic optimal control problems. Building upon recent advances in Markov chain approximation methods and sampling-based algorithms for deterministic path planning,…
In this paper, a quadratic optimal control problem is considered for second-order parabolic PDEs with homogeneous Dirichlet boundary conditions, in which the "point" control function (depending only on time) constitutes a source term. These…