Related papers: An It\^o-type formula for some measure-valued proc…
This paper introduces the formalism required to analyze a certain class of stochastic control problems that involve a super diffusion as the underlying controlled system. To establish the existence of these processes, we show that they are…
We establish It\^o's formula along flows of probability measures associated with general semimartingales; this generalizes existing results for flows of measures on It\^o processes. Our approach is to first establish It\^o's formula for…
In this paper, a stochastic optimal control problem is investigated in which the system is governed by a stochastic functional differential equation. In the framework of functional It\^o calculus, we build the dynamic programming principle…
We consider a class of stochastic control problems where the state process is a probability measure-valued process satisfying an additional martingale condition on its dynamics, called measure-valued martingales (MVMs). We establish the…
Using the theory of stochastic integration developed recently by the authors, in this paper we prove an It\^{o} formula for Hilbert space-valued It\^{o} processes defined with respect to a cylindrical-martingale valued measure. As part of…
We provide an It\^o's formula for $C^1$-functionals of flows of conditional marginal distributions of continuous semimartingales. This is based on the notion of weak Dirichlet process, and extends the $C^1$-It\^o's formula in Gozzi and…
In the present work we employ, for the first time, backward stochastic differential equations (BSDEs) to study the optimal control of semi-Markov processes on finite horizon, with general state and action spaces. More precisely, we prove…
We study a stochastic control problem on a bounded domain, which arises from a continuous-time optimal management model. Via the corresponding Hamilton-Jacobi-Bellman equation the value function is shown to be jointly continuous and to…
In this note, we demonstrate that a locally semiconvex viscosity supersolution to a possibly degenerate fully nonlinear elliptic Hamilton-Jacobi-Bellman (HJB) equation is differentiable along the directions spanned by the range of the…
We study the well-posedness of Hamilton-Jacobi-Bellman equations on subsets of $\mathbb{R}^d$ in a context without boundary conditions. The Hamiltonian is given as the supremum over two parts: an internal Hamiltonian depending on an…
This paper investigates the optimal control problems for the finite-horizon continuous-time Markov decision processes with delay-dependent control policies. We develop compactification methods in decision processes, and show that the…
In this paper we investigate a path dependent optimal control problem on the process space with both drift and volatility controls, with possibly degenerate volatility. The dynamic value function is characterized by a fully nonlinear second…
This paper is concerned with a comparison principle for viscosity solutions to Hamilton-Jacobi (HJ), -Bellman (HJB), and -Isaacs (HJI) equations for general classes of partial integro-differential operators. Our approach innovates in three…
We establish a comparison principle for viscosity solutions of a class of nonlinear partial differential equations posed on the space of nonnegative finite measures, thereby extending recent results for PDEs defined on the Wasserstein space…
This paper studies the stochastic optimal control of jump-diffusion processes and the associated fully nonlinear backward stochastic Hamilton--Jacobi--Bellman (BSHJB) equations. We establish the dynamic programming principle (DPP) via…
In this paper, we study a stochastic recursive optimal control problem in which the system is governed by a functional forward-backward stochastic differential equation. Under standard assumptions, we establish the dynamic programming…
We consider a kind of stochastic exit time optimal control problems, in which the cost function is defined through a nonlinear backward stochastic differential equation. We study the regularity of the value function for such a control…
This paper develops a comparison theorem for viscosity solutions of a new class of Hamilton-Jacobi-Bellman (HJB) equations, which is used to solve the separated problem governed by the K-S equation in the Wasserstein space. A distinctive…
We prove comparison principle for viscosity solutions of a Hamilton-Jacobi-Bellman equation in a strong coupling regime considering a stationary and a time-dependent version of the equation. We consider a Hamiltonian that has a…
In this article, a notion of viscosity solutions is introduced for second order path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with optimal control problems for path-dependent stochastic differential equations. We…