Related papers: G-BSDEs with non-Lipschitz coefficients and the co…
This paper introduces a notion of viscosity solutions for second order elliptic Hamilton-Jacobi-Bellman (HJB) equations with infinite delay associated with infinite-horizon optimal control problems for stochastic differential equations with…
We introduce a stochastic version of the optimal transport problem. We provide an analysis by means of the study of the associated Hamilton-Jacobi-Bellman equation, which is set on the set of probability measures. We introduce a new…
We consider a class of exit time stochastic control problems for diffusion processes with discounted criterion, where the controller can utilize a given amount of resource, called "fuel". In contrast to the vast majority of existing…
We consider the simplest example of a time-dependent first order Hamilton-Jacobi equation, in one space dimension and with a bounded and Lipschitz continuous Hamiltonian which only depends on the spatial derivative. We show that if the…
In this article, a notion of viscosity solutions is introduced for first order path-dependent Hamilton-Jacobi-Bellman (HJB) equations associated with optimal control problems for path-dependent differential equations. We identify the value…
We study optimal stochastic control problem for non-Markovian stochastic differential equations (SDEs) where the drift, diffusion coefficients, and gain functionals are path-dependent, and importantly we do not make any ellipticity…
We consider a classical finite horizon optimal control problem for continuous-time pure jump Markov processes described by means of a rate transition measure depending on a control parameter and controlled by a feedback law. For this class…
We study the problem of optimal portfolio selection under stochastic volatility within a continuous time reinforcement learning framework with portfolio constraints. Exploration is modeled through entropy-regularized relaxed controls, where…
The study of optimal control problems under uncertainty plays an important role in scientific numerical simulations. This class of optimization problems is strongly utilized in engineering, biology and finance. In this paper, a stochastic…
In this paper we establish H\"older continuity estimates for viscosity solutions to first order Hamilton-Jacobi equations linked to linear control systems satisfying the Kalman rank condition. Our model Hamiltonians are non-convex in the…
This paper investigates the existence of a G-relaxed optimal control of a controlled stochastic differential delay equation driven by G-Brownian motion (G-SDDE in short). First, we show that optimal control of G-SDDE exists for the finite…
This paper build on our recent work where we presented a dual stochastic optimal control formulation of the nonlinear filtering problem [1]. The constraint for the dual problem is a backward stochastic differential equations (BSDE). The…
We study PDE of the form $\max\{F(D^2u,x)-f(x), H(Du)\}=0$ where $F$ is uniformly elliptic and convex in its first argument, $H$ is convex, $f$ is a given function and $u$ is the unknown. These equations are derived from dynamic programming…
In this paper, we propose Q-learning algorithms for continuous-time deterministic optimal control problems with Lipschitz continuous controls. Our method is based on a new class of Hamilton-Jacobi-Bellman (HJB) equations derived from…
We study the large time behavior of Lipschitz continuous, possibly unbounded, viscosity solutions of Hamilton-Jacobi Equations in the whole space $\R^N$. The associated ergodic problem has Lipschitz continuous solutions if the analogue of…
A general time-inconsistent optimal control problem is considered for stochastic differential equations with deterministic coefficients. Under suitable conditions, a Hamilton-Jacobi-Bellman type equation is derived for the equilibrium value…
In this paper, we investigated the solvability of G-SVIEs under two cases: time-varying Lipschitz coefficients and integral-Lipschitz coefficients. Using the Picard iteration method, we established the existence and uniqueness of solutions…
In this paper, the stochastic verification theorems for stochastic control problems of reflected forward-backward stochastic differential equations are studied. We carry out the work within the frameworks of classical and viscosity…
The ergodic control problem for a non-degenerate controlled diffusion controlled through its drift is considered under a uniform stability condition that ensures the well-posedness of the associated Hamilton-Jacobi-Bellman (HJB) equation. A…
The numerical realization of the dynamic programming principle for continuous-time optimal control leads to nonlinear Hamilton-Jacobi-Bellman equations which require the minimization of a nonlinear mapping over the set of admissible…