Related papers: Path-dependent Hamilton-Jacobi-Bellman equations r…
This paper considers linear-quadratic control of a non-linear dynamical system subject to arbitrary cost. I show that for this class of stochastic control problems the non-linear Hamilton-Jacobi-Bellman equation can be transformed into a…
In this paper, we study backward doubly stochastic recursive optimal control problem where the cost function is described by the solution of a backward doubly stochastic differential equation. We give the dynamical programming principle for…
This paper, which is the natural continuation of a previous paper by the same authors, studies a class of optimal control problems with state constraints where the state equation is a differential equation with delays. This class includes…
We consider an infinite horizon control problem for dynamics constrained to remain on a multidimensional junction with entry costs. We derive the associated system of Hamilton-Jacobi equations (HJ), prove the comparison principle and that…
This paper considers optimal control of dynamical systems which are represented by nonlinear stochastic differential equations. It is well-known that the optimal control policy for this problem can be obtained as a function of a value…
Autonomous systems have witnessed a rapid increase in their capabilities, but it remains a challenge for them to perform tasks both effectively and safely. The fact that performance and safety can sometimes be competing objectives renders…
This paper is devoted to a stochastic differential game of functional forward-backward stochastic differential equation (FBSDE, for short). The associated upper and lower value functions of the stochastic differential game are defined by…
We consider an optimal control problem for a linear stochastic integro-diffe\-rential equation with conic constraints on the phase variable and the control of singular-regular type. Our setting includes consumption-investment problems for…
We discuss a class of debt management problems in a stochastic environment model. We propose a model for the debt-to-GDP (Gross Domestic Product) ratio where the government interventions via fiscal policies affect the public debt and the…
An optimal control problem is considered for a stochastic differential equation with the cost functional determined by a backward stochastic Volterra integral equation (BSVIE, for short). This kind of cost functional can cover the general…
We prove comparison principle for viscosity solutions of a Hamilton-Jacobi-Bellman equation in a strong coupling regime considering a stationary and a time-dependent version of the equation. We consider a Hamiltonian that has a…
We exploit the separation of the filtering and control aspects of quantum feedback control to consider the optimal control as a classical stochastic problem on the space of quantum states. We derive the corresponding Hamilton-Jacobi-Bellman…
This paper studies {a} mixed singular/switching stochastic control problem for a multidimensional diffusion with multiples regimes on a bounded domain. Using probabilistic, partial differential equation (PDE) and penalization techniques, we…
An abstract framework guaranteeing the continuous differentiability of local value functions on $H^1(\Omega)$ associated with optimal stabilization problems subject to abstract semilinear parabolic equations in the presence of norm…
We address the crucial yet underexplored stability properties of the Hamilton--Jacobi--Bellman (HJB) equation in model-free reinforcement learning contexts, specifically for Lipschitz continuous optimal control problems. We bridge the gap…
This paper is devoted to a viscosity solution theory of the stochastic Hamilton-Jacobi-Bellman equation in the Wasserstein spaces for the mean-field type control problem which allows for random coefficients and may thus be non-Markovian.…
In optimal control problems defined on stratified domains, the dynamics and the running cost may have discontinuities on a finite union of submanifolds of RN. In [8, 5], the corresponding value function is characterized as the unique…
This paper introduces a new type of second order stochastic backward Hamilton-Jacobi-Bellman (HJB) equations for optimal stochastic control problems with a currently observable but non-predicable parameter process, in addition to the…
We present a method for optimal path planning of human walking paths in mountainous terrain, using a control theoretic formulation and a Hamilton-Jacobi-Bellman equation. Previous models for human navigation were entirely deterministic,…
This is the first in a series of papers in which we study an efficient approximation scheme for solving the Hamilton-Jacobi-Bellman equation for multi-dimensional problems in stochastic control theory. The method is a combination of a WKB…