Related papers: On classical solutions and canonical transformatio…
In this paper we study the fully nonlinear stochastic Hamilton-Jacobi-Bellman (HJB) equation for the optimal stochastic control problem of stochastic differential equations with random coefficients. The notion of viscosity solution is…
We survey the main numerical techniques for finite-dimensional nonlinear optimal control. The chapter is written as a guide to practitioners who wish to get rapidly acquainted with the main numerical methods used to efficiently solve an…
We investigate the regularity of solutions of first order Hamilton-Jacobi equation with super linear growth in the gradient variable. We show that the solutions are locally H\"older continuous with H\"older exponent depending only on the…
We formulate a path-dependent stochastic optimal control problem under general conditions, for which weprove rigorously the dynamic programming principle and that the value function is the unique Crandall-Lions viscosity solution of the…
In this note, we demonstrate that a locally semiconvex viscosity supersolution to a possibly degenerate fully nonlinear elliptic Hamilton-Jacobi-Bellman (HJB) equation is differentiable along the directions spanned by the range of the…
We consider the numerical solution of Hamilton-Jacobi-Bellman equations arising in stochastic control theory. We introduce a class of monotone approximation schemes relying on monotone interpolation. These schemes converge under very weak…
On conformally compact manifolds of arbitrary signature, we use conformal geometry to identify a natural (and very general) class of canonical boundary problems. It turns out that these encompass and extend aspects of already known…
An example of a nonunique solution of the Cauchy problem of Hamilton-Jacobi-Bellman (HJB) equation with surprisingly regular Hamiltonian is presented. The Hamiltonian H(t,x,p) is locally Lipschitz continuous with respect to all variables,…
We consider a stochastic optimal control problem governed by a stochastic differential equation with delay in the control. Using a result of existence and uniqueness of a sufficiently regular mild solution of the associated…
Two different types of generalized solutions, namely viscosity and variational solutions, were introduced to solve the first-order evolutionary Hamilton--Jacobi equation. They coincide if the Hamiltonian is convex in the momentum variable.…
We propose a new globally convergent numerical method to solve Hamilton-Jacobi equations in $\mathbb{R}^d$, $d \geq 1$. This method is named as the Carleman convexification method. By Carleman convexification, we mean that we use a Carleman…
We propose an algorithm that produces a non-decreasing sequence of subsolutions for a class of optimal control problems distinguished by the property that the associated Bellman operators preserve convexity. In addition to a theoretical…
This paper presents an inverse optimality method to solve the Hamilton-Jacobi-Bellman equation for a class of nonlinear problems for which the cost is quadratic and the dynamics are affine in the input. The method is inverse optimal because…
In this note, we discuss a class of time-dependent Hamilton-Jacobi equations depending on a function of time, this function being chosen in order to keep the maximum of the solution to the constant value 0. The main result of the note is…
An abstract framework guaranteeing the continuous differentiability of local value functions on $H^1(\Omega)$ associated with optimal stabilization problems subject to abstract semilinear parabolic equations in the presence of norm…
We study a stochastic control problem on a bounded domain, which arises from a continuous-time optimal management model. Via the corresponding Hamilton-Jacobi-Bellman equation the value function is shown to be jointly continuous and to…
In this paper, we study singular systems with complete sets of involutive constraints. The aim is to establish, within the Hamilton-Jacobi theory, the relationship between the Frobenius' theorem, the infinitesimal canonical transformations…
Verification theorems are key results to successfully employ the dynamic programming approach to optimal control problems. In this paper we introduce a new method to prove verification theorems for infinite dimensional stochastic optimal…
We study the periodic homogenization of convex Hamilton-Jacobi equations on perforated domains with Dirichlet boundary conditions. By analyzing the optimal control representation of the solutions and the properties of the metric function…
The geometric formulation of Hamilton--Jacobi theory for systems with nonholonomic constraints is developed, following the ideas of the authors in previous papers. The relation between the solutions of the Hamilton--Jacobi problem with the…