Related papers: Hamilton Jacobi Bellman equations in infinite dime…
We study PDE of the form $\max\{F(D^2u,x)-f(x), H(Du)\}=0$ where $F$ is uniformly elliptic and convex in its first argument, $H$ is convex, $f$ is a given function and $u$ is the unknown. These equations are derived from dynamic programming…
This paper establishes the existence and uniqueness of mild solutions to stationary Hamilton-Jacobi-Bellman (HJB) equations associated with infinite-horizon stochastic optimal control problems in separable Hilbert spaces. Our framework…
In this paper, we introduce Hamilton-Jacobi-Bellman (HJB) equations for Q-functions in continuous time optimal control problems with Lipschitz continuous controls. The standard Q-function used in reinforcement learning is shown to be the…
Verification theorems are key results to successfully employ the dynamic programming approach to optimal control problems. In this paper we introduce a new method to prove verification theorems for infinite dimensional stochastic optimal…
It is studied the Hilbert boundary value problem for the nondegenerate Beltrami equations in domains $D$ of the complex plane $\mathbb C$ with the so--called quasihyperbolic boundary condition. It is proved the existence of solutions of…
In this paper we study the existence of sufficiently regular representations of Hamilton-Jacobi equations in the optimal control theory with unbounded control set. We use a new method to construct representations for a wide class of…
Unbounded stochastic control problems may lead to Hamilton-Jacobi-Bellman equations whose Hamiltonians are not always defined, especially when the diffusion term is unbounded with respect to the control. We obtain existence and uniqueness…
We address the crucial yet underexplored stability properties of the Hamilton--Jacobi--Bellman (HJB) equation in model-free reinforcement learning contexts, specifically for Lipschitz continuous optimal control problems. We bridge the gap…
This paper introduces a notion of viscosity solutions for second order elliptic Hamilton-Jacobi-Bellman (HJB) equations with infinite delay associated with infinite-horizon optimal control problems for stochastic differential equations with…
We study Hamiltonian flows in a real separable Hilbert space endowed with a symplectic structure. Measures on the Hilbert space that are invariant with respect to the flows of completely integrable Hamiltonian systems are investigated.…
A general time-inconsistent optimal control problem is considered for stochastic differential equations with deterministic coefficients. Under suitable conditions, a Hamilton-Jacobi-Bellman type equation is derived for the equilibrium value…
In this manuscript we consider a class optimal control problem for stochastic differential delay equations. First, we rewrite the problem in a suitable infinite-dimensional Hilbert space. Then, using the dynamic programming approach, we…
We study a family of stationary Hamilton-Jacobi-Bellman (HJB) equations in Hilbert spaces arising from stochastic optimal control problems. The main difficulties to treat such problems are: the lack of smoothing properties of the linear…
We study the properties of the value function associated with an optimal control problem with uncertainties, known as average or Riemann-Stieltjes problem. Uncertainties are assumed to belong to a compact metric probability space, and…
We propose a new approach to studying classical solutions of the Bellman equation and Master equation for mean field type control problems, using a novel form of the "lifting" idea introduced by P.-L. Lions. Rather than studying the usual…
We present a new formulation for the computation of solutions of a class of Hamilton Jacobi Bellman (HJB) equations on closed smooth surfaces of co-dimension one. For the class of equations considered in this paper, the viscosity solution…
The purpose of this article is to prove existence, uniqueness and uniform gradient estimates for unbounded classical solutions of a Hamilton-Jacobi-Bellman equation. Such an equation naturally arises in stochastic control problems. Contrary…
In this work, we consider the following two- and three-dimensional stochastic convective Brinkman-Forchheimer (SCBF) equations in torus $\mathbb{T}^d,\ d\in\{2,3\}$: \begin{align*} \mathrm{d}\boldsymbol{u}+\left[-\mu…
We determine the large-time behavior of unbounded solutions for the so-called viscous Hamilton Jacobi equation, $u_t - \Delta u + |Du|^m = f(x)$, in the quadratic and subquadratic cases (i.e., for $1<m\leq 2$), with a particular focus on…
In this paper, we are concerned with the classical solvability of a class of second-order Hamilton-Jacobi-Bellman equations (HJB equations) arising from stochastic optimal control problems with linear dynamics and uniformly convex cost…