Related papers: Sensitivity analysis for HJB equations with an app…
We address the crucial yet underexplored stability properties of the Hamilton--Jacobi--Bellman (HJB) equation in model-free reinforcement learning contexts, specifically for Lipschitz continuous optimal control problems. We bridge the gap…
We investigate time-dependent mean-field games with superquadratic Hamiltonians and a power dependence on the measure. Such problems pose substantial mathematical challenges as the key techniques used in the subquadratic case do not extend…
In this paper, we are concerned with the classical solvability of a class of second-order Hamilton-Jacobi-Bellman equations (HJB equations) arising from stochastic optimal control problems with linear dynamics and uniformly convex cost…
We obtain weighted uniform estimates for the gradient of the solutions to a class of linear parabolic Cauchy problems with unbounded coefficients. Such estimates are then used to prove existence and uniqueness of the mild solution to a…
We study the approximation of parabolic Hamilton-Jacobi-Bellman (HJB) equations in bounded domains with strong Dirichlet boundary conditions. We work under the assumption of the existence of a sufficiently regular barrier function for the…
The purpose of this work is to introduce a notion of weak solution to the master equation of a potential mean field game and to prove that existence and uniqueness hold under quite general assumptions. Remarkably, this is achieved without…
We study a degenerate second order mean field game (MFG) system in a Hilbert space $H$ which couples a Fokker--Planck equation describing the evolution of probability measures on $H$ with a Hamilton--Jacobi--Bellman (HJB) equation for the…
The purpose of this article is to prove existence, uniqueness and uniform gradient estimates for unbounded classical solutions of a Hamilton-Jacobi-Bellman equation. Such an equation naturally arises in stochastic control problems. Contrary…
We consider a path-dependent Hamilton--Jacobi equation with coinvariant derivatives over the space of continuous functions. We prove two uniqueness results for viscosity (generalized) solutions defined in terms of coinvariantly smooth test…
In this paper, we provide a generalization of the forward-backward splitting algorithm for minimizing the sum of a proper convex lower semicontinuous function and a differentiable convex function whose gradient satisfies a locally…
In this work we present a formal generalization of the Hamilton-Jacobi formalism, recently developed for singular systems, to include the case of Lagrangians containing variables which are elements of Berezin algebra. We derive the…
In this paper, we introduce Hamilton-Jacobi-Bellman (HJB) equations for Q-functions in continuous time optimal control problems with Lipschitz continuous controls. The standard Q-function used in reinforcement learning is shown to be the…
In this paper we establish periodic homogenization for Hamilton-Jacobi-Bellman (HJB) equations, associated to nonlocal operators of integro-differential type. We consider the case when the fractional diffusion has the same order as the…
We study the regularity properties of integro-partial differential equations of Hamilton-Jocobi-Bellman type with terminal condition, which can be interpreted through a stochastic control system, composed of a forward and a backward…
This paper proposes a new framework to model control systems in which a dynamic friction occurs. The model consists in a controlled differential inclusion with a discontinuous right hand side, which still preserves existence and uniqueness…
Motivated by the vanishing contact problem, we study in the present paper the convergence of solutions of Hamilton-Jacobi equations depending nonlinearly on the unknown function. Let $H(x,p,u)$ be a continuous Hamiltonian which is strictly…
We provide Lipschitz regularity for solutions to viscous time-dependent Hamilton-Jacobi equations with right-hand side belonging to Lebesgue spaces. Our approach is based on a duality method, and relies on the analysis of the regularity of…
We consider a Cauchy problem for a (first-order) path-dependent Hamilton--Jacobi equation with coinvariant derivatives and a right-end boundary condition. Such problems arise naturally in the study of properties of the value functional in…
This paper is devoted to the study of fully nonlinear stochastic Hamilton-Jacobi (HJ) equations for the optimal stochastic control problem of ordinary differential equations with random coefficients. Under the standard Lipschitz continuity…
We study a Mean Field Games (MFG) system in a real, separable infinite dimensional Hilbert space. The system consists of a second order parabolic type equation, called Hamilton-Jacobi-Bellman (HJB) equation in the paper, coupled with a…