Related papers: Viscosity Solutions to Second Order Path-Dependent…
In this paper, we introduce Hamilton-Jacobi-Bellman (HJB) equations for Q-functions in continuous time optimal control problems with Lipschitz continuous controls. The standard Q-function used in reinforcement learning is shown to be the…
We establish the existence and uniqueness of viscosity solutions within a domain $\Omega\subseteq\mathbb R^n$ for a class of equations governed by elliptic and eikonal type equations in disjoint regions. Our primary motivation stems from…
This paper develops a comparison theorem for viscosity solutions of a new class of Hamilton-Jacobi-Bellman (HJB) equations, which is used to solve the separated problem governed by the K-S equation in the Wasserstein space. A distinctive…
In this manuscript we consider a class optimal control problem for stochastic differential delay equations. First, we rewrite the problem in a suitable infinite-dimensional Hilbert space. Then, using the dynamic programming approach, we…
We give a new perspective on the existence of viscosity solutions for a stationary and a time-dependent first-order Hamilton-Jacobi equation. Following recent comparison principles, we work in a framework in which we consider a subsolution…
We consider a path-dependent Hamilton--Jacobi equation with coinvariant derivatives over the space of continuous functions. We prove two uniqueness results for viscosity (generalized) solutions defined in terms of coinvariantly smooth test…
We consider continuous-state and continuous-time control problems where the admissible trajectories of the system are constrained to remain on a union of half-planes which share a common straight line. This set will be named a junction. We…
We study a class of optimal control problems with state constraints where the state equation is a differential equation with delays. This class includes some problems arising in economics, in particular the so-called models with time to…
The aim of this work is to deal with a discontinuous Hamilton-Jacobi equation in the whole euclidian N-dimensional space, associated to a possibly unbounded optimal control problem. Here, the discontinuities are located on a hyperplane and…
In this paper, we show that the value functions of mean field control problems with common noise are the unique viscosity solutions to fully second-order Hamilton-Jacobi-Bellman equations, in a Crandall-Lions-like framework. We allow the…
Maximum entropy reinforcement learning (RL) methods have been successfully applied to a range of challenging sequential decision-making and control tasks. However, most of existing techniques are designed for discrete-time systems. As a…
We consider an initial value problem for a Hamilton--Jacobi equation with a quadratic and degenerate Hamiltonian. Our Hamiltonian comes from the dynamics of $N$-peakon in the Camassa--Holm equation. It is given by a quadratic form with a…
We study optimal control problems governed by abstract infinite dimensional stochastic differential equations using the dynamic programming approach. In the first part, we prove Lipschitz continuity, semiconcavity and semiconvexity of the…
We address the crucial yet underexplored stability properties of the Hamilton--Jacobi--Bellman (HJB) equation in model-free reinforcement learning contexts, specifically for Lipschitz continuous optimal control problems. We bridge the gap…
This paper proposes a new framework to model control systems in which a dynamic friction occurs. The model consists in a controlled differential inclusion with a discontinuous right hand side, which still preserves existence and uniqueness…
In this work, we consider the local Cahn-Hilliard-Navier-Stokes equation with regular potential in two dimensional bounded domain. We formulate distributed optimal control problem as the minimization of a suitable cost functional subject to…
We study a stochastic optimal control problem with the state constrained to a smooth, compact domain. The control influences both the drift and a possibly degenerate, control-dependent dispersion matrix, leading to a fully nonlinear,…
We prove a stochastic representation formula for the viscosity solution of Dirichlet terminal-boundary value problem for a degenerate Hamilton-Jacobi-Bellman integro-partial differential equation in a bounded domain. We show that the unique…
This paper is devoted to a viscosity solution theory of the stochastic Hamilton-Jacobi-Bellman equation in the Wasserstein spaces for the mean-field type control problem which allows for random coefficients and may thus be non-Markovian.…
Stochastic optimal control control problems with merely measurable coefficients are not well understood. In this manuscript, we consider fully non-linear stochastic optimal control problems in infinite horizon with measurable coefficients…