Related papers: Sensitivity analysis for HJB equations with an app…
Maximum entropy reinforcement learning (RL) methods have been successfully applied to a range of challenging sequential decision-making and control tasks. However, most of existing techniques are designed for discrete-time systems. As a…
In this paper, we study the optimal singular controls for stochastic recursive systems, in which the control has two components: the regular control, and the singular control. Under certain assumptions, we establish the dynamic programming…
The equivalence between logarithmic Sobolev inequalities and hypercontractivity of solutions of Hamilton-Jacobi equations has been proved in [5]. We consider a semi-Lagrangian approximation scheme for the Hamilton-Jacobi equation and we…
A tensor decomposition approach for the solution of high-dimensional, fully nonlinear Hamilton-Jacobi-Bellman equations arising in optimal feedback control of nonlinear dynamics is presented. The method combines a tensor train approximation…
We propose a supervised learning scheme for the first order Hamilton--Jacobi PDEs in high dimensions. The scheme is designed by using the geometric structure of Wasserstein Hamiltonian flows via a density coupling strategy. It is…
We develop an approach for the analysis of fundamental solutions to Hamilton-Jacobi equations of contact type based on a generalized variational principle proposed by Gustav Herglotz. We also give a quantitative Lipschitz estimate on the…
This paper studies the stochastic optimal control of jump-diffusion processes and the associated fully nonlinear backward stochastic Hamilton--Jacobi--Bellman (BSHJB) equations. We establish the dynamic programming principle (DPP) via…
Recently the Hamilton-Jacobi formulation for first order constrained systems has been developed. In such formalism the equations of motion are written as total differential equations in many variables. We generalize the Hamilton-Jacobi…
We develop dynamical programming methods for the purpose of optimal control of quantum states with convex constraints and concave cost and bequest functions of the quantum state. We consider both open loop and feedback control schemes,…
As a continuation of Rabei et al. work [11], the Hamilton- Jacobi partial differential equation is generalized to be applicable for systems containing fractional derivatives. The Hamilton- Jacobi function in configuration space is obtained…
This paper introduces a new type of second order stochastic backward Hamilton-Jacobi-Bellman (HJB) equations for optimal stochastic control problems with a currently observable but non-predicable parameter process, in addition to the…
In this paper we study the effect of randomness in kinetic equations that preserve mass. Our focus is in proving the analyticity of the solution with respect to the randomness, which naturally leads to the convergence of numerical methods.…
We study the generalized conditional gradient (GCG) method for time-dependent second-order mean field games (MFG) with local coupling terms. While explicit convergence rates of the GCG method were previously established only for globally…
This paper investigates a class of multiscale stochastic control problems driven by $\alpha$-stable L\'evy noises, where the controlled dynamics evolve across separate slow and fast time scales. The associated value functions are governed…
In this paper we study the fully nonlinear stochastic Hamilton-Jacobi-Bellman (HJB) equation for the optimal stochastic control problem of stochastic differential equations with random coefficients. The notion of viscosity solution is…
The paper deals with path-dependent Hamilton-Jacobi equations with a coinvariant derivative which arise in investigations of optimal control problems and differential games for neutral-type systems in Hale's form. A viscosity (generalized)…
We give a meaning to the Hamilton--Jacobi equation arising from mean-field spin glass models in the viscosity sense, and establish the corresponding well-posedness. Originally defined on the set of monotone probability measures, these…
We consider a system of mean field games with local coupling in the deterministic limit. Under general structure conditions on the Hamiltonian and coupling, we prove existence and uniqueness of the weak solution, characterizing this…
This is a survey paper on the quantitative analysis of the propagation of singularities for the viscosity solutions to Hamilton-Jacobi equations in the past decades. We also review further applications of the theory to various fields such…
The geometric formulation of Hamilton--Jacobi theory for systems with nonholonomic constraints is developed, following the ideas of the authors in previous papers. The relation between the solutions of the Hamilton--Jacobi problem with the…