Related papers: Policy iteration for nonconvex viscous Hamilton--J…

This paper is concerned with the convergence rate of policy iteration for (deterministic) optimal control problems in continuous time. To overcome the problem of ill-posedness due to lack of regularity, we consider a semi-discrete scheme by…

We study policy iteration (PI) for deterministic infinite-horizon discounted optimal control problems, whose value function is characterized by a stationary Hamilton--Jacobi--Bellman (HJB) equation. At the PDE level, PI is fundamentally…

We study the policy iteration algorithm (PIA) for entropy-regularized stochastic control problems on an infinite time horizon with a large discount rate, focusing on two main scenarios. First, we analyze PIA with bounded coefficients where…

Policy iteration is a widely used technique to solve the Hamilton Jacobi Bellman (HJB) equation, which arises from nonlinear optimal feedback control theory. Its convergence analysis has attracted much attention in the unconstrained case.…

This work is devoted to the analysis of the backward problem for a viscous Hamilton-Jacobi equation with degenerate diffusion and a general Hamiltonian that is not necessarily quadratic. First, we focus on linear degenerate parabolic…

We propose a mesh-free policy iteration framework that combines classical dynamic programming with physics-informed neural networks (PINNs) to solve high-dimensional, nonconvex Hamilton--Jacobi--Isaacs (HJI) equations arising in stochastic…

We introduce a new machinery to study the large time behavior for general classes of Hamilton--Jacobi type equations, which include degenerate parabolic equations and weakly coupled systems. We establish the convergence results by using the…

In this paper we provide a rate of convergence for periodic homogenization of Hamilton-Jacobi-Bellman equations with nonlocal diffusion. The result is based on the regularity of the associated effective problem, where the convexity plays a…

We study the homogenization of first-order Hamilton-Jacobi equations on an infinite-dimensional Hilbert space, motivated by systems of infinitely many indistinguishable particles on the torus. A central difficulty is that the analysis takes…

We study the qualitative homogenization of second order viscous Hamilton-Jacobi equations in space-time stationary ergodic random environments. Assuming that the Hamiltonian is convex and superquadratic in the momentum variable (gradient)…

H{\infty} control of nonlinear continuous-time system depends on the solution of the Hamilton-Jacobi-Isaacs (HJI) equation, which has been proved impossible to obtain a closed-form solution due to the nonlinearity of HJI equation. In order…

Here, we study the periodic homogenization problem of nonlinear weakly coupled systems of Hamilton-Jacobi equations in the convex setting. We establish a rate of convergence $O(\sqrt{\varepsilon})$ which is sharp.

For a general entropy-regularized time-inconsistent stochastic control problem, we propose a policy iteration algorithm (PIA) and establish its convergence to an equilibrium policy with an exponential convergence rate. The design of the PIA…

Policy iteration (PI) is a widely used algorithm for synthesizing optimal feedback control policies across many engineering and scientific applications. When PI is deployed on infinite-horizon, nonlinear, autonomous optimal-control…

In this paper, we investigate the numerical approximation of Hamilton-Jacobi equations with the Caputo time-fractional derivative. We introduce an explicit in time discretization of the Caputo derivative and a finite difference scheme for…

Systems of Hamilton-Jacobi equations arise naturally when we study the optimal control problems with pathwise deterministic trajectories with random switching. In this work, we are interested in the large time behavior of weakly coupled…

We show that non-dominated sorting of a sequence of i.i.d. random variables in Euclidean space has a continuum limit that corresponds to solving a Hamilton-Jacobi equation involving the probability density function of the random variables.…

We present two new sharp regularity results (regularizing effect and propagation of regularity) for viscosity solutions of uniformly convex space homogeneous Hamilton-Jacobi equations. In turn, these estimates yield new intermittent…

In this paper, we establish the higher order convergence rates in periodic homogenization of viscous Hamilton-Jacobi equations, which is convex and grows quadratically in the gradient variable. We observe that although the nonlinear…

We introduce some approximation schemes for linear and fully non-linear diffusion equations of Bellman-Isaacs type. Although they are not monotone one can prove their convergence to the viscosity solution of the problem. Effective…