Related papers: Policy iteration for nonconvex viscous Hamilton--J…
The ergodic control problem for a non-degenerate controlled diffusion controlled through its drift is considered under a uniform stability condition that ensures the well-posedness of the associated Hamilton-Jacobi-Bellman (HJB) equation. A…
We study a selection problem for degenerate viscous Hamilton--Jacobi equations with convex Hamiltonians, in which the approximation procedure combines a nonlinear discounted approximation with a small potential perturbation. A key question…
Given a discounted cost, we study deterministic discrete-time systems whose inputs are generated by policy iteration (PI). We provide novel near-optimality and stability properties, while allowing for non stabilizing initial policies. That…
We propose a new probabilistic numerical scheme for fully nonlinear equation of Hamilton-Jacobi-Bellman (HJB) type associated to stochastic control problem, which is based on the Feynman-Kac representation in [12] by means of control…
In this paper we investigate the convergence of the Policy Iteration Algorithm (PIA) for a class of general continuous-time entropy-regularized stochastic control problems. In particular, instead of employing sophisticated PDE estimates for…
In this paper we establish periodic homogenization for Hamilton-Jacobi-Bellman (HJB) equations, associated to nonlocal operators of integro-differential type. We consider the case when the fractional diffusion has the same order as the…
We propose a linear finite-element discretization of Dirichlet problems for static Hamilton-Jacobi equations on unstructured triangulations. The discretization is based on simplified localized Dirichlet problems that are solved by a local…
In this work, we propose a class of numerical schemes for solving semilinear Hamilton-Jacobi-Bellman-Isaacs (HJBI) boundary value problems which arise naturally from exit time problems of diffusion processes with controlled drift. We…
We study the homogenization of nonlinear, first-order equations with highly oscillatory mixing spatio-temporal dependence. It is shown in a variety of settings that the homogenized equations are stochastic Hamilton-Jacobi equations with…
We address the problem of combined stochastic and impulse control for a market maker operating in a limit order book. The problem is formulated as a Hamilton-Jacobi-Bellman quasi-variational inequality (HJBQVI). We propose an implicit…
Continuous-time reinforcement learning offers an appealing formalism for describing control problems in which the passage of time is not naturally divided into discrete increments. Here we consider the problem of predicting the distribution…
We provide some new integral estimates for solutions to Hamilton-Jacobi equations and we discuss several consequences, ranging from $L^p$-rates of convergence for the vanishing viscosity approximation to regularizing effects for the Cauchy…
We prove that the solution of the discounted approximation of a degenerate viscous Hamilton--Jacobi equation with convex Hamiltonians converges to that of the associated ergodic problem. We characterize the limit in terms of stochastic…
Sharp temporal decay estimates are established for the gradient and time derivative of solutions to a viscous Hamilton-Jacobi equation as well the associated Hamilton-Jacobi equation. Special care is given to the dependence of the estimates…
In this paper, a non-uniform time-stepping convex-splitting numerical algorithm for solving the widely used time-fractional Cahn-Hilliard equation is introduced. The proposed numerical scheme employs the $L1^+$ formula for discretizing the…
Recently, results regarding the Inverse Design problem for Conservation Laws and Hamilton-Jacobi equations with space-dependent convex fluxes were obtaine. More precisely, characterizations of attainable sets and the set of initialdata…
In this article, we propose and study several discrete versions of homogeneous and inhomogeneous one-dimensional Fokker-Planck equations. In particular, for these discretizations of velocity and space, we prove the exponential convergence…
Here, we study quantitative homogenization of first-order convex Hamilton-Jacobi equations with $(u/\varepsilon)$-periodic Hamiltonians which typically appear in dislocation dynamics. Firstly, we establish the optimal convergence rate by…
Nondominated sorting is a discrete process that sorts points in Euclidean space according to the coordinatewise partial order, and is used to rank feasible solutions to multiobjective optimization problems. It was previously shown that…
This paper presents an implicit solution formula for the Hamilton-Jacobi partial differential equation (HJ PDE). The formula is derived using the method of characteristics and is shown to coincide with the Hopf and Lax formulas in the case…