Related papers: Sensitivity analysis for HJB equations with an app…
We present an adjoint sensitivity method for hybrid discrete -- continuous systems, extending previously published forward sensitivity methods. We treat ordinary differential equations and differential-algebraic equations of index up to two…
In this article, a notion of viscosity solutions is introduced for second order path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with optimal control problems for path-dependent stochastic differential equations. We…
We study a singular perturbation problem for second-order Hamilton-Jacobi equations in the Wasserstein space. Specifically, we characterize the behavior of the solutions as the perturbation parameter $\varepsilon$ tends to zero. The notion…
We demonstrate a systematic method for solving the Hamilton-Jacobi equation for general relativity with the inclusion of matter fields. The generating functional is expanded in a series of spatial gradients. Each term is manifestly…
In this article, the notion of viscosity solution is introduced for the path-dependent Hamilton-Jacobi-Bellman (PHJB) equations associated with the optimal control problems for path-dependent stochastic differential equations. We identify…
Hamilton-Jacobi (HJ) reachability analysis is an important formal verification method for guaranteeing performance and safety properties of dynamical systems; it has been applied to many small-scale systems in the past decade. Its…
It is well-known that solutions to the basic problem in the calculus of variations may fail to be Lipschitz continuous when the Lagrangian depends on t. Similarly, for viscosity solutions to time-dependent Hamilton-Jacobi equations one…
We discuss a general procedure for arriving at the Hamilton-Jacobi equation of second-class constrained systems, and illustrate it in terms of a number of examples by explicitely obtaining the respective Hamilton principal function, and…
In this paper, we show that the value functions of mean field control problems with common noise are the unique viscosity solutions to fully second-order Hamilton-Jacobi-Bellman equations, in a Crandall-Lions-like framework. We allow the…
We study a second order BDF (Backward Differentiation Formula) scheme for the numerical approximation of parabolic HJB (Hamilton-Jacobi-Bellman) equations. The scheme under consideration is implicit, non-monotone, and second order accurate…
Sensitivity analysis of multibody systems computes the derivatives of general cost functions that depend on the system solution with respect to parameters or initial conditions. This work develops adjoint sensitivity analysis for hybrid…
Recently, significant connections between compressed sensing problems and optimization of a particular class of functions relating to solutions of Hamilton-Jacobi equation was discovered. In this paper we introduce a fast approximate…
We study the Hamilton-Jacobi equations $H(x,Du,u)=0$ in $M$ and $\partial u/\partial t +H(x,D_xu,u)=0$ in $M\times(0,\infty)$, where the Hamiltonian $H=H(x,p,u)$ depends Lipschitz continuously on the variable $u$. In the framework of the…
In this paper we set up a rigorous justification for the reinitialization algorithm. Using the theory of viscosity solutions, we propose a well-posed Hamilton-Jacobi equation with a parameter, which is derived from homogenization for a…
We study Hamilton Jacobi Bellman equations in an infinite dimensional Hilbert space, with Lipschitz coefficients, where the Hamiltonian has superquadratic growth with respect to the derivative of the value function, and the final condition…
We develop a discrete analogue of Hamilton-Jacobi theory in the framework of discrete Hamiltonian mechanics. The resulting discrete Hamilton-Jacobi equation is discrete only in time. We describe a discrete analogue of Jacobi's solution and…
We consider homogenization for weakly coupled systems of Hamilton--Jacobi equations with fast switching rates. The fast switching rate terms force the solutions converge to the same limit, which is a solution of the effective equation. We…
Policy iteration is a widely used technique to solve the Hamilton Jacobi Bellman (HJB) equation, which arises from nonlinear optimal feedback control theory. Its convergence analysis has attracted much attention in the unconstrained case.…
In this paper, we study a class of zero-sum two-player stochastic differential games with the controlled stochastic differential equations and the payoff/cost functionals of recursive type. As opposed to the pioneering work by Fleming and…
We extend the stochastic Perron method to analyze the framework of stochastic target games, in which one player tries to find a strategy such that the state process almost surely reaches a given target no matter which action is chosen by…