Related papers: Optimal Control of Unbounded Stochastic Evolution …
For continuous systems modeled by dynamical equations such as ODEs and SDEs, Bellman's Principle of Optimality takes the form of the Hamilton-Jacobi-Bellman (HJB) equation, which provides the theoretical target of reinforcement learning…
This work proposes a novel numerical scheme for solving the high-dimensional Hamilton-Jacobi-Bellman equation with a functional hierarchical tensor ansatz. We consider the setting of stochastic control, whereby one applies control to a…
We study the partial differential equation max{Lu - f, H(Du)}=0 where u is the unknown function, L is a second-order elliptic operator, f is a given smooth function and H is a convex function. This is a model equation for…
In this paper, we establish some second order necessary/sufficient optimality conditions for optimal control problems of stochastic evolution equations in infinite dimensions. The control acts on both the drift and diffusion terms and the…
Autonomous systems have witnessed a rapid increase in their capabilities, but it remains a challenge for them to perform tasks both effectively and safely. The fact that performance and safety can sometimes be competing objectives renders…
We consider the value function originating from an expected utility maximization problem with finite fuel constraint and show its close relation to a nonlinear parabolic degenerated Hamilton-Jacobi-Bellman (HJB) equation with singularity.…
Viscosity solutions of fully nonlinear, local or non local, Hamilton-Jacobi equations with a super-quadratic growth in the gradient variable are proved to be H\"older continuous, with a modulus depending only on the growth of the…
The Bellman equation and its continuous-time counterpart, the Hamilton-Jacobi-Bellman (HJB) equation, serve as necessary conditions for optimality in reinforcement learning and optimal control. While the value function is known to be the…
A two-person zero-sum differential game with unbounded controls is considered. Under proper coercivity conditions, the upper and lower value functions are characterized as the unique viscosity solutions to the corresponding upper and lower…
We here consider optimal control problems governed by nonlinear stochastic equations on a Hilbert space H with nonconvex payoff, which is rewritten as a deterministic optimal control problem governed by a Kolmogorov equation in H. We prove…
We derive a new class of non-linear expectations from first-principles deterministic chaotic dynamics. The homogenization of the system's skew-adjoint microscopic generator is achieved using the spectral theory of transfer operators for…
We consider a singular control problem with regime switching that arises in problems of optimal investment decisions of cash-constrained firms. The value function is proved to be the unique viscosity solution of the associated…
This work proposes an optimal safe controller minimizing an infinite horizon cost functional subject to control barrier functions (CBFs) safety conditions. The constrained optimal control problem is reformulated as a minimization problem of…
In this paper, we study a Hamilton-Jacobi-Bellman (HJB) equation set on the Wasserstein space $\mathcal{P}_2(\mathbb{R}^d)$, with a second order term arising from a purely common noise. We do not assume that the Hamiltonian is convex in the…
We address the problem of existence and uniqueness of solutions $(c,u(\cdot))$ to ergodic Hamilton-Jacobi-Bellman (HJB) equations of the form $H(x,\nabla u(x), D^{2}u(x)) = c$ in the whole space $\mathbb{R}^{m}$ with unbounded and merely…
This paper investigates the solvability and optimal control of a class of impulsive stochastic differential equations (SDEs) within a Hilbert space setting. First, we establish the existence and uniqueness of mild solutions for the proposed…
We consider the optimal control of solutions of first order Hamilton-Jacobi equations, where the Hamiltonian is convex with linear growth. This models the problem of steering the propagation of a front by constructing an obstacle. We prove…
The paper is concerned with a class of stochastic evolution equations in Hilbert space with random coefficients driven by Teugel's martingales and an independent multi-dimensional Brownian motion and its optimal control problem. Here…
This paper is concerned with the existence of optimal controls for backward stochastic partial differential equations with random coefficients, in which the control systems are represented in an abstract evolution form, i.e. backward…
This paper presents a new methodology to craft navigation functions for nonlinear systems with stochastic uncertainty. The method relies on the transformation of the Hamilton-Jacobi-Bellman (HJB) equation into a linear partial differential…