Related papers: Set-valued Hamilton-Jacobi-Bellman Equations
We present a method for optimal coordination of multiple vehicle teams when multiple endpoint configurations are equally desirable, such as seen in the autonomous assembly of formation flight. The individual vehicles' positions in the…
In this paper, we mainly focus on the set-valued (stochastic) analysis on the space of convex, closed, but possibly unbounded sets, and try to establish a useful theoretical framework for studying the set-valued stochastic differential…
We study stochastic differential equations (SDEs) whose drift and diffusion coefficients are path-dependent and controlled. We construct a value process on the canonical path space, considered simultaneously under a family of singular…
In this paper we consider a family of optimal control problems for economic models whose state variables are driven by Delay Differential Equations (DDE's). We consider two main examples: an AK model with vintage capital and an advertising…
This work investigates the optimal control problem for reflected McKean-Vlasov SDEs and the viscosity solutions to Hamilton-Jacobi-Bellman(HJB) equations on the Wasserstein space in terms of intrinsic derivative. It follows from the flow…
We study the loss, recovery, and preservation of differentiability of time-dependent large deviation rate functions. This study is motivated by mean-field Gibbs-non-Gibbs transitions. The gradient of the rate-function evolves according to a…
We study a stochastic optimal control problem for a partially observed diffusion. By using the control randomization method in [4], we prove a corresponding randomized dynamic programming principle (DPP) for the value function, which is…
We formulate and analyze a new method for solving optimal control problems for systems governed by Volterra integral equations. Our method utilizes discretization of the original Volterra controlled system and a novel type of dynamic…
Designing optimal controllers for nonlinear dynamical systems often relies on reinforcement learning and adaptive dynamic programming (ADP) to approximate solutions of the Hamilton Jacobi Bellman (HJB) equation. However, these methods…
Hamilton-Jacobi (HJ) reachability analysis is an important formal verification method for guaranteeing performance and safety properties of dynamical systems; it has been applied to many small-scale systems in the past decade. Its…
The control function approach allows the researcher to identify various causal effects of interest. While powerful, it requires a strong invertibility assumption in the selection process, which limits its applicability. This paper expands…
We consider a finite-time stochastic drift control problem with the assumption that the control is bounded and the system is controlled until the state process leaves the half-line. Assuming general conditions, it is proved that the…
Functions with uniform sublevel sets can represent orders, preference relations or other binary relations and thus turn out to be a tool for scalarization that can be used in multicriteria optimization, decision theory, mathematical…
In this brief paper, we consider the problem of minimizing the asymptotic exit rate of diffusion processes from an open connected bounded set pertaining to a multi-channel system with small random perturbations. Specifically, we establish a…
A class of nonlinear problems on the plane, described by nonlinear inhomogeneous $\bar{\partial}$-equations, is considered. It is shown that the corresponding dynamics, generated by deformations of inhomogeneous terms (sources) is described…
A deep learning approach for the approximation of the Hamilton-Jacobi-Bellman partial differential equation (HJB PDE) associated to the Nonlinear Quadratic Regulator (NLQR) problem. A state-dependent Riccati equation control law is first…
From the Hamilton-Jacobi-Bellman equation for the value function we derive a non-linear partial differential equation for the optimal portfolio strategy (the dynamic control). The equation is general in the sense that it does not depend on…
This paper is devoted to studying the Hamilton-Jacobi-Bellman equations with distribution-valued coefficients, which is not well-defined in the classical sense and shall be understood by using paracontrolled distribution method introduced…
Optimal control and the associated second-order Hamilton-Jacobi-Bellman (HJB) equation are studied for unbounded stochastic evolution systems in Hilbert spaces. A new notion of viscosity solution, featured by absence of B-continuity, is…
We consider a singular control problem with regime switching that arises in problems of optimal investment decisions of cash-constrained firms. The value function is proved to be the unique viscosity solution of the associated…