Related papers: Aubry set for sub-Riemannian control systems
We derive the long time asymptotic of solutions to an evolutive Hamilton-Jacobi-Bellman equation in a bounded smooth domain, in connection with ergodic problems recently studied in \cite{bcr}. Our main assumption is an appropriate…
This paper proposes an operator-theoretic framework that recasts the minimal value function of a nonlinear optimal control problem as an abstract bilinear form on a suitable function space. The resulting bilinear form is shown to satisfy an…
This paper presents a mathematical formulation to perform temporal parallelisation of continuous-time optimal control problems, which can be solved via the Hamilton--Jacobi--Bellman (HJB) equation. We divide the time interval of the control…
We study the long-run properties of optimal control problems in continuous time, where the running cost of a control problem is evaluated by a probability measure over R_+. Li, Quincampoix and Renault [DCDS-A, 2016] introduced an asymptotic…
In this paper, we deal with a minimum time problem in presence of a time delay $\tau.$ The value function of the considered optimal control problem is no longer defined in a subset of $\mathbb{R}^{n}$, as it happens in the undelayed case,…
We study the properties of the value function associated with an optimal control problem with uncertainties, known as average or Riemann-Stieltjes problem. Uncertainties are assumed to belong to a compact metric probability space, and…
We consider continuous-state and continuous-time control problems where the admissible trajectories of the system are constrained to remain on a union of half-planes which share a common straight line. This set will be named a junction. We…
We study the asymptotic behavior of the solutions to a family of discounted Hamilton Jacobi equations, posed in the Euclidean N dimensional space, when the discount factor goes to zero. The ambient space being noncompact, we introduce an…
We study a class of optimal control problems with state constraints where the state equation is a differential equation with delays. This class includes some problems arising in economics, in particular the so-called models with time to…
We study a family of optimal control problems under a set of controlled-loss constraints holding at different deterministic dates. The characterization of the associated value function by a Hamilton-Jacobi-Bellman equation usually calls for…
The Bellman equation and its continuous-time counterpart, the Hamilton-Jacobi-Bellman (HJB) equation, serve as necessary conditions for optimality in reinforcement learning and optimal control. While the value function is known to be the…
We address the problem of computing a control for a time-dependent nonlinear system to reach a target set in a minimal time. To solve this minimal time control problem, we introduce a hierarchy of linear semi-infinite programs, the values…
This paper is about operator-theoretic methods for solving nonlinear stochastic optimal control problems to global optimality. These methods leverage on the convex duality between optimally controlled diffusion processes and…
We examine the problem of two-point boundary optimal control of nonlinear systems over finite-horizon time periods with unknown model dynamics by employing reinforcement learning. We use techniques from singular perturbation theory to…
This manuscript studies the Minkowski-Bellman equation, which is the Bellman equation arising from finite or infinite horizon optimal control of unconstrained linear discrete time systems with stage and terminal cost functions specified as…
We study an ergodic problem associated to a non-local Hamilton-Jacobi equation defined on the whole space $\lambda-\mathcal{L}[u](x)+|Du(x)|^m=f(x)$ and determine whether (unbounded) solutions exist or not. We prove that there is a…
We consider the infinite horizon risk-sensitive problem for nondegenerate diffusions with a compact action space, and controlled through the drift. We only impose a structural assumption on the running cost function, namely…
Extending previuos results, we study the vanishing viscosity limit of solutions of space-time periodic Hamiltonian-Jacobi-Belllman equations, assuming that the "Aubry set" is the union of a finite number of hyperbolic periodic orbits of the…
The abelian Chern-Simons system is treated as a constrained system using the Hamilton-Jacobi approach. The equations of motion are obtained as total differential equations in many variables. It is shown that their simultaneous solutions…
We consider a class of diffusions controlled through the drift and jump size, and driven by a jump L\'evy process and a nondegenerate Wiener process, and we study infinite horizon (ergodic) risk-sensitive control problem for this model. We…