Related papers: The Pontryagin Maximum Principle for Optimal Multi…
The first motivation of our paper is to explore further the idea that, in risk control problems, it may be profitable to base decisions both on the position of the underlying process Xt and on its supremum Xt := sup 0$\le$s$\le$t Xs.…
In this paper we summarize our results in infinite horizon optimal control. We present optimality conditions for weak local minimizer in the framework of weighted functions. Moreover we formulate the Pontryagin Maximum Principle for strong…
This paper is concerned with the stochastic recursive optimal control problem with mixed delay. The connection between Pontryagin's maximum principle and Bellman's dynamic programming principle is discussed. Without containing any…
This paper investigates the relationship between Pontryagin's maximum principle and dynamic programming principle in the context of stochastic optimal control systems governed by stochastic evolution equations with random coefficients in…
Reinforcement learning has traditionally focused on learning state-dependent policies to solve optimal control problems in a closed-loop fashion. In this work, we introduce the paradigm of open-loop reinforcement learning where a fixed…
In this article, the sufficient Pontryagin's maximum principle for infinite horizon discounted stochastic control problem is established. The sufficiency is ensured by an additional assumption of concavity of the Hamiltonian function.…
At the core of optimal control theory is the Pontryagin maximum principle - the celebrated first order necessary optimality condition - whose solutions are called extremals and which are obtained through a function called Hamiltonian, akin…
In this paper, we introduce an optimal control problem for multi-agent systems with non-local cost which favors simultaneous aggregation of particles. This is done introducing a time-dependent notion of multiplicity whose intrinsic…
We present a quantum optimal control problem which exhibits a chattering phenomenon. This is the first instance of such a process in quantum control. Using the Pontryagin Maximum Principle and a general procedure due to V. F. Borisov and M.…
This paper develops a Pontryagin Differentiable Programming (PDP) methodology, which establishes a unified framework to solve a broad class of learning and control tasks. The PDP distinguishes from existing methods by two novel techniques:…
Pontryagin type maximum principle and Bellman's dynamic programming principle serve as two of the most important tools in solving optimal control problems. There is a huge literature on the study of relationship between them. The main…
We study the selective and robust time-optimal rotation control of several spin-1/2 particles with different offset terms. For that purpose, the Pontryagin Maximum Principle is applied to a model of two spins, which is simple enough for…
We address Newton-type problems of minimal resistance from an optimal control perspective. It is proven that for Newton-type problems the Pontryagin maximum principle is a necessary and sufficient condition. Solutions are then computed for…
We consider the free endpoint Mayer problem for a controlled Moreau process, the control acting as a perturbation of the dynamics driven by the normal cone, and derive necessary optimality conditions of Pontryagin's Maximum Principle type.…
Our work is devoted to the study of Pontryagin's stochastic maximum principle for a mean-field optimal control problem under Peng's $G$-expectation. The dynamics of the controlled state process is given by a stochastic differential equation…
This paper presents a new condition for the existence of optimal stationary policies in average-cost continuous-time Markov decision processes with unbounded cost and transition rates, arising from controlled queueing systems. This…
This work introduces a sequential convex programming framework for non-linear, finite-dimensional stochastic optimal control, where uncertainties are modeled by a multidimensional Wiener process. We prove that any accumulation point of the…
A problem of computing time-fuel optimal control for state transfer of a single input linear time invariant (LTI) system to the origin is considered. The input is assumed to be bounded. Since, the optimal control is bang-off-bang in nature,…
A geometric method is described to characterize the different kinds of extremals in optimal control theory. This comes from the use of a presymplectic constraint algorithm starting from the necessary conditions given by Pontryagin's Maximum…
This paper studies the dynamic programming principle using the measurable selection method for stochastic control of continuous processes. The novelty of this work is to incorporate intermediate expectation constraints on the canonical…