Related papers: GAC, savings, and unbounded inputs
We consider the simplest optimal control problem with one nonregular mixed inequality constraint, i.e. when its gradient in the control can vanish on the zero surface. Using the Dubovitskii--Milyutin theorem on the approximate separation of…
In this paper, we extend well-known relationships between global asymptotic controllability, sample stabilizability, and the existence of a control Lyapunov function to a wide class of control systems with unbounded controls, which includes…
The long time behavior and detailed convergence analysis of Langevin equations has received increased attention over the last years. Difficulties arise from a lack of coercivity, usually termed hypocoercivity, of the underlying kinetic…
We present novel results on the solution of a class of leavable, undiscounted optimal control problems in the minimax sense for nonlinear, continuous-state, discrete-time plants. The problem class includes entry-(exit-)time problems as well…
The optimal control of problems that are constrained by partial differential equations with uncertainties and with uncertain controls is addressed. The Lagrangian that defines the problem is postulated in terms of stochastic functions, with…
This paper presents a synthesis approach aiming to guarantee a minimum upper-bound for the time taken to reach a target set of non-zero measure that encompasses the origin, while taking into account uncertainties and input and state…
We study the Hamilton-Jacobi equation for undiscounted exit time control problems with general nonnegative Lagrangians using the dynamic programming approach. We prove theorems characterizing the value function as the unique…
In this article, the sufficient Pontryagin's maximum principle for infinite horizon discounted stochastic control problem is established. The sufficiency is ensured by an additional assumption of concavity of the Hamiltonian function.…
A controller synthesis method for state- and input-constrained nonlinear systems is presented that seeks continuous piecewise affine (CPA) Lyapunov-like functions and controllers simultaneously. Non-convex optimization problems are…
The first-order optimality conditions for a generic nonlinear optimization problem are generated as part of the terminal transversality conditions of an optimal control problem. It is shown that the Lagrangian of the optimization problem is…
We deal with a singularly perturbed optimal control problem with slow and fast variable depending on a parameter {\epsilon}. We study the asymptotic, as {\epsilon} goes to 0, of the corresponding value functions, and show convergence, in…
In this paper, a characterization of the solution of impulse control problems in terms of superharmonic functions is given. In a general Markovian framework, the value function of the impulse control problem is shown to be the minimal…
We introduce a novel extension to robust control theory that explicitly addresses uncertainty in the value function's gradient, a form of uncertainty endemic to applications like reinforcement learning where value functions are…
We consider optimal control problems involving two constraint sets: one comprised of linear ordinary differential equations with the initial and terminal states specified and the other defined by the control variables constrained by simple…
We study optimal control problems governed by abstract infinite dimensional stochastic differential equations using the dynamic programming approach. In the first part, we prove Lipschitz continuity, semiconcavity and semiconvexity of the…
This paper introduces harmonic control Lyapunov barrier functions (harmonic CLBF) that aid in constrained control problems such as reach-avoid problems. Harmonic CLBFs exploit the maximum principle that harmonic functions satisfy to encode…
We consider a control problem where the system is driven by a decoupled as well as a coupled forward-backward stochastic differential equation. We prove the existence of an optimal control in the class of relaxed controls, which are…
In the paper we study the following problem: given a Hamilton-Jacobi equation where the Hamiltonian is convex with respect to the last variable, are there any optimal control problems representing it? In other words, we search for an…
This paper focuses on finding approximate solutions to stochastic optimal control problems with control domains being not necessarily convex, where the state trajectory is subject to controlled stochastic differential equations. The…
This paper presents a new control approach for guaranteed safety (remaining in a safe set) subject to actuator constraints (the control is in a convex polytope). The control signals are computed using real-time optimization, including…