Related papers: On Lipschitz continuity of value functions for inf…
A class of infinite horizon optimal control problems involving $L^p$-type cost functionals with $0<p\leq 1$ is discussed. The existence of optimal controls is studied for both the convex case with $p=1$ and the nonconvex case with $0<p<1$,…
This paper addresses an open problem in the area of linear quadratic optimal control. We consider the regular, infinite-horizon, stability-modulo-a-subspace, indefinite linear quadratic problem under the assumption that the dynamics are…
Decision processes with incomplete state feedback have been traditionally modeled as Partially Observable Markov Decision Processes. In this paper, we present an alternative formulation based on probabilistic regular languages. The proposed…
In this paper, we discuss a new general formulation of fractional optimal control problems whose performance index is in the fractional integral form and the dynamics are given by a set of fractional differential equations in the Caputo…
An optimal control problem for a semilinear elliptic equation of divergence form is considered. Both the leading term and the semilinear term of the state equation contain the control. The well-known Pontryagin type maximum principle for…
In this paper, we perform sensitivity analysis for the maximal value function which is the optimal value function for a parametric maximization problem. Our aim is to study various subdifferentials for the maximal value function. We obtain…
Time optimal control problems for some non-smooth systems in general form are considered. The non-smoothness is caused by singularity. It is proved that Pontryagin's maximum principle holds for at least one optimal relaxed control. Thus,…
A learning technique for finite horizon optimal control problems and its approximation based on polynomials is analyzed. It allows to circumvent, in part, the curse dimensionality which is involved when the feedback law is constructed by…
An optimal control problem with an infinite horizon quadratic cost functional for a linear system with a known additive disturbance is considered. The feature of this problem is that a weight matrix of the control cost in the cost…
In this paper, we consider discrete-time infinite horizon problems of optimal control to a terminal set of states. These are the problems that are often taken as the starting point for adaptive dynamic programming. Under very general…
In this paper, we consider the infinite horizon optimal control problem for nonlinear systems. Under the conditions of controllability of the linearized system around the origin, and nonlinear controllability of the system to a terminal set…
We develop a rigorous framework for global non-convex optimization by reformulating the minimization problem as a discounted infinite-horizon optimal control problem. For non-convex, continuous, and possibly non-smooth objective functions…
The present paper considers a stochastic optimal control problem, in which the cost function is defined through a backward stochastic differential equation with infinite horizon driven by G-Brownian motion. Then we study the regularities of…
We consider a stochastic control problem where the set of strict (classical) controls is not necessarily convex and the the variable control has two components, the first being absolutely continuous and the second singular. The system is…
Consider a bounded open set $U$ in $R^n$ and a Lipschitz function g from the boundary of $U$ to $R^m$. Does this function always have a canonical optimal Lipschitz extension to all of $U$? We propose a notion of optimal Lipschitz extension…
We consider an optimal stochastic impulse control problem over an infinite time horizon motivated by a model of irreversible investment choices with fixed adjustment costs. By employing techniques of viscosity solutions and relying on…
Let $T>0$ fixed. We consider the optimal control problem for analytic affine systems: $\ds{\dot{x}=f\_0(x)+\sum\_{i=1}^m u\_if\_i(x)}$, with a cost of the form: $\ds{C(u)=\int\_0^T \sum\_{i=1}^m u\_i^2(t)dt}$. For this kind of systems we…
An optimal control problem in the space of probability measures, and the viscosity solutions of the corresponding dynamic programming equations defined using the intrinsic linear derivative are studied. The value function is shown to be…
As is well known, average-cost optimality inequalities imply the existence of stationary optimal policies for Markov Decision Processes with average costs per unit time, and these inequalities hold under broad natural conditions. This paper…
We consider the stability of Robust Optimization problems with respect to perturbations in their uncertainty sets. We focus on Linear Optimization problems, including those with a possibly infinite number of constraints, also known as…