Related papers: Analyzing a Maximum Principle for Finite Horizon S…
Stochastic maximum principle of nonlinear controlled forward-backward systems, where the set of strict (classical) controls need not be convex and the diffusion coefficient depends explicitly on the variable control, is an open problem…
We consider a stochastic control problem where the set of strict (classical) controls is not necessarily convex and the the variable control has two components, the first being absolutely continuous and the second singular. The system is…
We consider a class of closed loop stochastic optimal control problems in finite time horizon, in which the cost is an expectation conditional on the event that the process has not exited a given bounded domain. An important difficulty is…
This paper proposes an optimal control problem for a parabolic equation with a nonlocal nonlinearity. The system is described by a parabolic equation involving a nonlinear term that depends on the solution and its integral over the domain.…
The key element of the approach to the theory of necessary conditions in optimal control discussed in the paper is reduction of the original constrained problem to unconstrained minimization with subsequent application of a suitable…
In this paper we prove a version of the maximum principle, in the sense of Pontryagin, for the optimal control of a finite dimensional stochastic differential equation, driven by a multidimensional Wiener process. We drop the usual…
This article treats optimal sparse control problems with multiple constraints defined at intermediate points of the time domain. For such problems with intermediate constraints, we first establish a new Pontryagin maximum principle that…
Infinite horizon open loop optimal control problems for semilinear parabolic equations are investigated. The controls are subject to a cost-functional which promotes sparsity in time. The focus is put on deriving first order optimality…
We consider an optimal control problem governed by an elliptic variational inequality of the second kind. The problem is discretized by linear finite elements for the state and a variational discrete approach for the control. Based on a…
This article presents a constrained policy optimization approach for the optimal control of systems under nonstationary uncertainties. We introduce an assumption that we call Markov embeddability that allows us to cast the stochastic…
In optimal control theory, infimum gap means that there is a gap between the infimum values of a given minimum problem and an extended problem, obtained by enlarging the set of original solutions and controls. The gap phenomenon is somewhat…
We adopt an optimal-control framework for addressing the undiscounted infinite-horizon discrete-time restless $N$-armed bandit problem. Unlike most studies that rely on constructing policies based on the relaxed single-armed Markov Decision…
We present an alternative view for the study of optimal control of partially observed Markov Decision Processes (POMDPs). We first revisit the traditional (and by now standard) separated-design method of reducing the problem to fully…
We derive existence results and first order necessary optimality conditions for optimal control problems governed by quasilinear parabolic PDEs with a class of first order nonlinearities that include for instance quadratic gradient terms.…
In this article, we derive first-order necessary optimality conditions for a constrained optimal control problem formulated in the Wasserstein space of probability measures. To this end, we introduce a new notion of localised metric…
In this paper, we consider the stochastic optimal control problem for a generalized Volterra control system. The corresponding state process is a kind of a generalized stochastic Volterra integral differential equations. We prove the…
We prove a central limit theorem for a class of additive processes that arise naturally in the theory of finite horizon Markov decision problems. The main theorem generalizes a classic result of Dobrushin (1956) for temporally…
We consider the simplest optimal control problem with one nonregular mixed inequality constraint, i.e. when its gradient in the control can vanish on the zero surface. Using the Dubovitskii--Milyutin theorem on the approximate separation of…
This paper describes the structure of optimal policies for discounted periodic-review single-commodity total-cost inventory control problems with fixed ordering costs for finite and infinite horizons. There are known conditions in the…
We consider an optimal control problem for a system of local continuity equations on a space of probability measures. Such systems can be viewed as macroscopic models of ensembles of non-interacting particles or homotypic individuals,…