Related papers: Stochastic Control with Delayed Information and Re…
In this article we consider a stochastic optimal control problem where the dynamics of the state process, $X(t)$, is a controlled stochastic differential equation with jumps, delay and \emph{noisy memory}. The term noisy memory is, to the…
This paper presents a Newton-based stochastic extremum-seeking control method for real-time optimization in multi-input systems with distinct input delays. It combines predictor-based feedback and Hessian inverse estimation via stochastic…
A general and new stochastic linear quadratic optimal control problem is studied, where the coefficients are allowed to be time-varying, and both state delay and control delay can appear simultaneously in the state equation and the cost…
In this paper, we investigate an optimal control problem governed by parabolic equations with measure-valued controls over time. We establish the well-posedness of the optimal control problem and derive the first-order optimality condition…
Here and in a follow-on paper, we consider a simple control problem in which the underlying dynamics depend on a parameter $a$ that is unknown and must be learned. In this paper, we assume that $a$ is bounded, i.e., that $|a| \le…
In this paper, we develop a theoretical framework for nonlinear stochastic optimal control problems with optimal stopping by establishing a density-based deterministic representation of the underlying diffusion. For state-independent…
In this paper, we consider the mixed optimal control of a linear stochastic system with a quadratic cost functional, with two controllers-one can choose only deterministic time functions, called the deterministic controller, while the other…
This paper considers the relaxed version of the transport problem for general nonlinear control systems, where the objective is to design time-varying feedback laws that transport a given initial probability measure to a target probability…
In this paper we develop necessary conditions for optimality, in the form of the stochastic Pontryagin maximum principle, for controlled equation with delay in the state and with control dependent noise, in the general case of controls $u…
We present existence and discrete-time approximation results on optimal control policies for continuous-time stochastic control problems under a variety of information structures. These include fully observed models, partially observed…
An optimal control problem is considered for a stochastic differential equation containing a state-dependent regime switching, with a recursive cost functional. Due to the non-exponential discounting in the cost functional, the problem is…
We introduce discontinuous solutions to nonlinear impulsive control systems with state time delays in the dynamics and derive necessary optimality conditions in the form of a Maximum Principle for associated optimal control problems. In the…
This paper presents an algorithm to apply nonlinear control design approaches in the case of stochastic systems with partial state observation. Deterministic nonlinear control approaches are formulated under the assumption of full state…
We consider a class of stochastic control problems with a delayed control, both in drift and diffusion, of the type dX t = $\alpha$ t--d (bdt + $\sigma$dW t). We provide a new characterization of the solution in terms of a set of Riccati…
This paper considers the problem of determining an optimal control action based on observed data. We formulate the problem assuming that the system can be modelled by a nonlinear state-space model, but where the model parameters, state and…
In this paper, we consider a state constrained optimal control problem governed by the transient Stokes equations. The state constraint is given by an L2 functional in space, which is required to fulfill a pointwise bound in time. The…
We consider the optimal control design problem for discrete-time LTI systems with state feedback, when the actuation signal is subject to unmeasurable switching propagation delays, due to e.g. the routing in a multi-hop communication…
In this paper, we will investigate the moment exponential stabilization of highly nonlinear hybrid stochastic differential delay equations. A periodically intermittent controller based on discrete time state observations with asynchronous…
The purpose of this paper is to provide a detailed probabilistic analysis of the optimal control of nonlinear stochastic dynamical systems of the McKean Vlasov type. Motivated by the recent interest in mean field games, we highlight the…
In this study, we propose a varying terminal time structure for the optimal control problem under state constraints, in which the terminal time follows the varying of the control via the constrained condition. Focusing on this new optimal…