Related papers: Controllability concepts for mean-field dynamics w…
The discrete-time implementation of the super-twisting sliding mode controller for a plant with disturbances with bounded slope, zero-order hold actuation, and actuator constraints is considered. Motivated by restrictions of existing…
The purpose of this paper is to establish the first and second order necessary conditions for stochastic optimal controls in infinite dimensions. The control system is governed by a stochastic evolution equation, in which both drift and…
We address the problem of controllability of the MHD system in a rectangular domain with a control prescribed on the side boundary. We identify a necessary and sufficient condition on the data to be null controllable, i.e., can be driven to…
We study stochastic differential equations (SDEs) whose drift and diffusion coefficients are path-dependent and controlled. We construct a value process on the canonical path space, considered simultaneously under a family of singular…
Stochastic differential equations (SDEs) are a ubiquitous modeling framework that finds applications in physics, biology, engineering, social science, and finance. Due to the availability of large-scale data sets, there is growing interest…
This paper explores a class of fully coupled nonlinear forward-backward stochastic difference equations (FBS$\Delta$Es). Building on insights from linear quadratic optimal control problems, we introduce a more relaxed framework of…
We establish existence of controlled Markov chain of mean-field type with unbounded jump intensities by means of a fixed point argument using the Wasserstein distance. Using a Markov chain entropic backward SDE approach, we further suggest…
In this paper we model the role of a government of a large population as a mean field optimal control problem. Such control problems are constrainted by a PDE of continuity-type, governing the dynamics of the probability distribution of the…
In this paper, we continue the study of some controllability issues for the forward stochastic heat equation with dynamic boundary conditions. The main novelty in the present paper consists of considering only one control without extra…
Controllability -- the possibility of performing any target dynamics by applying a set of available operations -- is a fundamental requirement for the practical use of any physical system. For finite-dimensional systems, as for instance…
We derive a framework to compute optimal controls for problems with states in the space of probability measures. Since many optimal control problems constrained by a system of ordinary differential equations (ODE) modelling interacting…
We propose a new approach to studying classical solutions of the Bellman equation and Master equation for mean field type control problems, using a novel form of the "lifting" idea introduced by P.-L. Lions. Rather than studying the usual…
This paper, the second of a two-part series, presents a method for mean-field feedback stabilization of a swarm of agents on a finite state space whose time evolution is modeled as a continuous time Markov chain (CTMC). The resulting…
The well-posedness of a multi-population dynamical system with an entropy regularization and its convergence to a suitable mean-field approximation are proved, under a general set of assumptions. Under further assumptions on the evolution…
We are interested in understanding stability (almost sure boundedness) of stochastic approximation algorithms (SAs) driven by a `controlled Markov' process. Analyzing this class of algorithms is important, since many reinforcement learning…
For abstract linear systems in Hilbert spaces we revisit the problems of exact controllability and complete stabilizability (stabilizability with an arbitrary decay rate), the latter property is equivalent to exact null controllability. We…
We study risk-sensitive optimal control of a stochastic differential equation (SDE) of mean-field type, where the coefficients are allowed to depend on some functional of the law as well as the state and control processes. Moreover the…
This paper presents the concepts of exact, null, and approximate controllability in the Stackelberg-Nash sense for abstract forward and backward stochastic evolution equations, involving two types of controls: leaders and followers. We…
One proves that the $n$-D stochastic controlled equation $dX+AXdt=\sigma(X)dW+Bu\,dt$, where $\sigma\in\mbox{Lip}((\R^n,\L(\R^d,\R^n))$ and the pair $A\in\L(\R^n)$, $B\in\L(\R^m,\R^n)$ satisfies the Kalman rank condition, is exactly…
We consider a stochastic control problem for a class of nonlinear kernels. More precisely, our problem of interest consists in the optimisation, over a set of possibly non-dominated probability measures, of solutions of backward stochastic…