Related papers: A Mean-field Stochastic Control Problem with Parti…
In this paper, we focus on a class of time-inconsistent stochastic control problems, where the objective function includes the mean and several higher-order central moments of the terminal value of state. To tackle the time-inconsistency,…
Mean field games are studied in the framework of controlled martingale problems, and general existence theorems are proven in which the equilibrium control is Markovian. The framework is flexible enough to include degenerate volatility,…
This paper presents a novel methodology to tackle feedback optimal control problems in scenarios where the exact state of the controlled process is unknown. It integrates data assimilation techniques and optimal control solvers to manage…
We study a class of optimal control problems governed by nonlinear stochastic equations of monotone type under certain coercivity and linear growth conditions. We give first order necessary conditions of optimality. A stochastic Pontryagin…
In this paper, we study a class of stochastic optimal control problem with jumps under partial information. More precisely, the controlled systems are described by a fully coupled nonlinear multi- dimensional forward-backward stochastic…
We extend Peng's maximum principle to the case of stochastic delay differential equations of mean-field type. More precisely, the coefficients of our control problem depend on the state, on the past trajectory and on its expected value.…
We study infinite-horizon stochastic optimal control problems with observable side information: a Markov chain that modulates an unknown context-conditional randomness distribution. Since this distribution is unknown, we propose a Bayesian…
This paper is concerned with the stochastic recursive optimal control problem with mixed delay. The connection between Pontryagin's maximum principle and Bellman's dynamic programming principle is discussed. Without containing any…
Focusing on stochastic systems arising in mean-field models, the systems under consideration belong to the class of switching diffusions, in which continuous dynamics and discrete events coexist and interact. The discrete events are modeled…
At present, the problem to steer a non-Markovian process with minimum energy between specified end-point marginal distributions remains unsolved. Herein, we consider the special case for a non-Markovian process y(t) which, however, assumes…
This paper investigates the stabilization and control problems for linear continuous-time mean-field systems (MFS). Under standard assumptions, necessary and sufficient conditions to stabilize the mean-field systems in the mean square sense…
In this paper, we study the maximum principle of mean field type control problems when the volatility function depends on the state and its measure and also the control, by using our recently developed method. Our method is to embed the…
We present an alternative view for the study of optimal control of partially observed Markov Decision Processes (POMDPs). We first revisit the traditional (and by now standard) separated-design method of reducing the problem to fully…
In this article, we present a general methodology for control problems driven by the Brownian motion filtration including non-Markovian and non-semimartingale state processes controlled by mutually singular measures. The main result of this…
We study a class of backward stochastic differential equations (BSDEs) driven by a random measure or, equivalently, by a marked point process. Under appropriate assumptions we prove well-posedness and continuous dependence of the solution…
We consider a control problem constrained by the unsteady stochastic Stokes equations with nonhomogeneous boundary conditions in connected and bounded domains. In this paper, controls are defined inside the domain as well as on the…
In a mean field game of controls, players seek to minimize a cost that depends on the joint distribution of players' states and controls. We consider an ergodic problem for second-order mean field games of controls with state constraints,…
In this paper, we study the generalized mean-field stochastic control problem when the usual stochastic maximum principle (SMP) is not applicable due to the singularity of the Hamiltonian function. In this case, we derive a second order…
In this review/tutorial article, we present recent progress on optimal control of partially observed Markov Decision Processes (POMDPs). We first present regularity and continuity conditions for POMDPs and their belief-MDP reductions, where…
We introduce the concept of {\it mean-field optimal control} which is the rigorous limit process connecting finite dimensional optimal control problems with ODE constraints modeling multi-agent interactions to an infinite dimensional…