Related papers: Relationship between maximum principle and dynamic…
Stochastic maximum principle (SMP) specifies a necessary condition for the solution of a stochastic optimal control problem. The condition involves a coupled system of forward and backward stochastic differential equations (FBSDE) for the…
We study a control problem where the state equation is a nonlinear partial differential equation of the calculus of variation in a bounded domain, perturbed by noise. We allow the control to act on the boundary and set stochastic boundary…
We prove a stochastic maximum principle ofPontryagin's type for the optimal control of a stochastic partial differential equationdriven by white noise in the case when the set of control actions is convex. Particular attention is paid to…
In this paper, we propose a new policy iteration algorithm to compute the value function and the optimal controls of continuous time stochastic control problems. The algorithm relies on successive approximations using linear-quadratic…
We analyze a novel class of rough stochastic control problems that allows for a convenient approach to solving pathwise stochastic control problems with both non-anticipative and anticipative controls. We first establish the well-posedness…
Wind farms can increase annual energy production (AEP) with advanced control algorithms by coordinating the set points of individual turbine controllers across the farm. However, it remains a significant challenge to achieve performance…
We consider the utility maximization problem under convex constraints with regard to theoretical results which allow the formulation of algorithmic solvers which make use of deep learning techniques. In particular for the case of random…
We analyze the problem of stochastic optimal control of SDEs where the driver includes a self-exciting stochastic process. Due to the non-Markovian nature of the problem, we apply the stochastic maximum principle approach. We derive a…
We consider stochastic dynamic programming problems with high-dimensional, discrete state-spaces and finite, discrete-time horizons that prohibit direct computation of the value function from a given Bellman equation for all states and time…
This paper introduces a new recursive stochastic optimal control problem driven by a forward-backward stochastic differential equations (FBSDEs), where the ter?minal time varies according to the constraints of the state of the forward…
In this paper we develop necessary conditions for optimality, in the form of the stochastic Pontryagin maximum principle, for controlled equations with pointwise delay in the state and with control dependent noise, in the general case of…
We consider the approximation of some optimal control problems for the Navier-Stokes equation via a Dynamic Programming approach. These control problems arise in many industrial applications and are very challenging from the numerical point…
We generalize a Maximum Principle for optimal control problems involving sweeping systems previously derived in ``Necessary conditions for optimal control problems with sweeping systems and end point constraints'', by de Pinho, Ferreira and…
This work introduces a sequential convex programming framework for non-linear, finite-dimensional stochastic optimal control, where uncertainties are modeled by a multidimensional Wiener process. We prove that any accumulation point of the…
Dual control denotes a class of control problems where the parameters governing the system are imperfectly known. The challenge is to find the optimal balance between probing, i.e. exciting the system to understand it more, and caution,…
We consider a stochastic control problem which is composed of a controlled stochastic differential equation, and whose associated cost functional is defined through a controlled backward stochastic differential equation. Under appropriate…
The paper introduces the first formulation of convex Q-learning for Markov decision processes with function approximation. The algorithms and theory rest on a relaxation of a dual of Manne's celebrated linear programming characterization of…
In this paper, we consider the stochastic optimal control problems under model risk caused by uncertain volatilities. To have a mathematical consistent framework we use the notion of G-expectation and its corresponding G-Brwonian motion…
In this paper, we study a discrete-time stochastic optimal control problem under distribution uncertainty with convex control domain. By weak convergence method and Sion's minimax theorem, we obtain the variational inequality for cost…
This paper is concerned with impulse approximate controllability for stochastic evolution equations with impulse controls. As direct applications, we formulate captivating minimal norm and time optimal control problems; The minimal norm…