Related papers: Relationship between MP and DPP for stochastic rec…
Several attempts to dampen the curse of dimensionnality problem of the Dynamic Programming approach for solving multistage optimization problems have been investigated. One popular way to address this issue is the Stochastic Dual Dynamic…
We study discrete-time finite-horizon optimal control problems in probability spaces, whereby the state of the system is a probability measure. We show that, in many instances, the solution of dynamic programming in probability spaces…
In this paper, we prove the necessary and sufficient maximum principles (NSMPs in short) for the optimal control of systems described by a quasilinear stochastic heat equation within convex control domains, which all the coefficients…
In this article we consider a stochastic optimal control problem where the dynamics of the state process, $X(t)$, is a controlled stochastic differential equation with jumps, delay and \emph{noisy memory}. The term noisy memory is, to the…
In this article we approach a class of stochastic reachability problems with state constraints from an optimal control perspective. Preceding approaches to solving these reachability problems are either confined to the deterministic setting…
In this paper, we study an optimal stopping problem in the presence of model uncertainty and regime switching. The max-min formulation for robust control and the dynamic programming approach are adopted to establish a general theoretical…
This paper studies the dynamic programming principle using the measurable selection method for stochastic control of continuous processes. The novelty of this work is to incorporate intermediate expectation constraints on the canonical…
In this paper, we aim to develop the theory of optimal stochastic control for branching diffusion processes where both the movement and the reproduction of the particles depend on the control. More precisely, we study the problem of…
We present a version of the stochastic maximum principle (SMP) for ergodic control problems. In particular we give necessary (and sufficient) conditions for optimality for controlled dissipative systems in finite dimensions. The strategy we…
Differential Dynamic Programming (DDP) has become a well established method for unconstrained trajectory optimization. Despite its several applications in robotics and controls however, a widely successful constrained version of the…
We consider the optimal control problem of stochastic evolution equations in a Hilbert space under a recursive utility, which is described as the solution of a backward stochastic differential equation (BSDE). A very general maximum…
In this paper, we derive sufficient and necessary maximum principles for a stochastic optimal control problem where the system state is given by a controlled stochastic differential equation with default. We prove existence of a unique…
In this work, we propose and study a new approach to formulate the optimal control problem of second-order differential equations, with a particular interest in those derived from force-controlled Lagrangian systems. The formulation results…
Determinantal point processes (DPPs) are probability models over subsets of a ground set that favor diverse selections while suppressing redundancy. That is, they tend to assign higher likelihood to collections whose elements complement one…
We consider an optimal stopping problem where a constraint is placed on the distribution of the stopping time. Reformulating the problem in terms of so-called measure-valued martingales allows us to transform the marginal constraint into an…
We develop a general theoretical framework for optimal probability density control on standard measure spaces, aimed at addressing large-scale multi-agent control problems. In particular, we establish a maximum principle (MP) for control…
We define a class of reflected backward stochastic differential equation (RBSDE) driven by a marked point process (MPP) and a Brownian motion, where the solution is constrained to stay above a given c\`adl\`ag process. The MPP is only…
In this work, we introduce a stochastic maximum principle (SMP) approach for solving the reinforcement learning problem with the assumption that the unknowns in the environment can be parameterized based on physics knowledge. For the…
We consider a general class of Dynamic Programming (DP) problems with non-separable objective functions. We show that for any problem in this class, there exists an augmented-state DP problem which satisfies the Principle of Optimality and…
In this work we introduce a viscosity-based notion of solution for general approximation schemes associated with partial differential equations, such as dynamic programming principles~(DPPs). A key feature of our approach is that it…