Related papers: Pathwise stochastic control and a class of stochas…
We consider piecewise-deterministic optimal control problems in which the environment randomly switches among several deterministic modes, and the goal is to optimize the expected cost up to the termination while taking the likelihood of…
A new stochastic control problem of population dynamics under partial observation is formulated and analyzed both mathematically and numerically, with an emphasis on environmental and ecological problems. The decision-maker can only…
We establish a comparison principle for viscosity solutions of a class of nonlinear partial differential equations posed on the space of nonnegative finite measures, thereby extending recent results for PDEs defined on the Wasserstein space…
This paper studies a class of non$-$Markovian singular stochastic control problems, for which we provide a novel probabilistic representation. The solution of such control problem is proved to identify with the solution of a $Z-$constrained…
This paper proposes a new framework to model control systems in which a dynamic friction occurs. The model consists in a controlled differential inclusion with a discontinuous right hand side, which still preserves existence and uniqueness…
We show that the value function of a stochastic control problem is the unique solution of the associated Hamilton-Jacobi-Bellman (HJB) equation, completely avoiding the proof of the so-called dynamic programming principle (DPP). Using…
We present a method for optimal path planning of human walking paths in mountainous terrain, using a control theoretic formulation and a Hamilton-Jacobi-Bellman equation. Previous models for human navigation were entirely deterministic,…
This paper studies the stochastic optimal control of jump-diffusion processes and the associated fully nonlinear backward stochastic Hamilton--Jacobi--Bellman (BSHJB) equations. We establish the dynamic programming principle (DPP) via…
This paper addresses a continuous-time continuous-space chance-constrained stochastic optimal control (SOC) problem via a Hamilton-Jacobi-Bellman (HJB) partial differential equation (PDE). Through Lagrangian relaxation, we convert the…
We consider a stochastic optimal control problem for an heat equation with boundary noise and boundary controls. Under suitable assumptions on the coefficients, we prove existence of optimal controls in strong sense by solving the…
This paper is a review of results on Optimisation which are perhaps not so standard in the PDE realm. To this end, we consider the problem of deriving the PDEs associated to the optimal control of a system of either ODEs or SDEs with…
In this paper we introduce a new kind of Backward Stochastic Differential Equations, called ergodic BSDEs, which arise naturally in the study of optimal ergodic control. We study the existence, uniqueness and regularity of solution to…
In standard treatments of stochastic filtering one first has to estimate the values of the parameters of the model. Simply running the filter without considering the reliability of this estimate does not take into account this additional…
Optimal control of interacting particles governed by stochastic evolution equations in Hilbert spaces is an open area of research. Such systems naturally arise in formulations where each particle is modeled by stochastic partial…
We consider an infinite horizon control problem for dynamics constrained to remain on a multidimensional junction with entry costs. We derive the associated system of Hamilton-Jacobi equations (HJ), prove the comparison principle and that…
In this paper, we consider the functional It\^o calculus framework to find a path-dependent version of the Hamilton-Jacobi-Bellman equation for stochastic control problems that feature dynamics and running cost that depend on the path of…
In this paper we investigate a path dependent optimal control problem on the process space with both drift and volatility controls, with possibly degenerate volatility. The dynamic value function is characterized by a fully nonlinear second…
In Stochastic Optimal Control (SOC) one minimizes the average cost-to-go, that consists of the cost-of-control (amount of efforts), cost-of-space (where one wants the system to be) and the target cost (where one wants the system to arrive),…
We study an inverse problem of the stochastic optimal control of general diffusions with performance index having the quadratic penalty term of the control process. Under mild conditions on the system dynamics, the cost functions, and the…
In the present work we employ, for the first time, backward stochastic differential equations (BSDEs) to study the optimal control of semi-Markov processes on finite horizon, with general state and action spaces. More precisely, we prove…