Related papers: Mean viability theorems and second-order Hamilton-…
We study the well-posedness of Hamilton-Jacobi-Bellman equations on subsets of $\mathbb{R}^d$ in a context without boundary conditions. The Hamiltonian is given as the supremum over two parts: an internal Hamiltonian depending on an…
The global existence of martingale solutions to the compressible Navier-Stokes equations driven by stochastic external forces, with density-dependent viscosity and vacuum, is established in this paper. This work can be regarded as a…
We study existence, uniqueness and regularity properties of classical solutions to viscous Hamilton-Jacobi equations with Caputo time-fractional derivative. Our study relies on a combination of a gradient bound for the time-fractional…
The dynamic programming approach for the control of a 3D flow governed by the stochastic Navier-Stokes equations for incompressible fluid in a bounded domain is studied. By a compactness argument, existence of solutions for the associated…
We study stochastic differential equations (SDEs) whose drift and diffusion coefficients are path-dependent and controlled. We construct a value process on the canonical path space, considered simultaneously under a family of singular…
In this paper, we consider the following Hamilton-Jacobi equation with initial condition: \begin{equation*} \begin{cases} \partial_tu(x,t)+H(x,t,u(x,t),\partial_xu(x,t))=0, u(x,0)=\phi(x). \end{cases} \end{equation*} Under some assumptions…
In optimal control problems of control-affine systems, whose solutions are bang-bang or singular type, verification of optimality using the Hamilton-Jacobi-Bellman (HJB) equation involves the computation of partial derivatives of switching…
We study non-convex Hamilton-Jacobi equations in the presence of gradient constraints and produce new, optimal, regularity results for the solutions. A distinctive feature of those equations regards the existence of a lower bound to the…
For an optimal control problem of an It\^o's type stochastic differential equation, the control process could be taken as open-loop or closed-loop forms. In the standard literature, provided appropriate regularity, the value functions under…
This study introduces a mathematical framework to investigate the viability and reachability of production systems under constraints. We develop a model that incorporates key decision variables, such as pricing policy, quality investment,…
We generalize the notion of pathwise viscosity solutions, put forward by Lions and Souganidis to study fully nonlinear stochastic partial differential equations, to equations set on a sub-domain with Neumann boundary conditions. Under a…
We study the Hamilton-Jacobi equations $H(x,Du,u)=0$ in $M$ and $\partial u/\partial t +H(x,D_xu,u)=0$ in $M\times(0,\infty)$, where the Hamiltonian $H=H(x,p,u)$ depends Lipschitz continuously on the variable $u$. In the framework of the…
The Bellman equation and its continuous-time counterpart, the Hamilton-Jacobi-Bellman (HJB) equation, serve as necessary conditions for optimality in reinforcement learning and optimal control. While the value function is known to be the…
In this article we study ergodic problems in the whole space R m for viscous Hamilton-Jacobi Equations in the case of locally Lips-chitz continuous and coercive right-hand sides. We prove in particular the existence of a critical value…
This paper develops a new framework for designing and analyzing convergent finite difference methods for approximating both classical and viscosity solutions of second order fully nonlinear partial differential equations (PDEs) in 1-D. The…
This paper presents a new methodology to craft navigation functions for nonlinear systems with stochastic uncertainty. The method relies on the transformation of the Hamilton-Jacobi-Bellman (HJB) equation into a linear partial differential…
We consider a stochastic control problem with the assumption that the system is controlled until the state process breaks the fixed barrier. Assuming some general conditions, it is proved that the resulting Hamilton Jacobi Bellman equations…
We show that the value function of a stochastic control problem is the unique solution of the associated Hamilton-Jacobi-Bellman (HJB) equation, completely avoiding the proof of the so-called dynamic programming principle (DPP). Using…
This paper proposes a new framework to model control systems in which a dynamic friction occurs. The model consists in a controlled differential inclusion with a discontinuous right hand side, which still preserves existence and uniqueness…
This paper is concerned with stochastic impulse control problems in which the running cost changes depending on the impulse control. Because of such a dependence, it brings several difficulties when the usual dynamic programming principle…