Related papers: Viscosity properties with singularities in a state…
The paper deals with a Bolza optimal control problem for a dynamical system which motion is described by a delay differential equation under an initial condition defined by a piecewise continuous function. For the value functional in this…
We present a new formulation for the computation of solutions of a class of Hamilton Jacobi Bellman (HJB) equations on closed smooth surfaces of co-dimension one. For the class of equations considered in this paper, the viscosity solution…
We prove a stochastic representation formula for the viscosity solution of Dirichlet terminal-boundary value problem for a degenerate Hamilton-Jacobi-Bellman integro-partial differential equation in a bounded domain. We show that the unique…
In this paper, we explore a new class of stochastic control problems characterized by specific control constraints. Specifically, the admissible controls are subject to the ratcheting constraint, meaning they must be non-decreasing over…
We provide a dynamic programming principle for stochastic optimal control problems with expectation constraints. A weak formulation, using test functions and a probabilistic relaxation of the constraint, avoids restrictions related to a…
We extend the work on optimal investment and consumption of a population considered in [2] to a general stochastic setting over a finite time horizon. We incorporate the Cobb-Douglas production function in the capital dynamics while the…
We investigate an optimal control problem for a diffusion whose drift and running cost are merely measurable in the state variable. Such low regularity rules out the use of Pontryagin's maximum principle and also invalidates the standard…
This paper studies Hamilton-Jacobi equations of evolution type defined in a general metric space. We give a notion of a solution through optimal principles and establish a unique existence theorem of the solution for initial value problems.…
We consider an initial value problem for a Hamilton--Jacobi equation with a quadratic and degenerate Hamiltonian. Our Hamiltonian comes from the dynamics of $N$-peakon in the Camassa--Holm equation. It is given by a quadratic form with a…
We prove homogenization properties of random Hamilton-Jacobi-Bellman (HJB) equations on continuum percolation clusters, almost surely w.r.t. the law of the environment when the origin belongs to the unbounded component in the continuum.…
In optimal control problems defined on stratified domains, the dynamics and the running cost may have discontinuities on a finite union of submanifolds of RN. In [8, 5], the corresponding value function is characterized as the unique…
Unbounded stochastic control problems may lead to Hamilton-Jacobi-Bellman equations whose Hamiltonians are not always defined, especially when the diffusion term is unbounded with respect to the control. We obtain existence and uniqueness…
In this note, we demonstrate that a locally semiconvex viscosity supersolution to a possibly degenerate fully nonlinear elliptic Hamilton-Jacobi-Bellman (HJB) equation is differentiable along the directions spanned by the range of the…
We address the crucial yet underexplored stability properties of the Hamilton--Jacobi--Bellman (HJB) equation in model-free reinforcement learning contexts, specifically for Lipschitz continuous optimal control problems. We bridge the gap…
We consider a class of stochastic control problems where the state process is a probability measure-valued process satisfying an additional martingale condition on its dynamics, called measure-valued martingales (MVMs). We establish the…
We study an optimal investment and consumption problem over a finite-time horizon, in which an individual invests in a risk-free asset and a risky asset, and evaluate utility using a general utility function that exhibits loss aversion with…
Optimal control and the associated second-order path-dependent Hamilton-Jacobi-Bellman (PHJB) equation are studied for unbounded functional stochastic evolution systems in Hilbert spaces. The notion of viscosity solution without…
This paper studies the stochastic optimal control of jump-diffusion processes and the associated fully nonlinear backward stochastic Hamilton--Jacobi--Bellman (BSHJB) equations. We establish the dynamic programming principle (DPP) via…
In this paper we prove that there exists a smooth classical solution to the HJB equation for a large class of constrained problems with utility functions that are not necessarily differentiable or strictly concave. The value function is…
We consider an optimal control problem arising in the context of economic theory of growth, on the lines of the works by Skiba (1978) and Askenazy - Le Van (1999). The economic framework of the model is intertemporal infinite horizon…