English

HJB equations for certain singularly controlled diffusions

Probability 2007-11-06 v1

Abstract

Given a closed, bounded convex set WRd\mathcal{W}\subset{\mathbb {R}}^d with nonempty interior, we consider a control problem in which the state process WW and the control process UU satisfy Wt=w0+0tϑ(Ws)ds+0tσ(Ws)dZs+GUtW,t0,W_t= w_0+\int_0^t\vartheta(W_s) ds+\int_0^t\sigma(W_s) dZ_s+GU_t\in \mathcal{W},\qquad t\ge0, where ZZ is a standard, multi-dimensional Brownian motion, ϑ,σC0,1(W)\vartheta,\sigma\in C^{0,1}(\mathcal{W}), GG is a fixed matrix, and w0Ww_0\in\mathcal{W}. The process UU is locally of bounded variation and has increments in a given closed convex cone URp\mathcal{U}\subset{\mathbb{R}}^p. Given gC(W)g\in C(\mathcal{W}), κRp\kappa\in{\mathbb{R}}^p, and α>0\alpha>0, consider the objective that is to minimize the cost J(w0,U)E[0eαsg(Ws)ds+[0,)eαsd(κUs)]J(w_0,U)\doteq\mathbb{E}\biggl[\int_0^{\infty}e^{-\alpha s}g(W_s) ds+\int_{[0,\infty)}e^{-\alpha s} d(\kappa\cdot U_s)\biggr] over the admissible controls UU. Both gg and κu\kappa\cdot u (uUu\in\mathcal{U}) may take positive and negative values. This paper studies the corresponding dynamic programming equation (DPE), a second-order degenerate elliptic partial differential equation of HJB-type with a state constraint boundary condition. Under the controllability condition GU=RdG\mathcal{U}={\mathbb{R}}^d and the finiteness of H(q)=supuU1{Guqκu}\mathcal{H}(q)=\sup_{u\in\mathcal{U}_1}\{-Gu\cdot q-\kappa\cdot u\}, qRdq\in {\mathbb{R}}^d, where U1={uU:Gu=1}\mathcal{U}_1=\{u\in\mathcal{U}:|Gu|=1\}, we show that the cost, that involves an improper integral, is well defined. We establish the following: (i) the value function for the control problem satisfies the DPE (in the viscosity sense), and (ii) the condition infqRdH(q)<0\inf_{q\in{\mathbb{R}}^d}\mathcal{H}(q)<0 is necessary and sufficient for uniqueness of solutions to the DPE. The existence and uniqueness of solutions are shown to be connected to an intuitive ``no arbitrage'' condition. Our results apply to Brownian control problems that represent formal diffusion approximations to control problems associated with stochastic processing networks.

Keywords

Cite

@article{arxiv.0711.0641,
  title  = {HJB equations for certain singularly controlled diffusions},
  author = {Rami Atar and Amarjit Budhiraja and Ruth J. Williams},
  journal= {arXiv preprint arXiv:0711.0641},
  year   = {2007}
}

Comments

Published in at http://dx.doi.org/10.1214/07-AAP443 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)

R2 v1 2026-06-21T09:39:52.611Z