English

Optimal adaptive control with separable drift uncertainty

Optimization and Control 2023-11-13 v2 Analysis of PDEs Probability

Abstract

We consider a problem of stochastic optimal control with separable drift uncertainty in strong formulation on a finite horizon. The drift coefficient of the state YuY^{u} is multiplicatively influenced by an unknown random variable λ\lambda, while admissible controls uu are required to be adapted to the observation filtration. Choosing a control actively influences the state and information acquisition simultaneously and comes with a learning effect. The problem, initially non-Markovian, is embedded into a higher-dimensional Markovian, full information control problem with control-dependent filtration and noise. To that problem, we apply the stochastic Perron method to characterize the value function as the unique viscosity solution to the HJB equation, explicitly construct ε\varepsilon-optimal controls and show that the values of strong and weak formulations agree. Numerical illustrations show a significant difference between the adaptive control and the certainty equivalence control.

Keywords

Cite

@article{arxiv.2309.07091,
  title  = {Optimal adaptive control with separable drift uncertainty},
  author = {Samuel N. Cohen and Christoph Knochenhauer and Alexander Merkel},
  journal= {arXiv preprint arXiv:2309.07091},
  year   = {2023}
}
R2 v1 2026-06-28T12:20:31.645Z