English

Designing over uncertain outcomes with stochastic sampling Bayesian optimization

Machine Learning 2020-06-05 v2 Machine Learning

Abstract

Optimization is becoming increasingly common in scientific and engineering domains. Oftentimes, these problems involve various levels of stochasticity or uncertainty in generating proposed solutions. Therefore, optimization in these scenarios must consider this stochasticity to properly guide the design of future experiments. Here, we adapt Bayesian optimization to handle uncertain outcomes, proposing a new framework called stochastic sampling Bayesian optimization (SSBO). We show that the bounds on expected regret for an upper confidence bound search in SSBO resemble those of earlier Bayesian optimization approaches, with added penalties due to the stochastic generation of inputs. Additionally, we adapt existing batch optimization techniques to properly limit the myopic decision making that can arise when selecting multiple instances before feedback. Finally, we show that SSBO techniques properly optimize a set of standard optimization problems as well as an applied problem inspired by bioengineering.

Keywords

Cite

@article{arxiv.1911.02106,
  title  = {Designing over uncertain outcomes with stochastic sampling Bayesian optimization},
  author = {Peter D. Tonner and Daniel V. Samarov and A. Gilad Kusne},
  journal= {arXiv preprint arXiv:1911.02106},
  year   = {2020}
}
R2 v1 2026-06-23T12:06:48.658Z