English

BanditLP: Large-Scale Stochastic Optimization for Personalized Recommendations

Machine Learning 2026-01-23 v1 Artificial Intelligence Machine Learning

Abstract

We present BanditLP, a scalable multi-stakeholder contextual bandit framework that unifies neural Thompson Sampling for learning objective-specific outcomes with a large-scale linear program for constrained action selection at serving time. The methodology is application-agnostic, compatible with arbitrary neural architectures, and deployable at web scale, with an LP solver capable of handling billions of variables. Experiments on public benchmarks and synthetic data show consistent gains over strong baselines. We apply this approach in LinkedIn's email marketing system and demonstrate business win, illustrating the value of integrated exploration and constrained optimization in production.

Keywords

Cite

@article{arxiv.2601.15552,
  title  = {BanditLP: Large-Scale Stochastic Optimization for Personalized Recommendations},
  author = {Phuc Nguyen and Benjamin Zelditch and Joyce Chen and Rohit Patra and Changshuai Wei},
  journal= {arXiv preprint arXiv:2601.15552},
  year   = {2026}
}
R2 v1 2026-07-01T09:15:04.481Z