English

Beyond $\mathcal{O}(\sqrt{T})$ Regret: Decoupling Learning and Decision-making in Online Linear Programming

Machine Learning 2025-01-07 v1 Machine Learning Optimization and Control

Abstract

Online linear programming plays an important role in both revenue management and resource allocation, and recent research has focused on developing efficient first-order online learning algorithms. Despite the empirical success of first-order methods, they typically achieve a regret no better than O(T)\mathcal{O} ( \sqrt{T} ), which is suboptimal compared to the O(logT)\mathcal{O} (\log T) bound guaranteed by the state-of-the-art linear programming (LP)-based online algorithms. This paper establishes a general framework that improves upon the O(T)\mathcal{O} ( \sqrt{T} ) result when the LP dual problem exhibits certain error bound conditions. For the first time, we show that first-order learning algorithms achieve o(T)o( \sqrt{T} ) regret in the continuous support setting and O(logT)\mathcal{O} (\log T) regret in the finite support setting beyond the non-degeneracy assumption. Our results significantly improve the state-of-the-art regret results and provide new insights for sequential decision-making.

Keywords

Cite

@article{arxiv.2501.02761,
  title  = {Beyond $\mathcal{O}(\sqrt{T})$ Regret: Decoupling Learning and Decision-making in Online Linear Programming},
  author = {Wenzhi Gao and Dongdong Ge and Chenyu Xue and Chunlin Sun and Yinyu Ye},
  journal= {arXiv preprint arXiv:2501.02761},
  year   = {2025}
}

Comments

Extension of conference submission https://proceedings.mlr.press/v235/gao24n.html

R2 v1 2026-06-28T20:57:11.281Z