Factorized AdaBoost.MH Achieves the Same Convergence Rate as AdaBoost.MH
Abstract
AdaBoost.MH reduces multi-class classification to a collection of binary subproblems and enjoys the classical boosting-type convergence guarantee under a weak learning condition. A more structured variant, Factorized AdaBoost.MH, uses base classifiers of the form , where a single binary classifier is shared across all classes and the label dependence is carried by a vote vector . This factorization is algorithmically attractive and achieves better performance in practice, but its convergence depends on whether one can always choose a vote vector with sufficiently large induced binary weight mass. Previous work resolved this question with a lower bound , which still leaves a dimension-dependent slowdown relative to the original AdaBoost.MH analysis. In this paper, we sharpen this combinatorial step. For the minimax quantity governing the factorized edge, we prove , where for , for even , and for odd . Since , our bounds show that uniformly over and . Consequently, Factorized AdaBoost.MH achieves the same boosting-type convergence rate as AdaBoost.MH up to a universal constant factor, removing the previously suggested additional dependence on or in the number of boosting rounds.
Cite
@article{arxiv.2608.01091,
title = {Factorized AdaBoost.MH Achieves the Same Convergence Rate as AdaBoost.MH},
author = {Xin Zou and Jingyuan Xu},
journal= {arXiv preprint arXiv:2608.01091},
year = {2026}
}