Parallel coordinate descent for the Adaboost problem
Machine Learning
2017-04-14 v1 Optimization and Control
Machine Learning
Abstract
We design a randomised parallel version of Adaboost based on previous studies on parallel coordinate descent. The algorithm uses the fact that the logarithm of the exponential loss is a function with coordinate-wise Lipschitz continuous gradient, in order to define the step lengths. We provide the proof of convergence for this randomised Adaboost algorithm and a theoretical parallelisation speedup factor. We finally provide numerical examples on learning problems of various sizes that show that the algorithm is competitive with concurrent approaches, especially for large scale problems.
Keywords
Cite
@article{arxiv.1310.1840,
title = {Parallel coordinate descent for the Adaboost problem},
author = {Olivier Fercoq},
journal= {arXiv preprint arXiv:1310.1840},
year = {2017}
}
Comments
7 pages, 3 figures, extended version of the paper presented to ICMLA'13