English

Distributed Learning with Dependent Samples

Machine Learning 2021-11-05 v3 Distributed, Parallel, and Cluster Computing Machine Learning

Abstract

This paper focuses on learning rate analysis of distributed kernel ridge regression for strong mixing sequences. Using a recently developed integral operator approach and a classical covariance inequality for Banach-valued strong mixing sequences, we succeed in deriving optimal learning rate for distributed kernel ridge regression. As a byproduct, we also deduce a sufficient condition for the mixing property to guarantee the optimal learning rates for kernel ridge regression. Our results extend the applicable range of distributed learning from i.i.d. samples to non-i.i.d. sequences.

Keywords

Cite

@article{arxiv.2002.03757,
  title  = {Distributed Learning with Dependent Samples},
  author = {Zirui Sun and Shao-Bo Lin},
  journal= {arXiv preprint arXiv:2002.03757},
  year   = {2021}
}

Comments

17 pages, 8 figures