English

Communication-efficient distributed eigenspace estimation with arbitrary node failures

Machine Learning 2022-06-02 v1 Distributed, Parallel, and Cluster Computing Machine Learning Numerical Analysis Numerical Analysis

Abstract

We develop an eigenspace estimation algorithm for distributed environments with arbitrary node failures, where a subset of computing nodes can return structurally valid but otherwise arbitrarily chosen responses. Notably, this setting encompasses several important scenarios that arise in distributed computing and data-collection environments such as silent/soft errors, outliers or corrupted data at certain nodes, and adversarial responses. Our estimator builds upon and matches the performance of a recently proposed non-robust estimator up to an additive O~(σα)\tilde{O}(\sigma \sqrt{\alpha}) error, where σ2\sigma^2 is the variance of the existing estimator and α\alpha is the fraction of corrupted nodes.

Keywords

Cite

@article{arxiv.2206.00127,
  title  = {Communication-efficient distributed eigenspace estimation with arbitrary node failures},
  author = {Vasileios Charisopoulos and Anil Damle},
  journal= {arXiv preprint arXiv:2206.00127},
  year   = {2022}
}

Comments

23 pages, 1 figure