English

Byzantine-Robust Distributed Sparse Learning Revisited

Machine Learning 2026-05-14 v1 Statistics Theory Statistics Theory

Abstract

We revisit Byzantine robust distributed estimation for high-dimensional sparse linear models. By combining local 1\ell_1-regularized robust estimation with robust aggregation at the server, the framework applies to pseudo-Huber regression, quantile regression, and sparse SVM. We show that the resulting estimators yield non-asymptotic guarantees and attain near-optimal statistical rates under mild conditions, while remaining communication-efficient. Simulations confirm strong robustness in estimation, support recovery and classification accuracy under various Byzantine attacks.

Keywords

Cite

@article{arxiv.2605.13283,
  title  = {Byzantine-Robust Distributed Sparse Learning Revisited},
  author = {Yuxuan Wang and Lixin Zhang and Kangqiang Li},
  journal= {arXiv preprint arXiv:2605.13283},
  year   = {2026}
}