English

Online Multi-Agent Decentralized Byzantine-robust Gradient Estimation

Artificial Intelligence 2022-10-03 v1
Authors: Alexandre Reiffers-Masson , Isabel Amigo
View on arXiv ↗ PDF ↗

Abstract

In this paper, we propose an iterative scheme for distributed Byzantineresilient estimation of a gradient associated with a black-box model. Our algorithm is based on simultaneous perturbation, secure state estimation and two-timescale stochastic approximations. We also show the performance of our algorithm through numerical experiments.

Keywords

byzantine fault tolerance

Cite

@article{arxiv.2209.15274,
  title  = {Online Multi-Agent Decentralized Byzantine-robust Gradient Estimation},
  author = {Alexandre Reiffers-Masson and Isabel Amigo},
  journal= {arXiv preprint arXiv:2209.15274},
  year   = {2022}
}

Related papers

View all related →
Optimization and Control · Mathematics
Robust Distributed Optimization With Randomly Corrupted Gradients
Berkay Turan, Cesar A. Uribe, Hoi-To Wai, Mahnoosh Alizadeh
2022-07-27
Systems and Control · Computer Science
Finite-time Guarantees for Byzantine-Resilient Distributed State Estimation with Noisy Measurements
Lili Su, Shahin Shahrampour
2018-10-25
Machine Learning · Computer Science
Byzantine-Robust Online and Offline Distributed Reinforcement Learning
Yiding Chen, Xuezhou Zhang, Kaiqing Zhang, Mengdi Wang +1
2022-06-02
Optimization and Control · Mathematics
Resilient Distributed Optimization
Jingxuan Zhu, Yixuan Lin, Alvaro Velasquez, Ji Liu
2023-03-22
Optimization and Control · Mathematics
Byzantine-Resilient Multi-Agent Distributed Exact Optimization with Less Data
Yang Zhai, Zhi-Wei Liu, Dong Yue, Songlin Hu +1
2023-03-29
Multiagent Systems · Computer Science
Resilient Distributed Averaging
Mostafa Safi, Seyed Mehran Dibaji
2021-07-28
Systems and Control · Electrical Eng. & Systems
A Resilient Distributed Algorithm for Solving Linear Equations
Jingxuan Zhu, Alvaro Velasquez, Ji Liu
2023-04-04
Machine Learning · Computer Science
Byzantine-Robust Gossip: Insights from a Dual Approach
Renaud Gaucher, Aymeric Dieuleveut, Hadrien Hendrikx
2025-07-04
Optimization and Control · Mathematics
A Zeroth-order Resilient Algorithm for Distributed Online Optimization against Byzantine Edge Attacks
Yuhang Liu, Wenjun Mei
2025-11-10
Machine Learning · Computer Science
Byzantine Resilient Distributed Multi-Task Learning
Jiani Li, Waseem Abbas, Xenofon Koutsoukos
2021-01-11
Machine Learning · Computer Science
Byzantine Fault Tolerant Distributed Linear Regression
Nirupam Gupta, Nitin H. Vaidya
2019-04-05
Optimization and Control · Mathematics
Resilient Two-Time-Scale Local Stochastic Gradient Descent for Byzantine Federated Learning
Amit Dutta, Thinh T. Doan
2024-09-06
Machine Learning · Computer Science
Byzantine Robustness and Partial Participation Can Be Achieved at Once: Just Clip Gradient Differences
Grigory Malinovsky, Peter Richtárik, Samuel Horváth, Eduard Gorbunov
2024-06-10
Information Theory · Computer Science
Interactive Byzantine-Resilient Gradient Coding for General Data Assignments
Shreyas Jain, Luis Maßny, Christoph Hofmeister, Eitan Yaakobi +1
2024-01-31
Optimization and Control · Mathematics
On the Geometric Convergence of Byzantine-Resilient Distributed Optimization Algorithms
Kananart Kuwaranancharoen, Shreyas Sundaram
2024-12-30
Systems and Control · Computer Science
Byzantine-Resilient Distributed Observers for LTI Systems
Aritra Mitra, Shreyas Sundaram
2018-10-09
Optimization and Control · Mathematics
Byzantine-Resilient Decentralized Online Resource Allocation
Runhua Wang, Qing Ling, Hoi-To Wai, Zhi Tian
2026-05-27
Machine Learning · Computer Science
Byzantine-Robust Distributed Online Learning: Taming Adversarial Participants in An Adversarial Environment
Xingrong Dong, Zhaoxian Wu, Qing Ling, Zhi Tian
2023-12-06
Machine Learning · Computer Science
Distributed Byzantine Tolerant Stochastic Gradient Descent in the Era of Big Data
Richeng Jin, Xiaofan He, Huaiyu Dai
2019-03-08
Machine Learning · Computer Science
High Dimensional Distributed Gradient Descent with Arbitrary Number of Byzantine Attackers
Wenyu Liu, Tianqiang Huang, Pengfei Zhang, Zong Ke +2
2025-11-19
Machine Learning · Computer Science
Accelerating Byzantine-Robust Distributed Learning with Compressed Communication via Double Momentum and Variance Reduction
Yanghao Li, Changxin Liu, Yuhao Yi
2026-04-07
Distributed, Parallel, and Cluster Computing · Computer Science
Distributed Statistical Machine Learning in Adversarial Settings: Byzantine Gradient Descent
Yudong Chen, Lili Su, Jiaming Xu
2017-10-24
Optimization and Control · Mathematics
Prox-DBRO-VR: A Unified Analysis on Byzantine-Resilient Decentralized Stochastic Composite Optimization with Variance Reduction and Non-Asymptotic Convergence Rates
Jinhui Hu, Guo Chen, Huaqing Li, Xiaoyu Guo +2
2025-06-24
Machine Learning · Computer Science
Byzantine-Robust Distributed Learning: Towards Optimal Statistical Rates
Dong Yin, Yudong Chen, Kannan Ramchandran, Peter Bartlett
2021-02-26
Distributed, Parallel, and Cluster Computing · Computer Science
Efficient Byzantine-Resilient Stochastic Gradient Desce
Kaiyun Li, Xiaojun Chen, Ye Dong, Peng Zhang +2
2021-08-17
R2 v1 2026-06-28T02:26:06.655Z