English
Related papers

Related papers: Byzantine-Robust Learning on Heterogeneous Data vi…

200 papers

We tackle the problem of Byzantine errors in distributed gradient descent within the Byzantine-resilient gradient coding framework. Our proposed solution can recover the exact full gradient in the presence of $s$ malicious workers with a…

Information Theory · Computer Science 2024-01-31 Shreyas Jain , Luis Maßny , Christoph Hofmeister , Eitan Yaakobi , Rawad Bitar

We study distributed optimization in the presence of Byzantine adversaries, where both data and computation are distributed among $m$ worker machines, $t$ of which may be corrupt. The compromised nodes may collaboratively and arbitrarily…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-05 Deepesh Data , Linqi Song , Suhas Diggavi

This paper considers a distributed optimization problem in the presence of Byzantine agents capable of introducing untrustworthy information into the communication network. A resilient distributed subgradient algorithm is proposed based on…

Optimization and Control · Mathematics 2023-03-22 Jingxuan Zhu , Yixuan Lin , Alvaro Velasquez , Ji Liu

Byzantine-robust learning has emerged as a prominent fault-tolerant distributed machine learning framework. However, most techniques focus on the static setting, wherein the identity of Byzantine workers remains unchanged throughout the…

Machine Learning · Computer Science 2024-06-18 Ron Dorfman , Naseem Yehya , Kfir Y. Levy

Decentralized learning, which facilitates joint model training across geographically scattered agents, has gained significant attention in the field of signal and information processing in recent years. While the optimization errors of…

Machine Learning · Computer Science 2025-06-12 Haoxiang Ye , Tao Sun , Qing Ling

The problem of designing distributed optimization algorithms that are resilient to Byzantine adversaries has received significant attention. For the Byzantine-resilient distributed optimization problem, the goal is to (approximately)…

Optimization and Control · Mathematics 2024-12-30 Kananart Kuwaranancharoen , Shreyas Sundaram

Given sufficient data from multiple edge devices, federated learning (FL) enables training a shared model without transmitting private data to the central server. However, FL is generally vulnerable to Byzantine attacks from compromised…

Machine Learning · Computer Science 2025-09-18 Youngjoon Lee , Jinu Gong , Joonhyuk Kang

Federated learning (FL) facilitates distributed training across different IoT and edge devices, safeguarding the privacy of their data. The inherent distributed structure of FL introduces vulnerabilities, especially from adversarial devices…

Cryptography and Security · Computer Science 2023-11-13 Shenghui Li , Edith Ngai , Fanghua Ye , Li Ju , Tianru Zhang , Thiemo Voigt

Existing Byzantine robust aggregation mechanisms typically rely on fulldimensional gradi ent comparisons or pairwise distance computations, resulting in computational overhead that limits applicability in large scale and resource…

Cryptography and Security · Computer Science 2026-02-04 Ali Mahdavi , Santa Aghapour , Azadeh Zamanifar , Amirfarhad Farhadi

Federated learning (FL) is designed to preserve data privacy during model training, where the data remains on the client side (i.e., IoT devices), and only model updates of clients are shared iteratively for collaborative learning. However,…

Machine Learning · Computer Science 2023-09-08 Zikai Zhang , Rui Hu

Byzantine machine learning has garnered considerable attention in light of the unpredictable faults that can occur in large-scale distributed learning systems. The key to secure resilience against Byzantine machines in distributed learning…

Machine Learning · Computer Science 2024-04-02 Yuhao Yi , Ronghui You , Hong Liu , Changxin Liu , Yuan Wang , Jiancheng Lv

In decentralized machine learning, different devices communicate in a peer-to-peer manner to collaboratively learn from each other's data. Such approaches are vulnerable to misbehaving (or Byzantine) devices. We introduce F-RG, a general…

Optimization and Control · Mathematics 2025-06-12 Renaud Gaucher , Aymeric Dieuleveut , Hadrien Hendrikx

Federated Learning (FL) allows multiple clients to collaboratively train a model without sharing their private data. However, FL is vulnerable to Byzantine attacks, where adversaries manipulate client models to compromise the federated…

Cryptography and Security · Computer Science 2025-12-22 Baolei Zhang , Minghong Fang , Zhuqing Liu , Biao Yi , Peizhao Zhou , Yuan Wang , Tong Li , Zheli Liu

To study the resilience of distributed learning, the "Byzantine" literature considers a strong threat model where workers can report arbitrary gradients to the parameter server. Whereas this model helped obtain several fundamental results,…

Machine Learning · Computer Science 2022-07-22 Sadegh Farhadkhani , Rachid Guerraoui , Lê-Nguyên Hoang , Oscar Villemaud

\textit{Federated learning} (FL) is a nascent distributed learning paradigm to train a shared global model without violating users' privacy. FL has been shown to be vulnerable to various Byzantine attacks, where malicious participants could…

Cryptography and Security · Computer Science 2023-08-08 Wei Wan , Shengshan Hu , Minghui Li , Jianrong Lu , Longling Zhang , Leo Yu Zhang , Hai Jin

Detection and mitigation of Byzantine behaviors in a decentralized learning setting is a daunting task, especially when the data distribution at the users is heterogeneous. As our main contribution, we propose Basil, a fast and…

Systems and Control · Electrical Eng. & Systems 2022-10-07 Ahmed Roushdy Elkordy , Saurav Prakash , A. Salman Avestimehr

Adversarial attacks pose a major challenge to distributed learning systems, prompting the development of numerous robust learning methods. However, most existing approaches suffer from the curse of dimensionality, i.e. the error increases…

Machine Learning · Computer Science 2025-11-19 Wenyu Liu , Tianqiang Huang , Pengfei Zhang , Zong Ke , Minghui Min , Puning Zhao

Byzantine-robust Federated Learning (FL) aims to counter malicious clients and train an accurate global model while maintaining an extremely low attack success rate. Most existing systems, however, are only robust when most of the clients…

Cryptography and Security · Computer Science 2023-11-17 Rui Wang , Xingkai Wang , Huanhuan Chen , Jérémie Decouchant , Stjepan Picek , Nikolaos Laoutaris , Kaitai Liang

In distributed learning, a central server trains a model according to updates provided by nodes holding local data samples. In the presence of one or more malicious servers sending incorrect information (a Byzantine adversary), standard…

Machine Learning · Computer Science 2022-08-26 Lindon Roberts , Edward Smyth

Federated Learning (FL) enables decentralized model training without sharing raw data. However, it remains vulnerable to Byzantine attacks, which can compromise the aggregation of locally updated parameters at the central server.…

Machine Learning · Computer Science 2025-09-30 Shiyuan Zuo , Rongfei Fan , Cheng Zhan , Jie Xu , Puning Zhao , Han Hu