English
Related papers

Related papers: ByRDiE: Byzantine-resilient distributed coordinate…

200 papers

In this paper, we investigate the problem of distributed learning (DL) in the presence of Byzantine attacks. For this problem, various robust bounded aggregation (RBA) rules have been proposed at the central server to mitigate the impact of…

Machine Learning · Computer Science 2026-03-18 Chengxi Li , Ming Xiao , Mikael Skoglund

This paper considers a distributed optimization problem in the presence of Byzantine agents capable of introducing untrustworthy information into the communication network. A resilient distributed subgradient algorithm is proposed based on…

Optimization and Control · Mathematics 2023-03-22 Jingxuan Zhu , Yixuan Lin , Alvaro Velasquez , Ji Liu

We study a distributed computation problem in the presence of Byzantine workers where a central node wishes to solve a task that is divided into independent sub-tasks, each of which needs to be solved correctly. The distributed computation…

Information Theory · Computer Science 2025-07-23 Aayush Rajesh , Nikhil Karamchandani , Vinod M. Prabhakaran

Byzantine attacks present a critical challenge to Federated Learning (FL), where malicious participants can disrupt the training process, degrade model accuracy, and compromise system reliability. Traditional FL frameworks typically rely on…

Machine Learning · Computer Science 2025-03-17 Yufei Xia , Wenrui Yu , Qiongxiu Li

In collaborative and distributed learning, Byzantine robustness reflects a major facet of optimization algorithms. Such distributed algorithms are often accompanied by transmitting a large number of parameters, so communication compression…

Machine Learning · Computer Science 2026-04-07 Yanghao Li , Changxin Liu , Yuhao Yi

Federated learning is a newly emerging distributed learning framework that facilitates the collaborative training of a shared global model among distributed participants with their privacy preserved. However, federated learning systems are…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-14 Minghui Li , Wei Wan , Jianrong Lu , Shengshan Hu , Junyu Shi , Leo Yu Zhang , Man Zhou , Yifeng Zheng

In this paper, we investigate the problem of decentralized online resource allocation in the presence of Byzantine attacks. In this problem setting, some agents may be compromised due to external manipulations or internal failures, causing…

Optimization and Control · Mathematics 2026-05-27 Runhua Wang , Qing Ling , Hoi-To Wai , Zhi Tian

This paper considers the problem of detection in distributed networks in the presence of data falsification (Byzantine) attacks. Detection approaches considered in the paper are based on fully distributed consensus algorithms, where all of…

Systems and Control · Computer Science 2017-09-29 Bhavya Kailkhura , Swastik Brahma , Pramod K. Varshney

Byzantine-robust federated learning aims at mitigating Byzantine failures during the federated training process, where malicious participants may upload arbitrary local updates to the central server to degrade the performance of the global…

Machine Learning · Computer Science 2023-02-15 Shenghui Li , Edith C. -H. Ngai , Thiemo Voigt

Distributed optimization with open collaboration is a popular field since it provides an opportunity for small groups/companies/universities, and individuals to jointly solve huge-scale problems. However, standard optimization algorithms…

Optimization and Control · Mathematics 2023-03-09 Nikita Fedin , Eduard Gorbunov

State-of-the-art machine learning models are routinely trained on large-scale distributed clusters. Crucially, such systems can be compromised when some of the computing devices exhibit abnormal (Byzantine) behavior and return arbitrary…

Machine Learning · Computer Science 2022-01-25 Konstantinos Konstantinidis , Aditya Ramamoorthy

This paper focuses on the problem of adversarial attacks from Byzantine machines in a Federated Learning setting where non-Byzantine machines can be partitioned into disjoint clusters. In this setting, non-Byzantine machines in the same…

Machine Learning · Statistics 2023-06-02 Zhixu Tao , Kun Yang , Sanjeev R. Kulkarni

We study a framework for modeling distributed network systems assisted by a reliable and powerful cloud service. Our framework aims at capturing hybrid systems based on a point to point message passing network of machines, with the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-29 John Augustine , Jeffin Biju , Shachar Meir , David Peleg , Srikkanth Ramachandran , Aishwarya Thiruvengadam

In distributed learning, a central server trains a model according to updates provided by nodes holding local data samples. In the presence of one or more malicious servers sending incorrect information (a Byzantine adversary), standard…

Machine Learning · Computer Science 2022-08-26 Lindon Roberts , Edward Smyth

We study stochastic gradient descent (SGD) with local iterations in the presence of malicious/Byzantine clients, motivated by the federated learning. The clients, instead of communicating with the central server in every iteration, maintain…

Machine Learning · Statistics 2020-08-18 Deepesh Data , Suhas Diggavi

We study distributed optimization in the presence of Byzantine adversaries, where both data and computation are distributed among $m$ worker machines, $t$ of which may be corrupt. The compromised nodes may collaboratively and arbitrarily…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-05 Deepesh Data , Linqi Song , Suhas Diggavi

Training of large scale models on distributed clusters is a critical component of the machine learning pipeline. However, this training can easily be made to fail if some workers behave in an adversarial (Byzantine) fashion whereby they…

Machine Learning · Computer Science 2021-03-05 Konstantinos Konstantinidis , Aditya Ramamoorthy

Decentralized learning, which facilitates joint model training across geographically scattered agents, has gained significant attention in the field of signal and information processing in recent years. While the optimization errors of…

Machine Learning · Computer Science 2025-06-12 Haoxiang Ye , Tao Sun , Qing Ling

We consider unreliable distributed learning systems wherein the training data is kept confidential by external workers, and the learner has to interact closely with those workers to train a model. In particular, we assume that there exists…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-10 Lili Su , Jiaming Xu

Federated learning (FL) enables a collaborative environment for training machine learning models without sharing training data between users. This is typically achieved by aggregating model gradients on a central server. Decentralized…

Machine Learning · Computer Science 2024-07-09 Siddhartha Bhattacharya , Daniel Helo , Joshua Siegel