English
Related papers

Related papers: Byzantine-Resilient Decentralized Online Resource …

200 papers

This paper considers the problem of Byzantine fault tolerance in distributed linear regression in a multi-agent system. However, the proposed algorithms are given for a more general class of distributed optimization problems, of which…

Machine Learning · Computer Science 2019-04-05 Nirupam Gupta , Nitin H. Vaidya

In this paper, a fully distributed averaging algorithm in the presence of adversarial Byzantine agents is proposed. The algorithm is based on a resilient retrieval procedure, where all non-Byzantine nodes send their own initial values and…

Multiagent Systems · Computer Science 2021-07-28 Mostafa Safi , Seyed Mehran Dibaji

We study a distributed computation problem in the presence of Byzantine workers where a central node wishes to solve a task that is divided into independent sub-tasks, each of which needs to be solved correctly. The distributed computation…

Information Theory · Computer Science 2025-07-23 Aayush Rajesh , Nikhil Karamchandani , Vinod M. Prabhakaran

Byzantine attacks present a critical challenge to Federated Learning (FL), where malicious participants can disrupt the training process, degrade model accuracy, and compromise system reliability. Traditional FL frameworks typically rely on…

Machine Learning · Computer Science 2025-03-17 Yufei Xia , Wenrui Yu , Qiongxiu Li

The problem of distributed optimization requires a group of agents to reach agreement on a parameter that minimizes the average of their local cost functions using information received from their neighbors. While there are a variety of…

Optimization and Control · Mathematics 2024-03-05 Kananart Kuwaranancharoen , Lei Xin , Shreyas Sundaram

We consider the problem of Byzantine fault-tolerance in the peer-to-peer (P2P) distributed gradient-descent method -- a prominent algorithm for distributed optimization in a P2P system. In this problem, the system comprises of multiple…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-01 Nirupam Gupta , Nitin H. Vaidya

Robustness to Byzantine attacks is a necessity for various distributed training scenarios. When the training reduces to the process of solving a minimization problem, Byzantine robustness is relatively well-understood. However, other…

Distributed peer-to-peer (P2P) energy trading mandates an escalating coupling between the physical power network and communication network, necessitating high-frequency sharing of real-time data among prosumers. However, this data-sharing…

Systems and Control · Electrical Eng. & Systems 2025-05-28 Junhong Liu , Qinfei Long , Rong-Peng Liu , Wenjie Liu , Yunhe Hou

In this paper, we study the problem of distributed training (DT) under Byzantine attacks with communication constraints. While prior work has developed various robust aggregation rules at the server to enhance robustness to Byzantine…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-01 Chengxi Li , Youssef Allouah , Rachid Guerraoui , Mikael Skoglund , Ming Xiao

In this paper, we study a linear bandit optimization problem in a federated setting where a large collection of distributed agents collaboratively learn a common linear bandit model. Standard federated learning algorithms applied to this…

Machine Learning · Computer Science 2022-04-05 Ali Jadbabaie , Haochuan Li , Jian Qian , Yi Tian

We consider the problem of distributed statistical machine learning in adversarial settings, where some unknown and time-varying subset of working machines may be compromised and behave arbitrarily to prevent an accurate model from being…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-24 Yudong Chen , Lili Su , Jiaming Xu

This paper aims at jointly addressing two seemly conflicting issues in federated learning: differential privacy (DP) and Byzantine-robustness, which are particularly challenging when the distributed data are non-i.i.d. (independent and…

Machine Learning · Computer Science 2022-08-03 Heng Zhu , Qing Ling

This paper jointly considers privacy preservation and Byzantine-robustness in decentralized learning. In a decentralized network, honest-but-curious agents faithfully follow the prescribed algorithm, but expect to infer their neighbors'…

Machine Learning · Computer Science 2024-10-15 Haoxiang Ye , Heng Zhu , Qing Ling

In Byzantine robust distributed or federated learning, a central server wants to train a machine learning model over data distributed across multiple workers. However, a fraction of these workers may deviate from the prescribed algorithm…

Machine Learning · Computer Science 2023-11-23 Sai Praneeth Karimireddy , Lie He , Martin Jaggi

In this paper, we propose a class of robust stochastic subgradient methods for distributed learning from heterogeneous datasets at presence of an unknown number of Byzantine workers. The Byzantine workers, during the learning process, may…

Machine Learning · Computer Science 2019-11-12 Liping Li , Wei Xu , Tianyi Chen , Georgios B. Giannakis , Qing Ling

While the last few decades have witnessed a huge body of work devoted to inference and learning in distributed and decentralized setups, much of this work assumes a non-adversarial setting in which individual nodes---apart from occasional…

Machine Learning · Statistics 2020-06-03 Zhixiong Yang , Arpita Gang , Waheed U. Bajwa

To defend against Byzantine attacks in decentralized learning, most existing methods rely on robust aggregation rules to mitigate the influence of malicious machines. However, these strategies inherently introduce bias, leading to inexact…

Methodology · Statistics 2026-04-20 Siyuan Zhang , Chengde Qian , Xin Liu , Changliang Zou

Decentralized stochastic gradient algorithms efficiently solve large-scale finite-sum optimization problems when all agents in the network are reliable. However, most of these algorithms are not resilient to adverse conditions, such as…

Optimization and Control · Mathematics 2025-06-24 Jinhui Hu , Guo Chen , Huaqing Li , Xiaoyu Guo , Liang Ran , Tingwen Huang

Decentralized learning has gained great popularity to improve learning efficiency and preserve data privacy. Each computing node makes equal contribution to collaboratively learn a Deep Learning model. The elimination of centralized…

Machine Learning · Computer Science 2021-10-22 Shangwei Guo , Tianwei Zhang , Han Yu , Xiaofei Xie , Lei Ma , Tao Xiang , Yang Liu

We study a framework for modeling distributed network systems assisted by a reliable and powerful cloud service. Our framework aims at capturing hybrid systems based on a point to point message passing network of machines, with the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-29 John Augustine , Jeffin Biju , Shachar Meir , David Peleg , Srikkanth Ramachandran , Aishwarya Thiruvengadam