English
Related papers

Related papers: Byzantine-resilient Decentralized Stochastic Gradi…

200 papers

This paper considers the problem of detection in distributed networks in the presence of data falsification (Byzantine) attacks. Detection approaches considered in the paper are based on fully distributed consensus algorithms, where all of…

Systems and Control · Computer Science 2017-09-29 Bhavya Kailkhura , Swastik Brahma , Pramod K. Varshney

This paper studies the Byzantine Agreement problem where the nodes have access to a predictor that flags nodes for suspicion of faulty (Byzantine) behavior. We focus on algorithmic resilience -- the maximum number of faulty nodes an…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-20 Julien Dallot , Darya Melnyk , Tijana Milentijevic , Stefan Schmid , Patrik Welters

Byzantine agreement is a fundamental problem in fault-tolerant distributed computing that has been studied intensively for the last four decades. Much of the research has focused on a static Byzantine adversary, where the adversary is…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-06 Fabien Dufoulon , Gopal Pandurangan

We study stochastic gradient descent (SGD) with local iterations in the presence of malicious/Byzantine clients, motivated by the federated learning. The clients, instead of communicating with the central server in every iteration, maintain…

Machine Learning · Statistics 2020-08-18 Deepesh Data , Suhas Diggavi

Byzantine fault tolerance (BFT) has been extensively studied in distributed trustless systems to guarantee system's functioning when up to 1/3 Byzantine processes exist. Despite a plethora of previous work in BFT systems, they are mainly…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-11 Quan Nguyen , Andre Cronje

Due to the widespread availability of data, machine learning (ML) algorithms are increasingly being implemented in distributed topologies, wherein various nodes collaborate to train ML models via the coordination of a central server.…

Machine Learning · Computer Science 2023-12-15 Antoine Choffrut , Rachid Guerraoui , Rafael Pinot , Renaud Sirdey , John Stephan , Martin Zuber

Byzantine agreement algorithms typically assume implicit initial state consistency and synchronization among the correct nodes and then operate in coordinated rounds of information exchange to reach agreement based on the input values. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-08-04 Ariel Daliot , Danny Dolev

Federated learning (FL) is a privacy-friendly type of machine learning where devices locally train a model on their private data and typically communicate model updates with a server. In decentralized FL (DFL), peers communicate model…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-22 Joost Verbraeken , Martijn de Vos , Johan Pouwelse

Byzantine-robust distributed optimization relies on robust aggregation rules to mitigate the influence of malicious Byzantine workers. Despite the proliferation of such rules, a unified convergence analysis framework that accommodates…

Optimization and Control · Mathematics 2026-04-14 Boyuan Ruan , Xiaoyu Wang , Ya-Feng Liu

Federated Learning (FL) allows collaborative model training across distributed clients without sharing raw data, thus preserving privacy. However, the system remains vulnerable to privacy leakage from gradient updates and Byzantine attacks…

Cryptography and Security · Computer Science 2025-09-16 Xian Qin , Xue Yang , Xiaohu Tang

Due to the use of commodity software and hardware, crash-stop and Byzantine failures are likely to be more prevalent in today's large-scale distributed storage systems. Regenerating codes have been shown to be a more efficient way to…

Information Theory · Computer Science 2011-08-22 Yunghsiang S. Han , Rong Zheng , Wai Ho Mow

Federated Learning (FL) allows multiple clients to collaboratively train a model without sharing their private data. However, FL is vulnerable to Byzantine attacks, where adversaries manipulate client models to compromise the federated…

Cryptography and Security · Computer Science 2025-12-22 Baolei Zhang , Minghong Fang , Zhuqing Liu , Biao Yi , Peizhao Zhou , Yuan Wang , Tong Li , Zheli Liu

This paper proposes a Robust Gradient Classification Framework (RGCF) for Byzantine fault tolerance in distributed stochastic gradient descent. The framework consists of a pattern recognition filter which we train to be able to classify…

Machine Learning · Computer Science 2023-01-19 Shashank Reddy Chirra , Kalyan Varma Nadimpalli , Shrisha Rao

Modern machine learning (ML) models are capable of impressive performances. However, their prowess is not due only to the improvements in their architecture and training algorithms but also to a drastic increase in computational power used…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-27 Andrei Kucharavy , Matteo Monti , Rachid Guerraoui , Ljiljana Dolamic

This paper proposes a Byzantine-resilient consensus framework that simultaneously pursues two tightly coupled objectives: actively identifying Byzantine agents and guaranteeing resilient consensus among normal agents. Unlike existing…

Optimization and Control · Mathematics 2026-05-13 Rui Huang , Changxin Liu , Wen-Hua Chen , Yang Shi

This paper studies the problem of cooperative control of heterogeneous multi-agent systems (MASs) against Byzantine attacks. The agent affected by Byzantine attacks sends different wrong values to all neighbors while applying wrong input…

Systems and Control · Electrical Eng. & Systems 2023-03-28 Xin Gong , Yiwen Liang , Yukang Cui , Shi Liang , Tingwen Huang

In this paper, we study a fully-decentralized multi-agent policy evaluation problem, which is an important sub-problem in cooperative multi-agent reinforcement learning, in the presence of up to $f$ faulty agents. In particular, we focus on…

Cryptography and Security · Computer Science 2024-09-24 Hairi , Minghong Fang , Zifan Zhang , Alvaro Velasquez , Jia Liu

Gradient-based training in federated learning is known to be vulnerable to faulty/malicious clients, which are often modeled as Byzantine clients. To this end, previous work either makes use of auxiliary data at parameter server to verify…

Machine Learning · Computer Science 2023-05-02 Jian Xu , Shao-Lun Huang , Linqi Song , Tian Lan

This paper considers the multi-agent reinforcement learning (MARL) problem for a networked (peer-to-peer) system in the presence of Byzantine agents. We build on an existing distributed $Q$-learning algorithm, and allow certain agents in…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Yijing Xie , Shaoshuai Mou , Shreyas Sundaram

Federated learning (FL) is an emerging machine learning paradigm, in which clients jointly learn a model with the help of a cloud server. A fundamental challenge of FL is that the clients are often heterogeneous, e.g., they have different…

Cryptography and Security · Computer Science 2022-12-14 Minghong Fang , Jia Liu , Neil Zhenqiang Gong , Elizabeth S. Bentley