English
Related papers

Related papers: Dynamic Byzantine-Robust Learning: Adapting to Swi…

200 papers

This paper proposes a Robust One-Step Estimator(ROSE) to solve the Byzantine failure problem in distributed M-estimation when a moderate fraction of node machines experience Byzantine failures. To define ROSE, the algorithms use the robust…

Statistics Theory · Mathematics 2023-07-18 Chuhan Wang , Xuehu Zhu , Lixing Zhu

Distributed algorithms for multi-agent resource allocation can provide privacy and scalability over centralized algorithms in many cyber-physical systems. However, the distributed nature of these algorithms can render these systems…

Optimization and Control · Mathematics 2020-12-08 Berkay Turan , Cesar A. Uribe , Hoi-To Wai , Mahnoosh Alizadeh

In Federated Reinforcement Learning (FRL), agents aim to collaboratively learn a common task, while each agent is acting in its local environment without exchanging raw trajectories. Existing approaches for FRL either (a) do not provide any…

Machine Learning · Computer Science 2024-01-09 Philip Jordan , Florian Grötschla , Flint Xiaofeng Fan , Roger Wattenhofer

We study stochastic gradient descent (SGD) with local iterations in the presence of malicious/Byzantine clients, motivated by the federated learning. The clients, instead of communicating with the central server in every iteration, maintain…

Machine Learning · Statistics 2020-08-18 Deepesh Data , Suhas Diggavi

Federated Learning (FL) trains a global model across decentralized clients while preserving data privacy, but at scale it is vulnerable to malicious updates. Byzantine-resilient aggregation methods such as MultiKrum score gradients against…

Machine Learning · Computer Science 2026-05-19 Andras Ferenczi , Sutapa Samanta , Dagen Wang , Jason Qizhe Qin

Recently, new defense techniques have been developed to tolerate Byzantine failures for distributed machine learning. The Byzantine model captures workers that behave arbitrarily, including malicious and compromised workers. In this paper,…

Machine Learning · Computer Science 2019-03-12 Cong Xie , Sanmi Koyejo , Indranil Gupta

Byzantine Reliable Broadcast (BRB) is a fundamental primitive in distributed computing and cryptographic systems. Reducing the communication complexity of BRB protocols remains an important research direction. However, most work focuses on…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-13 Michael Yiqing Hu , Alvin Hong Yao Yan , Jialin Li

Recent advances in large-scale distributed learning algorithms have enabled communication-efficient training via SignSGD. Unfortunately, a major issue continues to plague distributed learning: namely, Byzantine failures may incur serious…

Information Theory · Computer Science 2020-10-27 Jy-yong Sohn , Dong-Jun Han , Beongjun Choi , Jaekyun Moon

Recent advancements in machine learning have improved performance while also increasing computational demands. While federated and distributed setups address these issues, their structures remain vulnerable to malicious influences. In this…

This paper considers the multi-agent reinforcement learning (MARL) problem for a networked (peer-to-peer) system in the presence of Byzantine agents. We build on an existing distributed $Q$-learning algorithm, and allow certain agents in…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Yijing Xie , Shaoshuai Mou , Shreyas Sundaram

This paper addresses the problem of combining Byzantine resilience with privacy in machine learning (ML). Specifically, we study if a distributed implementation of the renowned Stochastic Gradient Descent (SGD) learning algorithm is…

Machine Learning · Computer Science 2021-06-25 Rachid Guerraoui , Nirupam Gupta , Rafaël Pinot , Sébastien Rouault , John Stephan

In a practical Byzantine fault tolerance (PBFT) blockchain network, the voting nodes may always leave the network while some new nodes can also enter the network, thus the number of voting nodes is constantly changing. Such a new PBFT with…

Performance · Computer Science 2022-10-26 Yan-Xia Chang , Quan-Lin Li , Qing Wang , Xing-Shuo Song

We consider the problem of reliably broadcasting information in a multihop asyn- chronous network that is subject to Byzantine failures. That is, some nodes of the network can exhibit arbitrary (and potentially malicious) behavior. Existing…

Data Structures and Algorithms · Computer Science 2012-01-30 Alexandre Maurer , Sébastien Tixeuil

With the increasing importance of machine learning, the privacy and security of training data have become critical. Federated learning, which stores data in distributed nodes and shares only model parameters, has gained significant…

Machine Learning · Computer Science 2025-07-10 Yang Li , Chunhe Xia , Chang Li , Tianbo Wang

In this paper, we propose an iterative scheme for distributed Byzantineresilient estimation of a gradient associated with a black-box model. Our algorithm is based on simultaneous perturbation, secure state estimation and two-timescale…

Artificial Intelligence · Computer Science 2022-10-03 Alexandre Reiffers-Masson , Isabel Amigo

In this paper, we propose a zeroth-order resilient distributed online algorithm for networks under Byzantine edge attacks. We assume that both the edges attacked by Byzantine adversaries and the objective function are time-varying.…

Optimization and Control · Mathematics 2025-11-10 Yuhang Liu , Wenjun Mei

We develop a distributed second order optimization algorithm that is communication-efficient as well as robust against Byzantine failures of the worker machines. We propose COMRADE (COMunication-efficient and Robust Approximate Distributed…

Machine Learning · Computer Science 2021-03-19 Avishek Ghosh , Raj Kumar Maity , Arya Mazumdar

While being an effective framework of learning a shared model across multiple edge devices, federated learning (FL) is generally vulnerable to Byzantine attacks from adversarial edge devices. While existing works on FL mitigate such…

Machine Learning · Computer Science 2022-11-01 Youngjoon Lee , Sangwoo Park , Joonhyuk Kang

In this paper, we propose a robust aggregation method for federated learning (FL) that can effectively tackle malicious Byzantine attacks. At each user, model parameter is firstly updated by multiple steps, which is adjustable over…

Machine Learning · Computer Science 2023-08-22 Shiyuan Zuo , Rongfei Fan , Han Hu , Ning Zhang , Shimin Gong

This paper presents BFTBrain, a reinforcement learning (RL) based Byzantine fault-tolerant (BFT) system that provides significant operational benefits: a plug-and-play system suitable for a broad set of hardware and network configurations,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-14 Chenyuan Wu , Haoyun Qin , Mohammad Javad Amiri , Boon Thau Loo , Dahlia Malkhi , Ryan Marcus