English
Related papers

Related papers: Fast Machine Learning with Byzantine Workers and S…

200 papers

Consider a linear time-invariant (LTI) dynamical system monitored by a network of sensors, modeled as nodes of an underlying directed communication graph. We study the problem of collaboratively estimating the state of the system when…

Systems and Control · Computer Science 2018-10-09 Aritra Mitra , Shreyas Sundaram

This paper studies the design of Byzantine consensus algorithms in an \textit{asynchronous }single-hop network equipped with the "abstract MAC layer" [DISC09], which captures core properties of modern wireless MAC protocols. Newport…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-07 Lewis Tseng , Callie Sardina

Today's cyber-physical systems face various impediments to achieving their intended goals, namely, communication uncertainties and faults, relative to the increased integration of networked and wireless devices, hinder the synchronism…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-04 David Kozhaya , Jérémie Decouchant , Paulo Esteves-Verissimo

We study adversary-resilient stochastic distributed optimization, in which $m$ machines can independently compute stochastic gradients, and cooperate to jointly optimize over their local objective functions. However, an $\alpha$-fraction of…

Machine Learning · Computer Science 2021-04-05 Zeyuan Allen-Zhu , Faeze Ebrahimian , Jerry Li , Dan Alistarh

In this paper, we investigate the problem of distributed learning (DL) in the presence of Byzantine attacks. For this problem, various robust bounded aggregation (RBA) rules have been proposed at the central server to mitigate the impact of…

Machine Learning · Computer Science 2026-03-18 Chengxi Li , Ming Xiao , Mikael Skoglund

Given sufficient data from multiple edge devices, federated learning (FL) enables training a shared model without transmitting private data to the central server. However, FL is generally vulnerable to Byzantine attacks from compromised…

Machine Learning · Computer Science 2025-09-18 Youngjoon Lee , Jinu Gong , Joonhyuk Kang

Federated learning has emerged as a popular paradigm for collaboratively training a model from data distributed among a set of clients. This learning setting presents, among others, two unique challenges: how to protect privacy of the…

Cryptography and Security · Computer Science 2021-05-07 Hanieh Hashemi , Yongqin Wang , Chuan Guo , Murali Annavaram

We propose Byzantine-robust federated learning protocols with nearly optimal statistical rates. In contrast to prior work, our proposed protocols improve the dimension dependence and achieve a tight statistical rate in terms of all the…

Machine Learning · Computer Science 2023-03-21 Banghua Zhu , Lun Wang , Qi Pang , Shuai Wang , Jiantao Jiao , Dawn Song , Michael I. Jordan

Due to the widespread availability of data, machine learning (ML) algorithms are increasingly being implemented in distributed topologies, wherein various nodes collaborate to train ML models via the coordination of a central server.…

Machine Learning · Computer Science 2023-12-15 Antoine Choffrut , Rachid Guerraoui , Rafael Pinot , Renaud Sirdey , John Stephan , Martin Zuber

Federated Learning (FL) is a distributed machine learning paradigm where data is distributed among clients who collaboratively train a model in a computation process coordinated by a central server. By assigning a weight to each client…

Machine Learning · Computer Science 2021-05-19 Amit Portnoy , Yoav Tirosh , Danny Hendler

Federated Learning (FL) enables multiple distributed clients (e.g., mobile devices) to collaboratively train a centralized model while keeping the training data locally on the client. Compared to traditional centralized machine learning, FL…

Machine Learning · Computer Science 2021-09-29 Zhuohang Li , Luyang Liu , Jiaxin Zhang , Jian Liu

In this paper we present an open source, fully asynchronous, leaderless algorithm for reaching consensus in the presence of Byzantine faults in an asynchronous network. We prove the algorithm's correctness provided that less than a third of…

Cryptography and Security · Computer Science 2019-07-29 Pierre Chevalier , Bartlomiej Kaminski , Fraser Hutchison , Qi Ma , Spandan Sharma , Andreas Fackler , William J Buchanan

Standard federated learning algorithms are vulnerable to adversarial nodes, a.k.a. Byzantine failures. To solve this issue, robust distributed learning algorithms have been developed, which typically replace parameter averaging by robust…

Machine Learning · Computer Science 2026-02-04 Renaud Gaucher , Aymeric Dieuleveut , Hadrien Hendrikx

Byzantine fault tolerance (BFT) has been extensively studied in distributed trustless systems to guarantee system's functioning when up to 1/3 Byzantine processes exist. Despite a plethora of previous work in BFT systems, they are mainly…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-11 Quan Nguyen , Andre Cronje

Federated learning (FL) shows great promise in large scale machine learning, but brings new risks in terms of privacy and security. We propose ByITFL, a novel scheme for FL that provides resilience against Byzantine users while keeping the…

Information Theory · Computer Science 2025-06-16 Yue Xia , Christoph Hofmeister , Maximilian Egger , Rawad Bitar

The advancement of AI models, especially those powered by deep learning, faces significant challenges in data-sensitive industries like healthcare and finance due to the distributed and private nature of data. Federated Learning (FL) and…

Cryptography and Security · Computer Science 2025-01-14 Yongming Fan , Rui Zhu , Zihao Wang , Chenghong Wang , Haixu Tang , Ye Dong , Hyunghoon Cho , Lucila Ohno-Machado

Increasingly machine learning systems are being deployed to edge servers and devices (e.g. mobile phones) and trained in a collaborative manner. Such distributed/federated/decentralized training raises a number of concerns about the…

Machine Learning · Computer Science 2020-10-20 Lie He , Sai Praneeth Karimireddy , Martin Jaggi

Federated learning (FL) enables collaborative model training across distributed clients without sharing raw data, but its robustness is threatened by Byzantine behaviors such as data and model poisoning. Existing defenses face fundamental…

Cryptography and Security · Computer Science 2025-09-12 Usama Zafar , André M. H. Teixeira , Salman Toor

Byzantine-robust distributed optimization relies on robust aggregation rules to mitigate the influence of malicious Byzantine workers. Despite the proliferation of such rules, a unified convergence analysis framework that accommodates…

Optimization and Control · Mathematics 2026-04-14 Boyuan Ruan , Xiaoyu Wang , Ya-Feng Liu

Modern distributed systems face growing security threats, as attackers continuously enhance their skills and vulnerabilities span across the entire system stack, from hardware to the application layer. In the system design phase, fault…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-07 Silvia Bonomi , Giovanni Farina , Roy Friedman , Eviatar B. Procaccia , Sebastien Tixeuil