English
Related papers

Related papers: Dynamic Byzantine-Robust Learning: Adapting to Swi…

200 papers

To improve the resilience of distributed training to worst-case, or Byzantine node failures, several recent approaches have replaced gradient averaging with robust aggregation methods. Such techniques can have high computational costs,…

Machine Learning · Computer Science 2020-03-10 Shashank Rajput , Hongyi Wang , Zachary Charles , Dimitris Papailiopoulos

Federated learning (FL) enables a set of geographically distributed clients to collectively train a model through a server. Classically, the training process is synchronous, but can be made asynchronous to maintain its speed in presence of…

Machine Learning · Computer Science 2024-06-21 Bart Cox , Abele Mălan , Lydia Y. Chen , Jérémie Decouchant

Distributed learning enables scalable model training over decentralized data, but remains hindered by Byzantine faults and high communication costs. While both challenges have been studied extensively in isolation, their interplay has…

Machine Learning · Computer Science 2025-11-04 Diksha Gupta , Antonio Honsell , Chuan Xu , Nirupam Gupta , Giovanni Neglia

Self-stabilization is a versatile approach to fault-tolerance since it permits a distributed system to recover from any transient fault that arbitrarily corrupts the contents of all memories in the system. Byzantine tolerance is an…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-02-11 Swan Dubois , Toshimitsu Masuzawa , Sébastien Tixeuil

We investigate robust federated learning, where a group of workers collaboratively train a shared model under the orchestration of a central server in the presence of Byzantine adversaries capable of arbitrary and potentially malicious…

Machine Learning · Computer Science 2025-11-05 Lihan Xu , Yanjie Dong , Gang Wang , Runhao Zeng , Xiaoyi Fan , Xiping Hu

We study the convergence problem in fully asynchronous, uni-dimensional robot networks that are prone to Byzantine (i.e. malicious) failures. In these settings, oblivious anonymous robots with arbitrary initial positions are required to…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-08-05 Zohir Bouzid , Maria Potop-Butucaru , Sébastien Tixeuil

Byzantine attacks present a critical challenge to Federated Learning (FL), where malicious participants can disrupt the training process, degrade model accuracy, and compromise system reliability. Traditional FL frameworks typically rely on…

Machine Learning · Computer Science 2025-03-17 Yufei Xia , Wenrui Yu , Qiongxiu Li

In distributed learning, a central server trains a model according to updates provided by nodes holding local data samples. In the presence of one or more malicious servers sending incorrect information (a Byzantine adversary), standard…

Machine Learning · Computer Science 2022-08-26 Lindon Roberts , Edward Smyth

We analyze the impact of transient and Byzantine faults on the construction of a maximal independent set in a general network. We adapt the self-stabilizing algorithm presented by Turau \cite{turau2007linear} for computing such a vertex…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-17 Johanne Cohen , Laurence Pilard , Jonas Sénizergues

A shared read/write register emulation provides the illusion of shared-memory on top of message-passing models. The main hurdle with such emulations is dealing with server faults in the system. Several crash-tolerant register emulations in…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-16 Saptaparni Kumar , Jennifer L. Welch

We study a setting where a group of agents, each receiving partially informative private observations, seek to collaboratively learn the true state (among a set of hypotheses) that explains their joint observation profiles over time. To…

Systems and Control · Computer Science 2019-03-15 Aritra Mitra , John A. Richards , Shreyas Sundaram

Given a set of robots with arbitrary initial location and no agreement on a global coordinate system, convergence requires that all robots asymptotically approach the exact same, but unknown beforehand, location. Robots are oblivious-- they…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-05-26 Zohir Bouzid , Maria Potop-Butucaru , Sébastien Tixeuil

This paper proposes the first implementation of a self-stabilizing regular register emulated by $n$ servers that is tolerant to both mobile Byzantine agents, and \emph{transient failures} in a round-free synchronous model. Differently from…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-24 Silvia Bonomi , Antonella Del Pozzo , Maria Potop-Butucaru , Sébastien Tixeuil

This paper considers the problem of Byzantine fault tolerance in distributed linear regression in a multi-agent system. However, the proposed algorithms are given for a more general class of distributed optimization problems, of which…

Machine Learning · Computer Science 2019-04-05 Nirupam Gupta , Nitin H. Vaidya

We consider the following problem: two nodes want to reliably communicate in a dynamic multihop network where some nodes have been compromised, and may have a totally arbitrary and unpredictable behavior. These nodes are called Byzantine.…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-02-17 Alexandre Maurer , Sébastien Tixeuil , Xavier Défago

Robust distributed learning algorithms aim to maintain reliable performance despite the presence of misbehaving workers. Such misbehaviors are commonly modeled as Byzantine failures, allowing arbitrarily corrupted communication, or as data…

Machine Learning · Computer Science 2025-10-17 Thomas Boudou , Batiste Le Bars , Nirupam Gupta , Aurélien Bellet

Asynchronous distributed machine learning solutions have proven very effective so far, but always assuming perfectly functioning workers. In practice, some of the workers can however exhibit Byzantine behavior, caused by hardware failures,…

Machine Learning · Statistics 2018-07-10 Georgios Damaskinos , El Mahdi El Mhamdi , Rachid Guerraoui , Rhicheek Patra , Mahsa Taziki

Federated Learning (FL) emerges as a distributed machine learning approach that addresses privacy concerns by training AI models locally on devices. Decentralized Federated Learning (DFL) extends the FL paradigm by eliminating the central…

Machine Learning · Computer Science 2025-11-17 Diego Cajaraville-Aboy , Ana Fernández-Vilas , Rebeca P. Díaz-Redondo , Manuel Fernández-Veiga

We analyze the impact of transient and Byzantine faults on the construction of a maximal independent set in a general network. We adapt the self-stabilizing algorithm presented by Turau `for computing such a vertex set. Our algorithm is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-11 Johanne Cohen , Laurence Pilard , François Pirot , Jonas Sénizergues

The alternating direction of multipliers method (ADMM) is a popular method to solve distributed consensus optimization utilizing efficient communication among various nodes in the network. However, in the presence of faulty or attacked…

Optimization and Control · Mathematics 2025-12-10 Vishnu Vijay , Kartik A. Pant , Minhyun Cho , Inseok Hwang