English
Related papers

Related papers: A Zeroth-order Resilient Algorithm for Distributed…

200 papers

Privacy and Byzantine resilience are two indispensable requirements for a federated learning (FL) system. Although there have been extensive studies on privacy and Byzantine security in their own track, solutions that consider both remain…

Machine Learning · Computer Science 2023-08-03 Zihang Xiang , Tianhao Wang , Wanyu Lin , Di Wang

We study how to efficiently diffuse updates to a large distributed system of data replicas, some of which may exhibit arbitrary (Byzantine) failures. We assume that strictly fewer than $t$ replicas fail, and that each update is initially…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Dahlia Malkhi , Yishay Mansour , Michael Reiter

Recent years have witnessed a slew of coding techniques custom designed for networked storage systems. Network coding inspired regenerating codes are the most prolifically studied among these new age storage centric codes. A lot of effort…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-14 Frédérique Oggier , Anwitaman Datta

Motivated, in part, by the rise of permissionless systems such as Bitcoin where arbitrary nodes (whose identities are not known apriori) can join and leave at will, we extend established research in scalable Byzantine agreement to a more…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-26 John Augustine , Valerie King , Anisur R. Molla , Gopal Pandurangan , Jared Saia

Machine Learning (ML) solutions are nowadays distributed, according to the so-called server/worker architecture. One server holds the model parameters while several workers train the model. Clearly, such architecture is prone to various…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-03 El-Mahdi El-Mhamdi , Rachid Guerraoui , Arsany Guirguis , Lê Nguyên Hoang , Sébastien Rouault

Federated Learning (FL) emerges as a distributed machine learning approach that addresses privacy concerns by training AI models locally on devices. Decentralized Federated Learning (DFL) extends the FL paradigm by eliminating the central…

Machine Learning · Computer Science 2025-11-17 Diego Cajaraville-Aboy , Ana Fernández-Vilas , Rebeca P. Díaz-Redondo , Manuel Fernández-Veiga

Achieving agreement among distributed parties is a fundamental task in modern systems, underpinning applications such as consensus in blockchains, coordination in cloud infrastructure, and fault tolerance in critical services. However, this…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-18 Andrei Constantinescu , Marc Dufay , Anton Paramonov , Roger Wattenhofer

Decentralized learning has gained great popularity to improve learning efficiency and preserve data privacy. Each computing node makes equal contribution to collaboratively learn a Deep Learning model. The elimination of centralized…

Machine Learning · Computer Science 2021-10-22 Shangwei Guo , Tianwei Zhang , Han Yu , Xiaofei Xie , Lei Ma , Tao Xiang , Yang Liu

We address a fundamental problem in Peer-to-Peer (P2P) networks, namely, constructing and maintaining dynamic P2P overlay network topologies with essential properties such as connectivity, low diameter, and high expansion, that are…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-18 Aayush Gupta , Gopal Pandurangan

Federated learning (FL) becomes vulnerable to Byzantine attacks where some of participators tend to damage the utility or discourage the convergence of the learned model via sending their malicious model updates. Previous works propose to…

Cryptography and Security · Computer Science 2024-08-13 Fangyuan Zhao , Yuexiang Xie , Xuebin Ren , Bolin Ding , Shusen Yang , Yaliang Li

This paper proposes the first implementation of a self-stabilizing regular register emulated by $n$ servers that is tolerant to both mobile Byzantine agents, and \emph{transient failures} in a round-free synchronous model. Differently from…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-24 Silvia Bonomi , Antonella Del Pozzo , Maria Potop-Butucaru , Sébastien Tixeuil

We consider the problem of reliably broadcasting information in a multihop asyn- chronous network that is subject to Byzantine failures. That is, some nodes of the network can exhibit arbitrary (and potentially malicious) behavior. Existing…

Data Structures and Algorithms · Computer Science 2012-01-30 Alexandre Maurer , Sébastien Tixeuil

We study the convergence problem in fully asynchronous, uni-dimensional robot networks that are prone to Byzantine (i.e. malicious) failures. In these settings, oblivious anonymous robots with arbitrary initial positions are required to…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-08-05 Zohir Bouzid , Maria Potop-Butucaru , Sébastien Tixeuil

Optimum decision fusion in the presence of malicious nodes - often referred to as Byzantines - is hindered by the necessity of exactly knowing the statistical behavior of Byzantines. By focusing on a simple, yet widely studied, set-up in…

Systems and Control · Computer Science 2015-07-03 Andrea Abrardo , Mauro Barni , Kassem Kallas , Benedetta Tondi

We study the fundamental problem of counting the number of nodes in a sparse network (of unknown size) under the presence of a large number of Byzantine nodes. We assume the full information model where the Byzantine nodes have complete…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-19 Soumyottam Chatterjee , Gopal Pandurangan , Peter Robinson

We investigate the Byzantine attack problem within the context of model training in distributed learning systems. While ensuring the convergence of current model training processes, common solvers (e.g. SGD, Adam, RMSProp, etc.) can be…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-08 Kun Yang , Tianyi Luo , Yanjie Dong , Aohan Li

Distributed optimization with open collaboration is a popular field since it provides an opportunity for small groups/companies/universities, and individuals to jointly solve huge-scale problems. However, standard optimization algorithms…

Optimization and Control · Mathematics 2023-03-09 Nikita Fedin , Eduard Gorbunov

Recently emerged federated learning (FL) is an attractive distributed learning framework in which numerous wireless end-user devices can train a global model with the data remained autochthonous. Compared with the traditional machine…

Cryptography and Security · Computer Science 2022-10-10 Junyu Shi , Wei Wan , Shengshan Hu , Jianrong Lu , Leo Yu Zhang

Learning at the edges has become increasingly important as large quantities of data are continually generated locally. Among others, this paradigm requires algorithms that are simple (so that they can be executed by local devices), robust…

Machine Learning · Computer Science 2024-02-06 Tuan-Anh Nguyen , Nguyen Kim Thang , Denis Trystram

In distributed learning, a central server trains a model according to updates provided by nodes holding local data samples. In the presence of one or more malicious servers sending incorrect information (a Byzantine adversary), standard…

Machine Learning · Computer Science 2022-08-26 Lindon Roberts , Edward Smyth