English
Related papers

Related papers: Approximate Byzantine Fault-Tolerance in Distribut…

200 papers

We consider a distributed reinforcement learning setting where multiple agents separately explore the environment and communicate their experiences through a central server. However, $\alpha$-fraction of agents are adversarial and can…

Machine Learning · Computer Science 2022-06-02 Yiding Chen , Xuezhou Zhang , Kaiqing Zhang , Mengdi Wang , Xiaojin Zhu

This paper studies the Byzantine Agreement problem where the nodes have access to a predictor that flags nodes for suspicion of faulty (Byzantine) behavior. We focus on algorithmic resilience -- the maximum number of faulty nodes an…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-20 Julien Dallot , Darya Melnyk , Tijana Milentijevic , Stefan Schmid , Patrik Welters

We analyze the impact of transient and Byzantine faults on the construction of a maximal independent set in a general network. We adapt the self-stabilizing algorithm presented by Turau \cite{turau2007linear} for computing such a vertex…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-17 Johanne Cohen , Laurence Pilard , Jonas Sénizergues

Given a network in which some pairs of nodes can communicate freely, and some subsets of the nodes could be faulty and colluding to disrupt communication, when can messages reliably be sent from one given node to another? We give a new…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-11 Adam Hesterberg , Andrea Lincoln , Jayson Lynch

We address the challenges of Byzantine-robust training in asynchronous distributed machine learning systems, aiming to enhance efficiency amid massive parallelization and heterogeneous computing resources. Asynchronous systems, marked by…

Machine Learning · Computer Science 2025-06-05 Tehila Dahan , Kfir Y. Levy

In this paper, we investigate the problem of decentralized online resource allocation in the presence of Byzantine attacks. In this problem setting, some agents may be compromised due to external manipulations or internal failures, causing…

Optimization and Control · Mathematics 2026-05-27 Runhua Wang , Qing Ling , Hoi-To Wai , Zhi Tian

Distributed machine learning algorithms enable learning of models from datasets that are distributed over a network without gathering the data at a centralized location. While efficient distributed algorithms have been developed under the…

Machine Learning · Computer Science 2020-07-07 Zhixiong Yang , Waheed U. Bajwa

This paper proposes a new approach that enables multi-agent systems to achieve resilient \textit{constrained} consensus in the presence of Byzantine attacks, in contrast to existing literature that is only applicable to…

Systems and Control · Electrical Eng. & Systems 2023-12-19 Xuan Wang , Shaoshuai Mou , Shreyas Sundaram

We consider the federated learning problem where data on workers are not independent and identically distributed (i.i.d.). During the learning process, an unknown number of Byzantine workers may send malicious messages to the central node,…

Machine Learning · Computer Science 2021-08-31 Jie Peng , Zhaoxian Wu , Qing Ling , Tianyi Chen

We study the \emph{Byzantine} gathering problem involving $k$ mobile agents with unique identifiers (IDs), $f$ of which are Byzantine. These agents start the execution of a common algorithm from (possibly different) nodes in an $n$-node…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-14 Jion Hirose , Ryota Eguchi , Yuichi Sudo

We develop a communication-efficient distributed learning algorithm that is robust against Byzantine worker machines. We propose and analyze a distributed gradient-descent algorithm that performs a simple thresholding based on gradient…

Machine Learning · Computer Science 2021-08-17 Avishek Ghosh , Raj Kumar Maity , Swanand Kadhe , Arya Mazumdar , Kannan Ramchandran

In this paper, we study the problem of distributed multi-agent optimization over a network, where each agent possesses a local cost function that is smooth and strongly convex. The global objective is to find a common solution that…

Optimization and Control · Mathematics 2019-08-02 Shi Pu , Angelia Nedić

Fault-tolerant distributed systems offer high reliability because even if faults in their components occur, they do not exhibit erroneous behavior. Depending on the fault model adopted, hardware and software errors that do not result in a…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-19 Rodrigo R. Barbieri , Enrique S. dos Santos , Gustavo M. D. Vieira

This paper considers the problem of detection in distributed networks in the presence of data falsification (Byzantine) attacks. Detection approaches considered in the paper are based on fully distributed consensus algorithms, where all of…

Systems and Control · Computer Science 2017-09-29 Bhavya Kailkhura , Swastik Brahma , Pramod K. Varshney

In this paper, we consider the problem of minimizing the sum of nonconvex and possibly nonsmooth functions over a connected multi-agent network, where the agents have partial knowledge about the global cost function and can only access the…

Optimization and Control · Mathematics 2019-04-10 Davood Hajinezhad , Michael Zavlanos

We develop deterministic algorithms for the problems of consensus, gossiping and checkpointing with nodes prone to failing. Distributed systems are modeled as synchronous complete networks. Failures are represented either as crashes or…

Data Structures and Algorithms · Computer Science 2023-05-22 Bogdan S. Chlebus , Dariusz R. Kowalski , Jan Olkowski

This paper studies a distributed multi-agent convex optimization problem. The system comprises multiple agents in this problem, each with a set of local data points and an associated local cost function. The agents are connected to a…

Optimization and Control · Mathematics 2021-08-20 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra

We present two distributed algorithms for the {\em Byzantine counting problem}, which is concerned with estimating the size of a network in the presence of a large number of Byzantine nodes. In an $n$-node network ($n$ is unknown), our…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-27 Soumyottam Chatterjee , Gopal Pandurangan , Peter Robinson

In large-scale distributed learning, security issues have become increasingly important. Particularly in a decentralized environment, some computing units may behave abnormally, or even exhibit Byzantine failures -- arbitrary and…

Machine Learning · Computer Science 2021-02-26 Dong Yin , Yudong Chen , Kannan Ramchandran , Peter Bartlett

To improve the resilience of distributed training to worst-case, or Byzantine node failures, several recent approaches have replaced gradient averaging with robust aggregation methods. Such techniques can have high computational costs,…

Machine Learning · Computer Science 2020-03-10 Shashank Rajput , Hongyi Wang , Zachary Charles , Dimitris Papailiopoulos