English
Related papers

Related papers: Byzantine-Resilient Distributed Computation via Ta…

200 papers

Approximate byzantine consensus is a fundamental problem of distributed computing. This paper presents a novel algorithm for approximate byzantine consensus, called Relay-ABC. The algorithm allows machines to achieve approximate consensus…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-29 Matthew Ding

The development of fault-tolerant distributed systems that can tolerate Byzantine behavior has traditionally been focused on consensus protocols, which support fully-replicated designs. For the development of more sophisticated…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-06 Jelle Hellings , Mohammad Sadoghi

Byzantine resilience emerged as a prominent topic within the distributed machine learning community. Essentially, the goal is to enhance distributed optimization algorithms, such as distributed SGD, in a way that guarantees convergence…

Machine Learning · Computer Science 2022-05-25 Sadegh Farhadkhani , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , John Stephan

We give fault-tolerant algorithms for establishing synchrony in distributed systems in which each of the $n$ nodes has its own clock. Our algorithms operate in a very strong fault model: we require self-stabilisation, i.e., the initial…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-12 Christoph Lenzen , Joel Rybicki

This paper investigates the robustness of over-the-air federated learning to Byzantine attacks. The simple averaging of the model updates via over-the-air computation makes the learning task vulnerable to random or intended modifications of…

Machine Learning · Computer Science 2022-06-24 Houssem Sifaou , Geoffrey Ye Li

Both Byzantine resilience and communication efficiency have attracted tremendous attention recently for their significance in edge federated learning. However, most existing algorithms may fail when dealing with real-world irregular data…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-21 Youming Tao , Sijia Cui , Wenlu Xu , Haofei Yin , Dongxiao Yu , Weifa Liang , Xiuzhen Cheng

In this paper, we propose a first-order distributed optimization algorithm that is provably robust to Byzantine failures-arbitrary and potentially adversarial behavior, where all the participating agents are prone to failure. We model each…

Optimization and Control · Mathematics 2022-07-27 Berkay Turan , Cesar A. Uribe , Hoi-To Wai , Mahnoosh Alizadeh

In this paper, we study the challenging task of Byzantine-robust decentralized training on arbitrary communication graphs. Unlike federated learning where workers communicate through a server, workers in the decentralized environment can…

Machine Learning · Computer Science 2023-04-21 Lie He , Sai Praneeth Karimireddy , Martin Jaggi

This paper considers the problem of detection in distributed networks in the presence of data falsification (Byzantine) attacks. Detection approaches considered in the paper are based on fully distributed consensus algorithms, where all of…

Systems and Control · Computer Science 2017-09-29 Bhavya Kailkhura , Swastik Brahma , Pramod K. Varshney

We study distributed optimization in the presence of Byzantine adversaries, where both data and computation are distributed among $m$ worker machines, $t$ of which may be corrupt. The compromised nodes may collaboratively and arbitrarily…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-05 Deepesh Data , Linqi Song , Suhas Diggavi

Population protocols model information spreading and computation in network systems where pairwise node exchanges are determined by an external random scheduler and nodes have small memory. Most of the population protocols in the literature…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-06 Costas Busch , Dariusz R. Kowalski

Self-stabilization is a versatile approach to fault-tolerance since it permits a distributed system to recover from any transient fault that arbitrarily corrupts the contents of all memories in the system. Byzantine tolerance is an…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-02-11 Swan Dubois , Toshimitsu Masuzawa , Sébastien Tixeuil

There has been a growing need to provide Byzantine-resilience in distributed model training. Existing robust distributed learning algorithms focus on developing sophisticated robust aggregators at the parameter servers, but pay less…

Machine Learning · Computer Science 2021-10-12 Lingjiao Chen , Leshang Chen , Hongyi Wang , Susan Davidson , Edgar Dobriban

Byzantine attacks present a critical challenge to Federated Learning (FL), where malicious participants can disrupt the training process, degrade model accuracy, and compromise system reliability. Traditional FL frameworks typically rely on…

Machine Learning · Computer Science 2025-03-17 Yufei Xia , Wenrui Yu , Qiongxiu Li

A plethora of modern machine learning tasks require the utilization of large-scale distributed clusters as a critical component of the training pipeline. However, abnormal Byzantine behavior of the worker nodes can derail the training and…

Machine Learning · Computer Science 2023-05-16 Konstantinos Konstantinidis , Namrata Vaswani , Aditya Ramamoorthy

Clock synchronization is a very fundamental task in distributed system. It thus makes sense to require an underlying clock synchronization mechanism to be highly fault-tolerant. A self-stabilizing algorithm seeks to attain synchronization…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Ariel Daliot , Danny Dolev , Hanna Parnas

We study local stochastic gradient descent methods for solving federated optimization over a network of agents communicating indirectly through a centralized coordinator. We are interested in the Byzantine setting where there is a subset of…

Optimization and Control · Mathematics 2024-09-06 Amit Dutta , Thinh T. Doan

In this report, we study the problem of Byzantine fault-tolerant distributed set intersection and the importance of redundancy in solving this problem. Specifically, consider a distributed system with $n$ agents, each of which has a local…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-15 Shuo Liu , Nitin H. Vaidya

Distributed optimization with open collaboration is a popular field since it provides an opportunity for small groups/companies/universities, and individuals to jointly solve huge-scale problems. However, standard optimization algorithms…

Optimization and Control · Mathematics 2023-03-09 Nikita Fedin , Eduard Gorbunov

We consider the problem of reliably broadcasting information in a multihop asyn- chronous network that is subject to Byzantine failures. That is, some nodes of the network can exhibit arbitrary (and potentially malicious) behavior. Existing…

Data Structures and Algorithms · Computer Science 2012-01-30 Alexandre Maurer , Sébastien Tixeuil