English
Related papers

Related papers: Byzantine Fault-Tolerance in Decentralized Optimiz…

200 papers

Decentralized learning, which facilitates joint model training across geographically scattered agents, has gained significant attention in the field of signal and information processing in recent years. While the optimization errors of…

Machine Learning · Computer Science 2025-06-12 Haoxiang Ye , Tao Sun , Qing Ling

Machine Learning (ML) solutions are nowadays distributed, according to the so-called server/worker architecture. One server holds the model parameters while several workers train the model. Clearly, such architecture is prone to various…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-03 El-Mahdi El-Mhamdi , Rachid Guerraoui , Arsany Guirguis , Lê Nguyên Hoang , Sébastien Rouault

Distributed Software Defined Networking (SDN) controllers aim to solve the issue of single-point-of-failure and improve the scalability of the control plane. Byzantine and faulty controllers, however, may enforce incorrect configurations…

Networking and Internet Architecture · Computer Science 2019-02-25 Ermin Sakic , Wolfgang Kellerer

To improve the overall efficiency and reliability of Byzantine protocols in large sparse networks, we propose a new system assumption for developing multi-scale fault-tolerant systems, with which several kinds of multi-scale Byzantine…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-08 Shaolin Yu , Jihong Zhu , Jiali Yang , Yulong Zhan

We study the gathering problem requiring a team of mobile agents to gather at a single node in arbitrary networks. The team consists of $k$ agents with unique identifiers (IDs), and $f$ of them are weakly Byzantine agents, which behave…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-04 Jion Hirose , Junya Nakamura , Fukuhito Ooshita , Michiko Inoue

In this paper, we propose a class of robust stochastic subgradient methods for distributed learning from heterogeneous datasets at presence of an unknown number of Byzantine workers. The Byzantine workers, during the learning process, may…

Machine Learning · Computer Science 2019-11-12 Liping Li , Wei Xu , Tianyi Chen , Georgios B. Giannakis , Qing Ling

Motivated, in part, by the rise of permissionless systems such as Bitcoin where arbitrary nodes (whose identities are not known apriori) can join and leave at will, we extend established research in scalable Byzantine agreement to a more…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-26 John Augustine , Valerie King , Anisur R. Molla , Gopal Pandurangan , Jared Saia

It is a common belief that Byzantine fault-tolerant solutions for consensus are significantly slower than their crash fault-tolerant counterparts. Indeed, in PBFT, the most widely known Byzantine fault-tolerant consensus protocol, it takes…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-28 Petr Kuznetsov , Andrei Tonkikh , Yan X Zhang

Replicated services are inherently vulnerable to failures and security breaches. In a long-running system, it is, therefore, indispensable to maintain a reconfiguration mechanism that would replace faulty replicas with correct ones. An…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-22 Petr Kuznetsov , Andrei Tonkikh

The success of machine learning (ML) has been intimately linked with the availability of large amounts of data, typically collected from heterogeneous sources and processed on vast networks of computing devices (also called {\em workers}).…

Machine Learning · Computer Science 2024-05-02 Sadegh Farhadkhani , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot

The goal of Byzantine Broadcast (BB) is to allow a set of fault-free nodes to agree on information that a source node wants to broadcast to them, in the presence of Byzantine faulty nodes. We consider design of efficient algorithms for BB…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-05-03 Guanfeng Liang , Nitin Vaidya

In this paper we present an open source, fully asynchronous, leaderless algorithm for reaching consensus in the presence of Byzantine faults in an asynchronous network. We prove the algorithm's correctness provided that less than a third of…

Cryptography and Security · Computer Science 2019-07-29 Pierre Chevalier , Bartlomiej Kaminski , Fraser Hutchison , Qi Ma , Spandan Sharma , Andreas Fackler , William J Buchanan

In this work, we consider the distributed stochastic optimization problem of minimizing a non-convex function $f(x) = \mathbb{E}_{\xi \sim \mathcal{D}} f(x; \xi)$ in an adversarial setting, where the individual functions $f(x; \xi)$ can…

Optimization and Control · Mathematics 2019-12-11 Prashant Khanduri , Saikiran Bulusu , Pranay Sharma , Pramod K. Varshney

Consensus in decentralized systems that asynchronously receive events and which are subject to Byzantine faults is a common problem with many real-life applications. Advances in decentralized systems, such as distributed ledger (i.e.,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-05 Fedor Muratov , Andrei Lebedev , Nikolai Iushkevich , Bulat Nasrulin , Makoto Takemiya

In this paper, we study the challenging task of Byzantine-robust decentralized training on arbitrary communication graphs. Unlike federated learning where workers communicate through a server, workers in the decentralized environment can…

Machine Learning · Computer Science 2023-04-21 Lie He , Sai Praneeth Karimireddy , Martin Jaggi

Byzantine agreement is a fundamental problem in fault-tolerant distributed networks that has been studied intensively for the last four decades. Most of these works designed protocols for complete networks. A key goal in Byzantine protocols…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-29 John Augustine , Fabien Dufoulon , Gopal Pandurangan

We give fault-tolerant algorithms for establishing synchrony in distributed systems in which each of the $n$ nodes has its own clock. Our algorithms operate in a very strong fault model: we require self-stabilisation, i.e., the initial…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-12 Christoph Lenzen , Joel Rybicki

Numerous distributed applications, such as cloud computing and distributed ledgers, necessitate the system to invoke asynchronous consensus objects an unbounded number of times, where the completion of one consensus instance is followed by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-28 Chryssis Georgiou , Michel Raynal , Elad M. Schiller

In this paper, we consider the problem of distributed detection in tree topologies in the presence of Byzantines. The expression for minimum attacking power required by the Byzantines to blind the fusion center (FC) is obtained. More…

Applications · Statistics 2015-06-17 Bhavya Kailkhura , Swastik Brahma , Yunghsiang S. Han , Pramod K. Varshney

In Byzantine robust distributed or federated learning, a central server wants to train a machine learning model over data distributed across multiple workers. However, a fraction of these workers may deviate from the prescribed algorithm…

Machine Learning · Computer Science 2023-11-23 Sai Praneeth Karimireddy , Lie He , Martin Jaggi