English
Related papers

Related papers: Dispel: Byzantine SMR with Distributed Pipelining

200 papers

To improve the resilience of distributed training to worst-case, or Byzantine node failures, several recent approaches have replaced gradient averaging with robust aggregation methods. Such techniques can have high computational costs,…

Machine Learning · Computer Science 2020-03-10 Shashank Rajput , Hongyi Wang , Zachary Charles , Dimitris Papailiopoulos

Distributed peer-to-peer (P2P) energy trading mandates an escalating coupling between the physical power network and communication network, necessitating high-frequency sharing of real-time data among prosumers. However, this data-sharing…

Systems and Control · Electrical Eng. & Systems 2025-05-28 Junhong Liu , Qinfei Long , Rong-Peng Liu , Wenjie Liu , Yunhe Hou

Popular blockchains today have hundreds of thousands of nodes and need to be able to support sophisticated scaling solutions$\unicode{x2013}$such as sharding, data availability sampling, and layer-2 methods. Designing secure and efficient…

Networking and Internet Architecture · Computer Science 2025-04-25 Yunqi Zhang , Shaileshh Bojja Venkatakrishnan

Decentralized learning has gained great popularity to improve learning efficiency and preserve data privacy. Each computing node makes equal contribution to collaboratively learn a Deep Learning model. The elimination of centralized…

Machine Learning · Computer Science 2021-10-22 Shangwei Guo , Tianwei Zhang , Han Yu , Xiaofei Xie , Lei Ma , Tao Xiang , Yang Liu

We present Blizzard, a Byzantine Fault Tolerant (BFT) distributed ledger protocol that is aimed at making mobile devices first-class citizens in the consensus process. Blizzard introduces a novel two-tier architecture by having the mobile…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-07 Mehrdad Kiamari , Bhaskar Krishnamachari , Muhammad Naveed , Seokgu Yun

In this paper, we present the most extensive evaluation of blockchain system to date. To achieve scalability across servers in more than 10 countries located on 4 different continents, we drastically revisited Byzantine fault tolerant…

Cryptography and Security · Computer Science 2019-01-01 Tyler Crain , Christopher Natoli , Vincent Gramoli

Robustness to Byzantine attacks is a necessity for various distributed training scenarios. When the training reduces to the process of solving a minimization problem, Byzantine robustness is relatively well-understood. However, other…

The problem of Byzantine consensus has been key to designing secure distributed systems. However, it is particularly difficult, mainly due to the presence of Byzantine processes that act arbitrarily and the unknown message delays in general…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-05 Alejandro Ranchal-Pedrosa , Vincent Gramoli

This paper addresses the problem of combining Byzantine resilience with privacy in machine learning (ML). Specifically, we study if a distributed implementation of the renowned Stochastic Gradient Descent (SGD) learning algorithm is…

Machine Learning · Computer Science 2021-06-25 Rachid Guerraoui , Nirupam Gupta , Rafaël Pinot , Sébastien Rouault , John Stephan

State-of-the-art machine learning models are routinely trained on large-scale distributed clusters. Crucially, such systems can be compromised when some of the computing devices exhibit abnormal (Byzantine) behavior and return arbitrary…

Machine Learning · Computer Science 2022-01-25 Konstantinos Konstantinidis , Aditya Ramamoorthy

We propose three new robust aggregation rules for distributed synchronous Stochastic Gradient Descent~(SGD) under a general Byzantine failure model. The attackers can arbitrarily manipulate the data transferred between the servers and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-28 Cong Xie , Oluwasanmi Koyejo , Indranil Gupta

It is a common belief that Byzantine fault-tolerant solutions for consensus are significantly slower than their crash fault-tolerant counterparts. Indeed, in PBFT, the most widely known Byzantine fault-tolerant consensus protocol, it takes…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-28 Petr Kuznetsov , Andrei Tonkikh , Yan X Zhang

Byzantine-robust distributed learning (BRDL), in which computing devices are likely to behave abnormally due to accidental failures or malicious attacks, has recently become a hot research topic. However, even in the independent and…

Machine Learning · Computer Science 2023-05-24 Yi-Rui Yang , Chang-Wei Shi , Wu-Jun Li

Byzantine general problem is the core problem of the consensus algorithm, and many protocols are proposed recently to improve the decentralization level, the performance and the security of the blockchain. There are two challenging issues…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-09 Tzu-Wei Chao , Hao Chung , Po-Chun Kuo

In this paper, we study the challenging task of Byzantine-robust decentralized training on arbitrary communication graphs. Unlike federated learning where workers communicate through a server, workers in the decentralized environment can…

Machine Learning · Computer Science 2023-04-21 Lie He , Sai Praneeth Karimireddy , Martin Jaggi

Byzantine fault-tolerant agreement (BFT) in a partially synchronous system usually requires 3f + 1 nodes to tolerate f faulty replicas. Due to their high throughput and finality property BFT algorithms build the core of recent permissioned…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-26 Ines Messadi , Markus Horst Becker , Kai Bleeke , Leander Jehl , Sonia Ben Mokhtar , Rüdiger Kapitza

We consider the problem of Byzantine fault-tolerance in the peer-to-peer (P2P) distributed gradient-descent method -- a prominent algorithm for distributed optimization in a P2P system. In this problem, the system comprises of multiple…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-01 Nirupam Gupta , Nitin H. Vaidya

Iterative Approximate Byzantine Consensus (IABC) is a fundamental problem of fault-tolerant distributed computing where machines seek to achieve approximate consensus to arbitrary exactness in the presence of Byzantine failures. We present…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-06 Matthew Ding

Byzantine fault tolerant protocols enable state replication in the presence of crashed, malfunctioning, or actively malicious processes. Designing such protocols without the assistance of verification tools, however, is remarkably…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-23 Joel Wanner , Laurent Chuat , Adrian Perrig

Byzantine-Fault-Tolerant (BFT) systems are rapidly emerging as a viable technology for production-grade systems, notably in closed consortia deployments for nancial and supply-chain applications. Unfortunately, most algorithms proposed so…

Databases · Computer Science 2019-11-11 Loïck Bonniot , Christoph Neumann , François Taïani