English
Related papers

Related papers: Robust and Scalable Renaming with Subquadratic Bit…

200 papers

The problem of designing distributed optimization algorithms that are resilient to Byzantine adversaries has received significant attention. For the Byzantine-resilient distributed optimization problem, the goal is to (approximately)…

Optimization and Control · Mathematics 2024-12-30 Kananart Kuwaranancharoen , Shreyas Sundaram

The Byzantine agreement problem is considered to be a core problem in distributed systems. For example, Byzantine agreement is needed to build a blockchain, a totally ordered log of records. Blockchains are asynchronous distributed systems,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-27 Ye Wang , Roger Wattenhofer

Applications in machine learning, optimization, and control require the sequential selection of a few system elements, such as sensors, data, or actuators, to optimize the system performance across multiple time steps. However, in…

Machine Learning · Statistics 2020-12-17 Vasileios Tzoumas , Ali Jadbabaie , George J. Pappas

A plethora of modern machine learning tasks require the utilization of large-scale distributed clusters as a critical component of the training pipeline. However, abnormal Byzantine behavior of the worker nodes can derail the training and…

Machine Learning · Computer Science 2023-05-16 Konstantinos Konstantinidis , Namrata Vaswani , Aditya Ramamoorthy

We propose the first deterministic algorithm that tolerates up to $f$ byzantine faults in $3f+1$-sized networks and performs in the asynchronous CORDA model. Our solution matches the previously established lower bound for the…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-13 Zohir Bouzid , Maria Potop-Butucaru , Sébastien Tixeuil

In this paper, we study the problem of distributed training (DT) under Byzantine attacks with communication constraints. While prior work has developed various robust aggregation rules at the server to enhance robustness to Byzantine…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-01 Chengxi Li , Youssef Allouah , Rachid Guerraoui , Mikael Skoglund , Ming Xiao

Distributed Learning often suffers from Byzantine failures, and there have been a number of works studying the problem of distributed stochastic optimization under Byzantine failures, where only a portion of workers, instead of all the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-17 Kaiyun Li , Xiaojun Chen , Ye Dong , Peng Zhang , Dakui Wang , Shuai Zen

We address the problem of reaching consensus in the presence of Byzantine faults. In particular, we are interested in investigating the impact of messages relay on the network connectivity for a correct iterative approximate Byzantine…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-04-17 Lili Su , Nitin Vaidya

We provide a new protocol for Validated Asynchronous Byzantine Agreement. Validated (multi-valued) Asynchronous Byzantine Agreement is a key building block in constructing Atomic Broadcast and fault-tolerant state machine replication in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-06 Ittai Abraham , Dahlia Malkhi , Alexander Spiegelman

We introduce an information-theoretic framework, named Coded State Machine (CSM), to securely and efficiently execute multiple state machines on untrusted network nodes, some of which are Byzantine. The standard method of solving this…

Information Theory · Computer Science 2019-06-27 Songze Li , Saeid Sahraei , Mingchao Yu , Salman Avestimehr , Sreeram Kannan , Pramod Viswanath

This paper considers the problem of Byzantine fault tolerance in distributed linear regression in a multi-agent system. However, the proposed algorithms are given for a more general class of distributed optimization problems, of which…

Machine Learning · Computer Science 2019-04-05 Nirupam Gupta , Nitin H. Vaidya

Byzantine machine learning (ML) aims to ensure the resilience of distributed learning algorithms to misbehaving (or Byzantine) machines. Although this problem received significant attention, prior works often assume the data held by the…

Machine Learning · Computer Science 2023-02-06 Youssef Allouah , Sadegh Farhadkhani , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , John Stephan

This paper focuses on decentralized stochastic optimization in the presence of Byzantine attacks. During the optimization process, an unknown number of malfunctioning or malicious workers, termed as Byzantine workers, disobey the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-13 Zhaoxian Wu , Tianyi Chen , Qing Ling

Self-stabilization is a versatile approach to fault-tolerance since it permits a distributed system to recover from any transient fault that arbitrarily corrupts the contents of all memories in the system. Byzantine tolerance is an…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-02-11 Swan Dubois , Toshimitsu Masuzawa , Sébastien Tixeuil

We develop a distributed second order optimization algorithm that is communication-efficient as well as robust against Byzantine failures of the worker machines. We propose COMRADE (COMunication-efficient and Robust Approximate Distributed…

Machine Learning · Computer Science 2021-03-19 Avishek Ghosh , Raj Kumar Maity , Arya Mazumdar

Self-stabilization is a versatile approach to fault-tolerance since it permits a distributed system to recover from any transient fault that arbitrarily corrupts the contents of all memories in the system. Byzantine tolerance is an…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-05-31 Swan Dubois , Toshimitsu Masuzawa , Sébastien Tixeuil

Clock synchronization is a very fundamental task in distributed system. It thus makes sense to require an underlying clock synchronization mechanism to be highly fault-tolerant. A self-stabilizing algorithm seeks to attain synchronization…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Ariel Daliot , Danny Dolev , Hanna Parnas

Distributed model training is vulnerable to byzantine system failures and adversarial compute nodes, i.e., nodes that use malicious updates to corrupt the global model stored at a parameter server (PS). To guarantee some form of robustness,…

Machine Learning · Statistics 2018-06-25 Lingjiao Chen , Hongyi Wang , Zachary Charles , Dimitris Papailiopoulos

We present a scheme to convert self-stabilizing algorithms that use randomization during and following convergence to self-stabilizing algorithms that use randomization only during convergence. We thus reduce the number of random bits from…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-13 Shlomi Dolev , Nir Tzachar

Randomisation is a critical tool in designing distributed systems. The common coin primitive, enabling the system members to agree on an unpredictable random number, has proven to be particularly useful. We observe, however, that it is…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-25 Luciano Freitas , Petr Kuznetsov , Andrei Tonkikh