English
Related papers

Related papers: Finite-time Guarantees for Byzantine-Resilient Dis…

200 papers

Federated learning enables training collaborative machine learning models at scale with many participants whilst preserving the privacy of their datasets. Standard federated learning techniques are vulnerable to Byzantine failures, biased…

Machine Learning · Statistics 2019-09-12 Luis Muñoz-González , Kenneth T. Co , Emil C. Lupu

This paper studies Byzantine-robust stochastic optimization over a decentralized network, where every agent periodically communicates with its neighbors to exchange local models, and then updates its own local model by stochastic gradient…

Machine Learning · Computer Science 2023-08-11 Jie Peng , Weiyu Li , Qing Ling

In collaborative and distributed learning, Byzantine robustness reflects a major facet of optimization algorithms. Such distributed algorithms are often accompanied by transmitting a large number of parameters, so communication compression…

Machine Learning · Computer Science 2026-04-07 Yanghao Li , Changxin Liu , Yuhao Yi

We revisit Byzantine tolerant reliable broadcast with honest dealer algorithms in multi-hop networks. To tolerate Byzantine faulty nodes arbitrarily spread over the network, previous solutions require a factorial number of messages to be…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-13 Silvia Bonomi , Giovanni Farina , Sébastien Tixeuil

Machine Learning (ML) solutions are nowadays distributed, according to the so-called server/worker architecture. One server holds the model parameters while several workers train the model. Clearly, such architecture is prone to various…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-03 El-Mahdi El-Mhamdi , Rachid Guerraoui , Arsany Guirguis , Lê Nguyên Hoang , Sébastien Rouault

Distributed learning has become the standard approach for training large-scale machine learning models across private data silos. While distributed learning enhances privacy preservation and training efficiency, it faces critical challenges…

Machine Learning · Computer Science 2024-09-16 Changxin Liu , Yanghao Li , Yuhao Yi , Karl H. Johansson

State-of-the-art machine learning models are routinely trained on large-scale distributed clusters. Crucially, such systems can be compromised when some of the computing devices exhibit abnormal (Byzantine) behavior and return arbitrary…

Machine Learning · Computer Science 2022-01-25 Konstantinos Konstantinidis , Aditya Ramamoorthy

This work studies the problem of non-Bayesian learning over multi-agent network when there are some adversarial (faulty) agents in the network. At each time step, each non-faulty agent collects partial information about an unknown state of…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-08 Pooja Vyavahare , Lili Su , Nitin H. Vaidya

This paper presents a consensus algorithm for a multi-agent system where each agent has access to its imperfect own state and neighboring state measurements. The measurements are subject to deterministic disturbances and the proposed…

Systems and Control · Computer Science 2014-09-22 Mohammad Zamani , Iman Shames , Valery Ugrinovskii

We propose a novel relaxation of the classic asynchronous network model, called the random asynchronous model, which removes adversarial message scheduling while preserving unbounded message delays and Byzantine faults. Instead of an…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-27 George Danezis , Jovan Komatovic , Lefteris Kokoris-Kogias , Alberto Sonnino , Igor Zablotchi

This paper proposes the first implementation of a self-stabilizing regular register emulated by $n$ servers that is tolerant to both mobile Byzantine agents, and \emph{transient failures} in a round-free synchronous model. Differently from…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-24 Silvia Bonomi , Antonella Del Pozzo , Maria Potop-Butucaru , Sébastien Tixeuil

This paper proposes a Byzantine-resilient consensus-based distributed filter (BR-CDF) wherein network agents employ partial sharing of state parameters. We characterize the performance and convergence of the BR-CDF and study the impact of a…

Signal Processing · Electrical Eng. & Systems 2023-07-27 Ashkan Moradi , Vinay Chakravarthi Gogineni , Naveen K. D. Venkategowda , Stefan Werner

Secure networks rely upon players to maintain security and reliability. However not every player can be assumed to have total loyalty and one must use methods to uncover traitors in such networks. We use the original concept of the…

Cryptography and Security · Computer Science 2007-05-23 Liam Wagner , Stuart McDonald

Distributed optimization with open collaboration is a popular field since it provides an opportunity for small groups/companies/universities, and individuals to jointly solve huge-scale problems. However, standard optimization algorithms…

Optimization and Control · Mathematics 2023-03-09 Nikita Fedin , Eduard Gorbunov

We study distributed stochastic gradient descent (SGD) in the master-worker architecture under Byzantine attacks. We consider the heterogeneous data model, where different workers may have different local datasets, and we do not make any…

Machine Learning · Statistics 2020-05-19 Deepesh Data , Suhas Diggavi

The goal of Byzantine Broadcast (BB) is to allow a set of fault-free nodes to agree on information that a source node wants to broadcast to them, in the presence of Byzantine faulty nodes. We consider design of efficient algorithms for BB…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-05-03 Guanfeng Liang , Nitin Vaidya

This paper introduces a deterministic Byzantine consensus algorithm that relies on a new weak coordinator. As opposed to previous algorithms that cannot terminate in the presence of a faulty or slow coordinator, our algorithm can terminate…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-26 Tyler Crain , Vincent Gramoli , Mikel Larrea , Michel Raynal

Approximate byzantine consensus is a fundamental problem of distributed computing. This paper presents a novel algorithm for approximate byzantine consensus, called Relay-ABC. The algorithm allows machines to achieve approximate consensus…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-29 Matthew Ding

In this paper, we address the discrete-time dynamic average consensus (DAC) of a multi-agent system in the presence of adversarial attacks. The adversarial attack is considered to be of Byzantine type, which compromises the computation…

Systems and Control · Electrical Eng. & Systems 2023-03-16 Shamik Bhattacharyya , Rachel Kalpana Kalaimani

Decentralized stochastic gradient algorithms efficiently solve large-scale finite-sum optimization problems when all agents in the network are reliable. However, most of these algorithms are not resilient to adverse conditions, such as…

Optimization and Control · Mathematics 2025-06-24 Jinhui Hu , Guo Chen , Huaqing Li , Xiaoyu Guo , Liang Ran , Tingwen Huang