English
Related papers

Related papers: Finite-time Guarantees for Byzantine-Resilient Dis…

200 papers

A crucial challenge in decentralized systems is state estimation in the presence of unknown inputs, particularly within heterogeneous sensor networks with dynamic topologies. While numerous consensus algorithms have been introduced, they…

Systems and Control · Electrical Eng. & Systems 2024-12-13 Zida Wu , Ankur Mehta

We study a recently proposed large-scale distributed learning paradigm, namely Federated Learning, where the worker machines are end users' own devices. Statistical and computational challenges arise in Federated Learning particularly in…

Machine Learning · Computer Science 2019-10-11 Avishek Ghosh , Justin Hong , Dong Yin , Kannan Ramchandran

We introduce a distributed, cooperative framework and method for Bayesian estimation and control in decentralized agent networks. Our framework combines joint estimation of time-varying global and local states with information-seeking…

Systems and Control · Computer Science 2015-09-24 Florian Meyer , Henk Wymeersch , Markus Fröhle , Franz Hlawatsch

We demonstrate that the Byzantine Agreement (detectable broadcast) is also solvable in the continuous-variable scenario with multipartite entangled Gaussian states and Gaussian operations (homodyne detection). Within this scheme we find…

Quantum Physics · Physics 2008-06-09 Rodion Neigovzen , C. Rodó , Gerardo Adesso , A. Sanpera

We propose two novel stochastic gradient descent algorithms, ByGARS and ByGARS++, for distributed machine learning in the presence of any number of Byzantine adversaries. In these algorithms, reputation scores of workers are computed using…

Machine Learning · Computer Science 2020-12-09 Jayanth Regatti , Hao Chen , Abhishek Gupta

As large language model (LLM) agents increasingly integrate into our infrastructure, their robust coordination and message synchronization become vital. The Byzantine Generals Problem (BGP) is a critical model for constructing resilient…

Multiagent Systems · Computer Science 2024-10-24 Yihuan Mao , Yipeng Kang , Peilun Li , Ning Zhang , Wei Xu , Chongjie Zhang

We study stochastic gradient descent (SGD) with local iterations in the presence of malicious/Byzantine clients, motivated by the federated learning. The clients, instead of communicating with the central server in every iteration, maintain…

Machine Learning · Statistics 2020-08-18 Deepesh Data , Suhas Diggavi

We study a framework for modeling distributed network systems assisted by a reliable and powerful cloud service. Our framework aims at capturing hybrid systems based on a point to point message passing network of machines, with the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-29 John Augustine , Jeffin Biju , Shachar Meir , David Peleg , Srikkanth Ramachandran , Aishwarya Thiruvengadam

Byzantine reliable broadcast is a powerful primitive that allows a set of processes to agree on a message from a designated sender, even if some processes (including the sender) are Byzantine. Existing broadcast protocols for this setting…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-21 Rachid Guerraoui , Petr Kuznetsov , Matteo Monti , Matej Pavlovic , Dragos-Adrian Seredinschi , Yann Vonlanthen

This paper explores the problem good-case latency of Byzantine fault-tolerant broadcast, motivated by the real-world latency and performance of practical state machine replication protocols. The good-case latency measures the time it takes…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-14 Ittai Abraham , Kartik Nayak , Ling Ren , Zhuolun Xiang

We study how to efficiently diffuse updates to a large distributed system of data replicas, some of which may exhibit arbitrary (Byzantine) failures. We assume that strictly fewer than $t$ replicas fail, and that each update is initially…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Dahlia Malkhi , Yishay Mansour , Michael Reiter

Robust distributed learning algorithms aim to maintain reliable performance despite the presence of misbehaving workers. Such misbehaviors are commonly modeled as Byzantine failures, allowing arbitrarily corrupted communication, or as data…

Machine Learning · Computer Science 2025-10-17 Thomas Boudou , Batiste Le Bars , Nirupam Gupta , Aurélien Bellet

Adversarial attacks attempt to disrupt the training, retraining and utilizing of artificial intelligence and machine learning models in large-scale distributed machine learning systems. This causes security risks on its prediction outcome.…

Cryptography and Security · Computer Science 2021-09-07 Yusen Wu , Hao Chen , Xin Wang , Chao Liu , Phuong Nguyen , Yelena Yesha

In this paper, we study a linear bandit optimization problem in a federated setting where a large collection of distributed agents collaboratively learn a common linear bandit model. Standard federated learning algorithms applied to this…

Machine Learning · Computer Science 2022-04-05 Ali Jadbabaie , Haochuan Li , Jian Qian , Yi Tian

This paper studies resilient multi-agent distributed estimation of an unknown vector parameter when a subset of the agents is adversarial. We present and analyze a Flag Raising Distributed Estimator ($\mathcal{FRDE}$) that allows the agents…

Optimization and Control · Mathematics 2018-05-09 Yuan Chen , Soummya Kar , José M. F. Moura

This report considers the problem of resilient distributed optimization and stochastic learning in a server-based architecture. The system comprises a server and multiple agents, where each agent has its own local cost function. The agents…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-15 Shuo Liu , Nirupam Gupta , Nitin H. Vaidya

We study adversary-resilient stochastic distributed optimization, in which $m$ machines can independently compute stochastic gradients, and cooperate to jointly optimize over their local objective functions. However, an $\alpha$-fraction of…

Machine Learning · Computer Science 2021-04-05 Zeyuan Allen-Zhu , Faeze Ebrahimian , Jerry Li , Dan Alistarh

Given a set of robots with arbitrary initial location and no agreement on a global coordinate system, convergence requires that all robots asymptotically approach the exact same, but unknown beforehand, location. Robots are oblivious-- they…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-05-26 Zohir Bouzid , Maria Potop-Butucaru , Sébastien Tixeuil

In this report, we investigate the multi-valued Byzantine consensus problem. We introduce two algorithms: the first one achieves traditional validity requirement for consensus, and the second one achieves a stronger "q-validity"…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-10 Guanfeng Liang , Nitin Vaidya

At PODC 2014, A. Most\'efaoui, H. Moumen, and M. Raynal presented a new and simple randomized signature-free binary consensus algorithm (denoted here MMR) that copes with the net effect of asynchrony Byzantine behaviors. Assuming message…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-24 Chryssis Georgiou , Ioannis Marcoullis , Michel Raynal , Elad Michael Schiller