English
Related papers

Related papers: Byzantine-Resilient Decentralized Stochastic Optim…

200 papers

This paper considers the problem of detection in distributed networks in the presence of data falsification (Byzantine) attacks. Detection approaches considered in the paper are based on fully distributed consensus algorithms, where all of…

Systems and Control · Computer Science 2017-09-29 Bhavya Kailkhura , Swastik Brahma , Pramod K. Varshney

Byzantine State Machine Replication (SMR) is a long studied topic that received increasing attention recently with the advent of blockchains as companies are trying to scale them to hundreds of nodes. Byzantine SMRs try to increase…

Cryptography and Security · Computer Science 2020-06-15 Gauthier Voron , Vincent Gramoli

Machine learning has begun to play a central role in many applications. A multitude of these applications typically also involve datasets that are distributed across multiple computing devices/machines due to either design constraints…

Machine Learning · Statistics 2022-06-16 Cheng Fang , Zhixiong Yang , Waheed U. Bajwa

This paper proposes a Robust Gradient Classification Framework (RGCF) for Byzantine fault tolerance in distributed stochastic gradient descent. The framework consists of a pattern recognition filter which we train to be able to classify…

Machine Learning · Computer Science 2023-01-19 Shashank Reddy Chirra , Kalyan Varma Nadimpalli , Shrisha Rao

In this work we study the problem of Byzantine-robust learning when data among clients is heterogeneous. We focus on poisoning attacks targeting the convergence of SGD. Although this problem has received great attention; the main Byzantine…

Machine Learning · Computer Science 2022-10-18 Latifa Errami , El Houcine Bergou

Federated learning systems that jointly preserve Byzantine robustness and privacy have remained an open problem. Robust aggregation, the standard defense for Byzantine attacks, generally requires server access to individual updates or…

Cryptography and Security · Computer Science 2021-10-07 Raj Kiriti Velicheti , Derek Xia , Oluwasanmi Koyejo

The proliferation of Internet of Things devices in critical infrastructure has created unprecedented cybersecurity challenges, necessitating collaborative threat detection mechanisms that preserve data privacy while maintaining robustness…

Cryptography and Security · Computer Science 2026-01-06 Milad Rahmati , Nima Rahmati

We study stochastic gradient descent (SGD) with local iterations in the presence of malicious/Byzantine clients, motivated by the federated learning. The clients, instead of communicating with the central server in every iteration, maintain…

Machine Learning · Statistics 2020-08-18 Deepesh Data , Suhas Diggavi

In this paper, we consider a min-max optimization problem under adversarial manipulation, where there are $n$ cost functions, up to $f$ of which may be replaced by arbitrary faulty functions by an adversary. The goal is to minimize the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-19 Shuo Liu , Nitin Vaidya

For reaching dependable high-precision clock synchronization (CS) upon IoT networks, the distributed CS paradigm adopted in ultra-high reliable systems and the master-slave CS paradigm adopted in high-performance but unreliable systems are…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-21 Shaolin Yu , Jihong Zhu , Jiali Yang , Wei Lu

Federated learning (FL) enables a collaborative environment for training machine learning models without sharing training data between users. This is typically achieved by aggregating model gradients on a central server. Decentralized…

Machine Learning · Computer Science 2024-07-09 Siddhartha Bhattacharya , Daniel Helo , Joshua Siegel

Machine Learning (ML) solutions are nowadays distributed and are prone to various types of component failures, which can be encompassed in so-called Byzantine behavior. This paper introduces LiuBei, a Byzantine-resilient ML algorithm that…

Machine Learning · Computer Science 2020-07-21 El Mahdi El Mhamdi , Rachid Guerraoui , Arsany Guirguis

As the network scale increases, existing fully distributed solutions start to lag behind the real-world challenges such as (1) slow information propagation, (2) network communication failures, and (3) external adversarial attacks. In this…

Machine Learning · Computer Science 2023-07-28 Connor Mclaughlin , Matthew Ding , Denis Edogmus , Lili Su

This paper presents a resilient distributed algorithm for solving a system of linear algebraic equations over a multi-agent network in the presence of Byzantine agents capable of arbitrarily introducing untrustworthy information in…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Jingxuan Zhu , Alvaro Velasquez , Ji Liu

Federated Learning (FL) enables clients to collaboratively train a global model without sharing their private data. However, the presence of malicious (Byzantine) clients poses significant challenges to the robustness of FL, particularly…

Machine Learning · Computer Science 2026-05-26 Javad Parsa , Amir Hossein Daghestani , André M. H. Teixeira , Mikael Johansson

Byzantine-robust learning has emerged as a prominent fault-tolerant distributed machine learning framework. However, most techniques focus on the static setting, wherein the identity of Byzantine workers remains unchanged throughout the…

Machine Learning · Computer Science 2024-06-18 Ron Dorfman , Naseem Yehya , Kfir Y. Levy

Optimum decision fusion in the presence of malicious nodes - often referred to as Byzantines - is hindered by the necessity of exactly knowing the statistical behavior of Byzantines. By focusing on a simple, yet widely studied, set-up in…

Systems and Control · Computer Science 2015-07-03 Andrea Abrardo , Mauro Barni , Kassem Kallas , Benedetta Tondi

Population protocols model information spreading and computation in network systems where pairwise node exchanges are determined by an external random scheduler and nodes have small memory. Most of the population protocols in the literature…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-06 Costas Busch , Dariusz R. Kowalski

The cooperative bandit problem is a multi-agent decision problem involving a group of agents that interact simultaneously with a multi-armed bandit, while communicating over a network with delays. The central idea in this problem is to…

Machine Learning · Statistics 2022-05-31 Abhimanyu Dubey , Alex Pentland

We study a recently proposed large-scale distributed learning paradigm, namely Federated Learning, where the worker machines are end users' own devices. Statistical and computational challenges arise in Federated Learning particularly in…

Machine Learning · Computer Science 2019-10-11 Avishek Ghosh , Justin Hong , Dong Yin , Kannan Ramchandran