English
Related papers

Related papers: Delayed Momentum Aggregation: Communication-effici…

200 papers

The increasing popularity of the federated learning (FL) framework due to its success in a wide range of collaborative learning tasks also induces certain security concerns. Among many vulnerabilities, the risk of Byzantine attacks is of…

Machine Learning · Computer Science 2024-01-02 Kerem Ozfatura , Emre Ozfatura , Alptekin Kupcu , Deniz Gunduz

In Federated Reinforcement Learning (FRL), agents aim to collaboratively learn a common task, while each agent is acting in its local environment without exchanging raw trajectories. Existing approaches for FRL either (a) do not provide any…

Machine Learning · Computer Science 2024-01-09 Philip Jordan , Florian Grötschla , Flint Xiaofeng Fan , Roger Wattenhofer

Federated learning is a framework for distributed optimization that places emphasis on communication efficiency. In particular, it follows a client-server broadcast model and is particularly appealing because of its ability to accommodate…

Machine Learning · Computer Science 2022-03-30 Han Wang , Siddartha Marella , James Anderson

We develop a communication-efficient distributed learning algorithm that is robust against Byzantine worker machines. We propose and analyze a distributed gradient-descent algorithm that performs a simple thresholding based on gradient…

Machine Learning · Computer Science 2021-08-17 Avishek Ghosh , Raj Kumar Maity , Swanand Kadhe , Arya Mazumdar , Kannan Ramchandran

A set of mobile robots (represented as points) is distributed in the Cartesian plane. The collection contains an unknown subset of byzantine robots which are indistinguishable from the reliable ones. The reliable robots need to gather,…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-08 Jurek Czyzowicz , Ryan Killick , Evangelos Kranakis , Danny Krizanc , Oscar Morale-Ponce

Byzantine-robust Federated Learning (FL) aims to counter malicious clients and train an accurate global model while maintaining an extremely low attack success rate. Most existing systems, however, are only robust when most of the clients…

Cryptography and Security · Computer Science 2023-11-17 Rui Wang , Xingkai Wang , Huanhuan Chen , Jérémie Decouchant , Stjepan Picek , Nikolaos Laoutaris , Kaitai Liang

Decentralized Learning (DL) is a peer--to--peer learning approach that allows a group of users to jointly train a machine learning model. To ensure correctness, DL should be robust, i.e., Byzantine users must not be able to tamper with the…

Machine Learning · Computer Science 2023-03-08 Mathilde Raynal , Dario Pasquini , Carmela Troncoso

Federated learning is a distributed training framework vulnerable to Byzantine attacks, particularly when over 50% of clients are malicious or when datasets are highly non-independent and identically distributed (non-IID). Additionally,…

Cryptography and Security · Computer Science 2025-08-04 Haocheng Jiang , Hua Shen , Jixin Zhang , Willy Susilo , Mingwu Zhang

This paper considers the problem of Byzantine fault-tolerance in multi-agent decentralized optimization. In this problem, each agent has a local cost function. The goal of a decentralized optimization algorithm is to allow the agents to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-01 Nirupam Gupta , Thinh T. Doan , Nitin H. Vaidya

In this paper, we propose a class of robust stochastic subgradient methods for distributed learning from heterogeneous datasets at presence of an unknown number of Byzantine workers. The Byzantine workers, during the learning process, may…

Machine Learning · Computer Science 2019-11-12 Liping Li , Wei Xu , Tianyi Chen , Georgios B. Giannakis , Qing Ling

Machine Learning (ML) solutions are nowadays distributed, according to the so-called server/worker architecture. One server holds the model parameters while several workers train the model. Clearly, such architecture is prone to various…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-03 El-Mahdi El-Mhamdi , Rachid Guerraoui , Arsany Guirguis , Lê Nguyên Hoang , Sébastien Rouault

Standard federated learning algorithms are vulnerable to adversarial nodes, a.k.a. Byzantine failures. To solve this issue, robust distributed learning algorithms have been developed, which typically replace parameter averaging by robust…

Machine Learning · Computer Science 2026-02-04 Renaud Gaucher , Aymeric Dieuleveut , Hadrien Hendrikx

Numerous distributed tasks have to be handled in a setting where a fraction of nodes behaves Byzantine, that is, deviates arbitrarily from the intended protocol. Resilient, deterministic protocols rely on the detection of majorities to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-10 Philipp Schneider

Traditional statistical methods need to be updated to work with modern distributed data storage paradigms. A common approach is the split-and-conquer framework, which involves learning models on local machines and averaging their parameter…

Methodology · Statistics 2026-04-22 Qiong Zhang , Yan Shuo Tan , Jiahua Chen

Federated recommendation systems can provide good performance without collecting users' private data, making them attractive. However, they are susceptible to low-cost poisoning attacks that can degrade their performance. In this paper, we…

Machine Learning · Computer Science 2020-06-16 Chen Chen , Jingfeng Zhang , Anthony K. H. Tung , Mohan Kankanhalli , Gang Chen

Byzantine machine learning (ML) aims to ensure the resilience of distributed learning algorithms to misbehaving (or Byzantine) machines. Although this problem received significant attention, prior works often assume the data held by the…

Machine Learning · Computer Science 2023-02-06 Youssef Allouah , Sadegh Farhadkhani , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , John Stephan

The problem of designing distributed optimization algorithms that are resilient to Byzantine adversaries has received significant attention. For the Byzantine-resilient distributed optimization problem, the goal is to (approximately)…

Optimization and Control · Mathematics 2024-12-30 Kananart Kuwaranancharoen , Shreyas Sundaram

Federated learning systems are susceptible to adversarial attacks. To combat this, we introduce a novel aggregator based on Huber loss minimization, and provide a comprehensive theoretical analysis. Under independent and identically…

Machine Learning · Computer Science 2024-03-26 Puning Zhao , Fei Yu , Zhiguo Wan

We study stochastic gradient descent (SGD) with local iterations in the presence of malicious/Byzantine clients, motivated by the federated learning. The clients, instead of communicating with the central server in every iteration, maintain…

Machine Learning · Statistics 2020-08-18 Deepesh Data , Suhas Diggavi

We propose PRISM-FCP (Partial shaRing and robust calIbration with Statistical Margins for Federated Conformal Prediction), a Byzantine-resilient federated conformal prediction framework that utilizes partial model sharing to improve…

Machine Learning · Computer Science 2026-02-23 Ehsan Lari , Reza Arablouei , Stefan Werner