English
Related papers

Related papers: Delayed Momentum Aggregation: Communication-effici…

200 papers

In federated learning, most existing robust aggregation rules (AGRs) combat Byzantine attacks in the IID setting, where client data is assumed to be independent and identically distributed. In this paper, we address label skewness, a more…

Machine Learning · Computer Science 2024-03-21 Wenxuan Bao , Jun Wu , Jingrui He

This paper investigates the task solvability of mobile robot systems subject to Byzantine faults. We first consider the gathering problem, which requires all robots to meet in finite time at a non-predefined location. It is known that the…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-02 Taisuke Izumi , Zohir Bouzid , Sébastien Tixeuil , Koichi Wada

Federated learning (FL) enables multiple clients to collaboratively train machine learning models without revealing their private training data. In conventional FL, the system follows the server-assisted architecture (server-assisted FL),…

Cryptography and Security · Computer Science 2024-07-16 Minghong Fang , Zifan Zhang , Hairi , Prashant Khanduri , Jia Liu , Songtao Lu , Yuchen Liu , Neil Gong

Distributed control systems require high reliability and availability guarantees despite often being deployed at the edge of network infrastructure. Edge computing resources are less secure and less reliable than centralized resources in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-21 Roy Shadmon , Daniel Spencer , Owen Arden

Federated Learning is a collaborative training framework that leverages heterogeneous data distributed across a vast number of clients. Since it is practically infeasible to request and process all clients during the aggregation step,…

Machine Learning · Computer Science 2023-06-07 Michał Grudzień , Grigory Malinovsky , Peter Richtárik

It is a common belief that Byzantine fault-tolerant solutions for consensus are significantly slower than their crash fault-tolerant counterparts. Indeed, in PBFT, the most widely known Byzantine fault-tolerant consensus protocol, it takes…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-28 Petr Kuznetsov , Andrei Tonkikh , Yan X Zhang

We study Byzantine-resilient distributed multi-agent reinforcement learning (MARL), where agents must collaboratively learn optimal value functions over a compromised communication network. Existing resilient MARL approaches typically…

Multiagent Systems · Computer Science 2026-04-06 Haejoon Lee , Dimitra Panagou

Federated Learning is a distributed machine learning approach which enables model training without data sharing. In this paper, we propose a new federated learning algorithm, Federated Averaging with Client-level Momentum (FedCM), to tackle…

Machine Learning · Computer Science 2021-06-22 Jing Xu , Sen Wang , Liwei Wang , Andrew Chi-Chih Yao

This paper considers the problem of Byzantine fault tolerance in distributed linear regression in a multi-agent system. However, the proposed algorithms are given for a more general class of distributed optimization problems, of which…

Machine Learning · Computer Science 2019-04-05 Nirupam Gupta , Nitin H. Vaidya

In this paper, we propose a first-order distributed optimization algorithm that is provably robust to Byzantine failures-arbitrary and potentially adversarial behavior, where all the participating agents are prone to failure. We model each…

Optimization and Control · Mathematics 2022-07-27 Berkay Turan , Cesar A. Uribe , Hoi-To Wai , Mahnoosh Alizadeh

We consider distributed optimization under Byzantine attacks in the presence of $(L_0,L_1)$-smoothness, a generalization of standard $L$-smoothness that captures functions with state-dependent gradient Lipschitz constants. We propose…

Machine Learning · Computer Science 2026-03-16 Arman Bolatov , Samuel Horváth , Martin Takáč , Eduard Gorbunov

In this paper, we study a linear bandit optimization problem in a federated setting where a large collection of distributed agents collaboratively learn a common linear bandit model. Standard federated learning algorithms applied to this…

Machine Learning · Computer Science 2022-04-05 Ali Jadbabaie , Haochuan Li , Jian Qian , Yi Tian

Federated Learning (FL) enables decentralized model training without sharing raw data. However, it remains vulnerable to Byzantine attacks, which can compromise the aggregation of locally updated parameters at the central server.…

Machine Learning · Computer Science 2025-09-30 Shiyuan Zuo , Rongfei Fan , Cheng Zhan , Jie Xu , Puning Zhao , Han Hu

This paper proposes a Byzantine-resilient consensus framework that simultaneously pursues two tightly coupled objectives: actively identifying Byzantine agents and guaranteeing resilient consensus among normal agents. Unlike existing…

Optimization and Control · Mathematics 2026-05-13 Rui Huang , Changxin Liu , Wen-Hua Chen , Yang Shi

We consider the problem of approximate consensus in mobile networks containing Byzantine nodes. We assume that each correct node can communicate only with its neighbors and has no knowledge of the global topology. As all nodes have moving…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-06-04 Chuanyou Li , Michel Hurfin , Yun Wang

Federated Learning (FL) trains a global model across decentralized clients while preserving data privacy, but at scale it is vulnerable to malicious updates. Byzantine-resilient aggregation methods such as MultiKrum score gradients against…

Machine Learning · Computer Science 2026-05-19 Andras Ferenczi , Sutapa Samanta , Dagen Wang , Jason Qizhe Qin

Federated learning (FL) is an emerging distributed learning paradigm without sharing participating clients' private data. However, existing works show that FL is vulnerable to both Byzantine (security) attacks and data reconstruction…

Cryptography and Security · Computer Science 2024-07-30 Chenfei Nie , Qiang Li , Yuxin Yang , Yuede Ji , Binghui Wang

This paper introduces a deep learning-based framework for resilient decision fusion in adversarial multi-sensor networks, providing a unified mathematical setup that encompasses diverse scenarios, including varying Byzantine node…

Machine Learning · Computer Science 2024-12-18 Kassem Kallas

We demonstrate a deterministic Byzantine consensus algorithm with synchronous operation in partial synchrony. It is naturally leaderless, tolerates any number of $ f<n/2 $ Byzantine processes with 2 rounds of exchange of originator-only…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-16 Ivan Klianev

Byzantine-robustness has been gaining a lot of attention due to the growth of the interest in collaborative and federated learning. However, many fruitful directions, such as the usage of variance reduction for achieving robustness and…

Machine Learning · Computer Science 2023-03-09 Eduard Gorbunov , Samuel Horváth , Peter Richtárik , Gauthier Gidel