English
Related papers

Related papers: Byzantine-Robust and Communication-Efficient Distr…

200 papers

With the increasing importance of machine learning, the privacy and security of training data have become critical. Federated learning, which stores data in distributed nodes and shares only model parameters, has gained significant…

Machine Learning · Computer Science 2025-07-10 Yang Li , Chunhe Xia , Chang Li , Tianbo Wang

Decentralized learning involves training machine learning models over remote mobile devices, edge servers, or cloud servers while keeping data localized. Even though many studies have shown the feasibility of preserving privacy, enhancing…

Cryptography and Security · Computer Science 2022-01-07 Minghui Xu , Zongrui Zou , Ye Cheng , Qin Hu , Dongxiao Yu , Xiuzhen Cheng

We study a recently proposed large-scale distributed learning paradigm, namely Federated Learning, where the worker machines are end users' own devices. Statistical and computational challenges arise in Federated Learning particularly in…

Machine Learning · Computer Science 2019-10-11 Avishek Ghosh , Justin Hong , Dong Yin , Kannan Ramchandran

This paper considers a distributed optimization problem in the presence of Byzantine agents capable of introducing untrustworthy information into the communication network. A resilient distributed subgradient algorithm is proposed based on…

Optimization and Control · Mathematics 2023-03-22 Jingxuan Zhu , Yixuan Lin , Alvaro Velasquez , Ji Liu

We consider unreliable distributed learning systems wherein the training data is kept confidential by external workers, and the learner has to interact closely with those workers to train a model. In particular, we assume that there exists…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-10 Lili Su , Jiaming Xu

Federated learning (FL) facilitates distributed training across different IoT and edge devices, safeguarding the privacy of their data. The inherent distributed structure of FL introduces vulnerabilities, especially from adversarial devices…

Cryptography and Security · Computer Science 2023-11-13 Shenghui Li , Edith Ngai , Fanghua Ye , Li Ju , Tianru Zhang , Thiemo Voigt

Network traffic prediction plays a crucial role in intelligent network operation. Traditional prediction methods often rely on centralized training, necessitating the transfer of vast amounts of traffic data to a central server. This…

Machine Learning · Computer Science 2025-05-27 Hui Ma , Kai Yang , Yang Jiao

Federated Learning (FL) is notorious for its vulnerability to Byzantine attacks. Most current Byzantine defenses share a common inductive bias: among all the gradients, the densely distributed ones are more likely to be honest. However,…

Machine Learning · Computer Science 2025-02-17 Yuchen Liu , Chen Chen , Lingjuan Lyu , Yaochu Jin , Gang Chen

Federated Learning (FL) enables multiple clients to collaboratively train models without sharing raw data, but it is highly vulnerable to Byzantine attacks. Existing robust approaches can neutralize these threats but incur substantial…

Machine Learning · Computer Science 2026-05-28 Shiyuan Zuo , Jiashuo Li , Rongfei Fan , Han Hu , Jie Xu

This paper studies the problem of cooperative control of heterogeneous multi-agent systems (MASs) against Byzantine attacks. The agent affected by Byzantine attacks sends different wrong values to all neighbors while applying wrong input…

Systems and Control · Electrical Eng. & Systems 2023-03-28 Xin Gong , Yiwen Liang , Yukang Cui , Shi Liang , Tingwen Huang

In this paper, we propose a robust aggregation method for federated learning (FL) that can effectively tackle malicious Byzantine attacks. At each user, model parameter is firstly updated by multiple steps, which is adjustable over…

Machine Learning · Computer Science 2023-08-22 Shiyuan Zuo , Rongfei Fan , Han Hu , Ning Zhang , Shimin Gong

Federated learning (FL) enables a set of geographically distributed clients to collectively train a model through a server. Classically, the training process is synchronous, but can be made asynchronous to maintain its speed in presence of…

Machine Learning · Computer Science 2024-06-21 Bart Cox , Abele Mălan , Lydia Y. Chen , Jérémie Decouchant

Federated learning (FL) is designed to preserve data privacy during model training, where the data remains on the client side (i.e., IoT devices), and only model updates of clients are shared iteratively for collaborative learning. However,…

Machine Learning · Computer Science 2023-09-08 Zikai Zhang , Rui Hu

Analog Lagrange Coded Computing (ALCC) is a recently proposed computational paradigm wherein certain computations over analog datasets are efficiently performed using distributed worker nodes through floating point representation. While the…

Information Theory · Computer Science 2025-10-24 Rimpi Borah , J. Harshan

We investigate the Byzantine attack problem within the context of model training in distributed learning systems. While ensuring the convergence of current model training processes, common solvers (e.g. SGD, Adam, RMSProp, etc.) can be…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-08 Kun Yang , Tianyi Luo , Yanjie Dong , Aohan Li

We consider gradient coding in the presence of an adversary controlling so-called malicious workers trying to corrupt the computations. Previous works propose the use of MDS codes to treat the responses from malicious workers as errors and…

Information Theory · Computer Science 2024-01-08 Christoph Hofmeister , Luis Maßny , Eitan Yaakobi , Rawad Bitar

In this paper, we consider the Byzantine-robust stochastic optimization problem defined over decentralized static and time-varying networks, where the agents collaboratively minimize the summation of expectations of stochastic local cost…

Optimization and Control · Mathematics 2020-12-21 Jie Peng , Weiyu Li , Qing Ling

In this work we study the problem of Byzantine-robust learning when data among clients is heterogeneous. We focus on poisoning attacks targeting the convergence of SGD. Although this problem has received great attention; the main Byzantine…

Machine Learning · Computer Science 2022-10-18 Latifa Errami , El Houcine Bergou

In this paper, we propose a first-order distributed optimization algorithm that is provably robust to Byzantine failures-arbitrary and potentially adversarial behavior, where all the participating agents are prone to failure. We model each…

Optimization and Control · Mathematics 2022-07-27 Berkay Turan , Cesar A. Uribe , Hoi-To Wai , Mahnoosh Alizadeh

In Federated Reinforcement Learning (FRL), agents aim to collaboratively learn a common task, while each agent is acting in its local environment without exchanging raw trajectories. Existing approaches for FRL either (a) do not provide any…

Machine Learning · Computer Science 2024-01-09 Philip Jordan , Florian Grötschla , Flint Xiaofeng Fan , Roger Wattenhofer