中文
相关论文

相关论文: The Hidden Vulnerability of Distributed Learning i…

200 篇论文

In this paper, we investigate the problem of distributed learning (DL) in the presence of Byzantine attacks. For this problem, various robust bounded aggregation (RBA) rules have been proposed at the central server to mitigate the impact of…

机器学习 · 计算机科学 2026-03-18 Chengxi Li , Ming Xiao , Mikael Skoglund

We study local stochastic gradient descent methods for solving federated optimization over a network of agents communicating indirectly through a centralized coordinator. We are interested in the Byzantine setting where there is a subset of…

最优化与控制 · 数学 2024-09-06 Amit Dutta , Thinh T. Doan

Byzantine-robust federated learning aims at mitigating Byzantine failures during the federated training process, where malicious participants may upload arbitrary local updates to the central server to degrade the performance of the global…

机器学习 · 计算机科学 2023-02-15 Shenghui Li , Edith C. -H. Ngai , Thiemo Voigt

There has been a growing need to provide Byzantine-resilience in distributed model training. Existing robust distributed learning algorithms focus on developing sophisticated robust aggregators at the parameter servers, but pay less…

机器学习 · 计算机科学 2021-10-12 Lingjiao Chen , Leshang Chen , Hongyi Wang , Susan Davidson , Edgar Dobriban

While being an effective framework of learning a shared model across multiple edge devices, federated learning (FL) is generally vulnerable to Byzantine attacks from adversarial edge devices. While existing works on FL mitigate such…

机器学习 · 计算机科学 2022-11-01 Youngjoon Lee , Sangwoo Park , Joonhyuk Kang

Recently emerged federated learning (FL) is an attractive distributed learning framework in which numerous wireless end-user devices can train a global model with the data remained autochthonous. Compared with the traditional machine…

密码学与安全 · 计算机科学 2022-10-10 Junyu Shi , Wei Wan , Shengshan Hu , Jianrong Lu , Leo Yu Zhang

This paper studies Byzantine-robust stochastic optimization over a decentralized network, where every agent periodically communicates with its neighbors to exchange local models, and then updates its own local model by stochastic gradient…

机器学习 · 计算机科学 2023-08-11 Jie Peng , Weiyu Li , Qing Ling

To study the resilience of distributed learning, the "Byzantine" literature considers a strong threat model where workers can report arbitrary gradients to the parameter server. Whereas this model helped obtain several fundamental results,…

机器学习 · 计算机科学 2022-07-22 Sadegh Farhadkhani , Rachid Guerraoui , Lê-Nguyên Hoang , Oscar Villemaud

We study distributed optimization in the presence of Byzantine adversaries, where both data and computation are distributed among $m$ worker machines, $t$ of which may be corrupt. The compromised nodes may collaboratively and arbitrarily…

分布式、并行与集群计算 · 计算机科学 2020-11-05 Deepesh Data , Linqi Song , Suhas Diggavi

In this work, we consider the distributed stochastic optimization problem of minimizing a non-convex function $f(x) = \mathbb{E}_{\xi \sim \mathcal{D}} f(x; \xi)$ in an adversarial setting, where the individual functions $f(x; \xi)$ can…

最优化与控制 · 数学 2019-12-11 Prashant Khanduri , Saikiran Bulusu , Pranay Sharma , Pramod K. Varshney

This paper jointly considers privacy preservation and Byzantine-robustness in decentralized learning. In a decentralized network, honest-but-curious agents faithfully follow the prescribed algorithm, but expect to infer their neighbors'…

机器学习 · 计算机科学 2024-10-15 Haoxiang Ye , Heng Zhu , Qing Ling

Distributed learning is central for large-scale training of deep-learning models. However, they are exposed to a security threat in which Byzantine participants can interrupt or control the learning process. Previous attack models and their…

机器学习 · 计算机科学 2021-11-16 Moran Baruch , Gilad Baruch , Yoav Goldberg

We develop a communication-efficient distributed learning algorithm that is robust against Byzantine worker machines. We propose and analyze a distributed gradient-descent algorithm that performs a simple thresholding based on gradient…

机器学习 · 计算机科学 2021-08-17 Avishek Ghosh , Raj Kumar Maity , Swanand Kadhe , Arya Mazumdar , Kannan Ramchandran

We consider distributed optimization under Byzantine attacks in the presence of $(L_0,L_1)$-smoothness, a generalization of standard $L$-smoothness that captures functions with state-dependent gradient Lipschitz constants. We propose…

机器学习 · 计算机科学 2026-03-16 Arman Bolatov , Samuel Horváth , Martin Takáč , Eduard Gorbunov

The increasing popularity of the federated learning (FL) framework due to its success in a wide range of collaborative learning tasks also induces certain security concerns. Among many vulnerabilities, the risk of Byzantine attacks is of…

机器学习 · 计算机科学 2024-01-02 Kerem Ozfatura , Emre Ozfatura , Alptekin Kupcu , Deniz Gunduz

We study the problem of Byzantine fault tolerance in a distributed optimization setting, where there is a group of $N$ agents communicating with a trusted centralized coordinator. Among these agents, there is a subset of $f$ agents that may…

最优化与控制 · 数学 2023-12-19 Amit Dutta , Thinh T. Doan , Jeffrey H. Reed

This paper considers the problem of resilient distributed optimization and stochastic machine learning in a server-based architecture. The system comprises a server and multiple agents, where each agent has a local cost function. The agents…

分布式、并行与集群计算 · 计算机科学 2021-10-22 Shuo Liu , Nirupam Gupta , Nitin Vaidya

Federated recommendation systems can provide good performance without collecting users' private data, making them attractive. However, they are susceptible to low-cost poisoning attacks that can degrade their performance. In this paper, we…

机器学习 · 计算机科学 2020-06-16 Chen Chen , Jingfeng Zhang , Anthony K. H. Tung , Mohan Kankanhalli , Gang Chen

Federated learning (FL) enables multiple clients to collaboratively train a global model without sharing their local data. Recent studies have highlighted the vulnerability of FL to Byzantine attacks, where malicious clients send poisoned…

分布式、并行与集群计算 · 计算机科学 2025-06-16 Kai Yue , Richeng Jin , Chau-Wai Wong , Huaiyu Dai

Federated Learning (FL) enables multiple clients to collaboratively train models without sharing raw data, but is vulnerable to Byzantine attacks and data heterogeneity, which can severely degrade performance. Existing Byzantine-robust…

机器学习 · 计算机科学 2025-10-28 Shiyuan Zuo , Xingrun Yan , Rongfei Fan , Li Shen , Puning Zhao , Jie Xu , Han Hu