中文
相关论文

相关论文: Coded Robust Aggregation for Distributed Learning …

200 篇论文

Federated Learning (FL) is notorious for its vulnerability to Byzantine attacks. Most current Byzantine defenses share a common inductive bias: among all the gradients, the densely distributed ones are more likely to be honest. However,…

机器学习 · 计算机科学 2025-02-17 Yuchen Liu , Chen Chen , Lingjuan Lyu , Yaochu Jin , Gang Chen

Federated learning (FL) enables multiple clients to collaboratively train a global model without sharing their local data. Recent studies have highlighted the vulnerability of FL to Byzantine attacks, where malicious clients send poisoned…

分布式、并行与集群计算 · 计算机科学 2025-06-16 Kai Yue , Richeng Jin , Chau-Wai Wong , Huaiyu Dai

Federated learning has arisen as a mechanism to allow multiple participants to collaboratively train a model without sharing their data. In these settings, participants (workers) may not trust each other fully; for instance, a set of…

机器学习 · 计算机科学 2021-07-28 Kamala Varma , Yi Zhou , Nathalie Baracaldo , Ali Anwar

In this paper, we propose a robust aggregation method for federated learning (FL) that can effectively tackle malicious Byzantine attacks. At each user, model parameter is firstly updated by multiple steps, which is adjustable over…

机器学习 · 计算机科学 2023-08-22 Shiyuan Zuo , Rongfei Fan , Han Hu , Ning Zhang , Shimin Gong

This paper investigates the robustness of over-the-air federated learning to Byzantine attacks. The simple averaging of the model updates via over-the-air computation makes the learning task vulnerable to random or intended modifications of…

机器学习 · 计算机科学 2022-06-24 Houssem Sifaou , Geoffrey Ye Li

Distributed learning has emerged as a leading paradigm for training large machine learning models. However, in real-world scenarios, participants may be unreliable or malicious, posing a significant challenge to the integrity and accuracy…

机器学习 · 计算机科学 2024-06-10 Grigory Malinovsky , Peter Richtárik , Samuel Horváth , Eduard Gorbunov

Distributed Learning often suffers from Byzantine failures, and there have been a number of works studying the problem of distributed stochastic optimization under Byzantine failures, where only a portion of workers, instead of all the…

分布式、并行与集群计算 · 计算机科学 2021-08-17 Kaiyun Li , Xiaojun Chen , Ye Dong , Peng Zhang , Dakui Wang , Shuai Zen

Implementations of SGD on distributed systems create new vulnerabilities, which can be identified and misused by one or more adversarial agents. Recently, it has been shown that well-known Byzantine-resilient gradient aggregation schemes…

机器学习 · 计算机科学 2022-09-26 Ali Ramezani-Kebrya , Iman Tabrizian , Fartash Faghri , Petar Popovski

Machine Learning (ML) solutions are nowadays distributed, according to the so-called server/worker architecture. One server holds the model parameters while several workers train the model. Clearly, such architecture is prone to various…

分布式、并行与集群计算 · 计算机科学 2020-06-03 El-Mahdi El-Mhamdi , Rachid Guerraoui , Arsany Guirguis , Lê Nguyên Hoang , Sébastien Rouault

This paper focuses on decentralized stochastic optimization in the presence of Byzantine attacks. During the optimization process, an unknown number of malfunctioning or malicious workers, termed as Byzantine workers, disobey the…

分布式、并行与集群计算 · 计算机科学 2023-04-13 Zhaoxian Wu , Tianyi Chen , Qing Ling

Distributed learning has become a hot research topic due to its wide application in clusterbased large-scale learning, federated learning, edge computing and so on. Most traditional distributed learning methods typically assume no failure…

机器学习 · 计算机科学 2022-02-01 Yi-Rui Yang , Wu-Jun Li

We investigate the Byzantine attack problem within the context of model training in distributed learning systems. While ensuring the convergence of current model training processes, common solvers (e.g. SGD, Adam, RMSProp, etc.) can be…

分布式、并行与集群计算 · 计算机科学 2024-10-08 Kun Yang , Tianyi Luo , Yanjie Dong , Aohan Li

\textit{Federated learning} (FL) is a nascent distributed learning paradigm to train a shared global model without violating users' privacy. FL has been shown to be vulnerable to various Byzantine attacks, where malicious participants could…

密码学与安全 · 计算机科学 2023-08-08 Wei Wan , Shengshan Hu , Minghui Li , Jianrong Lu , Longling Zhang , Leo Yu Zhang , Hai Jin

Federated Learning (FL) paradigms enable large numbers of clients to collaboratively train Machine Learning models on private data. However, due to their multi-party nature, traditional FL schemes are left vulnerable to Byzantine attacks…

机器学习 · 计算机科学 2024-10-31 Atharv Deshmukh

Distributed learning has become a promising computational parallelism paradigm that enables a wide scope of intelligent applications from the Internet of Things (IoT) to autonomous driving and the healthcare industry. This paper studies…

信号处理 · 电气工程与系统科学 2024-10-28 Yuhan Yang , Youlong Wu , Yuning Jiang , Yuanming Shi

Robustness to Byzantine attacks is a necessity for various distributed training scenarios. When the training reduces to the process of solving a minimization problem, Byzantine robustness is relatively well-understood. However, other…

Distributed optimization with open collaboration is a popular field since it provides an opportunity for small groups/companies/universities, and individuals to jointly solve huge-scale problems. However, standard optimization algorithms…

最优化与控制 · 数学 2023-03-09 Nikita Fedin , Eduard Gorbunov

Recently emerged federated learning (FL) is an attractive distributed learning framework in which numerous wireless end-user devices can train a global model with the data remained autochthonous. Compared with the traditional machine…

密码学与安全 · 计算机科学 2022-10-10 Junyu Shi , Wei Wan , Shengshan Hu , Jianrong Lu , Leo Yu Zhang

While machine learning is going through an era of celebrated success, concerns have been raised about the vulnerability of its backbone: stochastic gradient descent (SGD). Recent approaches have been proposed to ensure the robustness of…

机器学习 · 统计学 2018-07-19 El Mahdi El Mhamdi , Rachid Guerraoui , Sébastien Rouault

This paper studies distributed online learning under Byzantine attacks. The performance of an online learning algorithm is often characterized by (adversarial) regret, which evaluates the quality of one-step-ahead decision-making when an…

机器学习 · 计算机科学 2023-12-06 Xingrong Dong , Zhaoxian Wu , Qing Ling , Zhi Tian