中文
相关论文

相关论文: Federated Variance-Reduced Stochastic Gradient Des…

200 篇论文

Inherent client drifts caused by data heterogeneity, as well as vulnerability to Byzantine attacks within the system, hinder effective model training and convergence in federated learning (FL). This paper presents two new frameworks, named…

分布式、并行与集群计算 · 计算机科学 2026-01-13 Bingnan Xiao , Feng Zhu , Jingjing Zhang , Wei Ni , Xin Wang

Federated Learning (FL) emerges as a distributed machine learning approach that addresses privacy concerns by training AI models locally on devices. Decentralized Federated Learning (DFL) extends the FL paradigm by eliminating the central…

Decentralized learning has gained great popularity to improve learning efficiency and preserve data privacy. Each computing node makes equal contribution to collaboratively learn a Deep Learning model. The elimination of centralized…

机器学习 · 计算机科学 2021-10-22 Shangwei Guo , Tianwei Zhang , Han Yu , Xiaofei Xie , Lei Ma , Tao Xiang , Yang Liu

In this work we study the problem of Byzantine-robust learning when data among clients is heterogeneous. We focus on poisoning attacks targeting the convergence of SGD. Although this problem has received great attention; the main Byzantine…

机器学习 · 计算机科学 2022-10-18 Latifa Errami , El Houcine Bergou

The problem of designing distributed optimization algorithms that are resilient to Byzantine adversaries has received significant attention. For the Byzantine-resilient distributed optimization problem, the goal is to (approximately)…

最优化与控制 · 数学 2024-12-30 Kananart Kuwaranancharoen , Shreyas Sundaram

There has been a growing need to provide Byzantine-resilience in distributed model training. Existing robust distributed learning algorithms focus on developing sophisticated robust aggregators at the parameter servers, but pay less…

机器学习 · 计算机科学 2021-10-12 Lingjiao Chen , Leshang Chen , Hongyi Wang , Susan Davidson , Edgar Dobriban

State-of-the-art machine learning models are routinely trained on large-scale distributed clusters. Crucially, such systems can be compromised when some of the computing devices exhibit abnormal (Byzantine) behavior and return arbitrary…

机器学习 · 计算机科学 2022-01-25 Konstantinos Konstantinidis , Aditya Ramamoorthy

\textit{Federated learning} (FL) is a nascent distributed learning paradigm to train a shared global model without violating users' privacy. FL has been shown to be vulnerable to various Byzantine attacks, where malicious participants could…

密码学与安全 · 计算机科学 2023-08-08 Wei Wan , Shengshan Hu , Minghui Li , Jianrong Lu , Longling Zhang , Leo Yu Zhang , Hai Jin

Machine learning has begun to play a central role in many applications. A multitude of these applications typically also involve datasets that are distributed across multiple computing devices/machines due to either design constraints…

机器学习 · 统计学 2022-06-16 Cheng Fang , Zhixiong Yang , Waheed U. Bajwa

This paper investigates the robustness of over-the-air federated learning to Byzantine attacks. The simple averaging of the model updates via over-the-air computation makes the learning task vulnerable to random or intended modifications of…

机器学习 · 计算机科学 2022-06-24 Houssem Sifaou , Geoffrey Ye Li

Recently, decentralized learning has emerged as a popular peer-to-peer signal and information processing paradigm that enables model training across geographically distributed agents in a scalable manner, without the presence of any central…

机器学习 · 计算机科学 2024-07-12 Haoxiang Ye , Qing Ling

Federated learning is a novel framework that enables resource-constrained edge devices to jointly learn a model, which solves the problem of data protection and data islands. However, standard federated learning is vulnerable to Byzantine…

机器学习 · 计算机科学 2021-09-07 Kun Zhai , Qiang Ren , Junli Wang , Chungang Yan

Recent years have witnessed a growing interest in the topic of min-max optimization, owing to its relevance in the context of generative adversarial networks (GANs), robust control and optimization, and reinforcement learning. Motivated by…

机器学习 · 计算机科学 2022-04-08 Arman Adibi , Aritra Mitra , George J. Pappas , Hamed Hassani

This paper proposes a Robust Gradient Classification Framework (RGCF) for Byzantine fault tolerance in distributed stochastic gradient descent. The framework consists of a pattern recognition filter which we train to be able to classify…

机器学习 · 计算机科学 2023-01-19 Shashank Reddy Chirra , Kalyan Varma Nadimpalli , Shrisha Rao

In this paper, we investigate the problem of decentralized online resource allocation in the presence of Byzantine attacks. In this problem setting, some agents may be compromised due to external manipulations or internal failures, causing…

最优化与控制 · 数学 2026-05-27 Runhua Wang , Qing Ling , Hoi-To Wai , Zhi Tian

Federated Learning (FL) enables clients to collaboratively train a global model without sharing their private data. However, the presence of malicious (Byzantine) clients poses significant challenges to the robustness of FL, particularly…

机器学习 · 计算机科学 2026-05-26 Javad Parsa , Amir Hossein Daghestani , André M. H. Teixeira , Mikael Johansson

How to achieve precise distributed optimization despite unknown attacks, especially the Byzantine attacks, is one of the critical challenges for multiagent systems. This paper addresses a distributed resilient optimization for linear…

系统与控制 · 电气工程与系统科学 2024-10-18 Chenhang Yan , Liping Yan , Yuezu Lv , Bolei Dong , Yuanqing Xia

Federated Learning (FL) enables heterogeneous clients to collaboratively train a shared model without centralizing their raw data, offering an inherent level of privacy. However, gradients and model updates can still leak sensitive…

One of the most common defense strategies against Byzantine clients in federated learning (FL) is to employ a robust aggregator mechanism that makes the training more resilient. While many existing Byzantine robust aggregators provide…

计算机视觉与模式识别 · 计算机科学 2025-04-10 Joseph Geo Benjamin , Mothilal Asokan , Mohammad Yaqub , Karthik Nandakumar

This paper addresses the problem of combining Byzantine resilience with privacy in machine learning (ML). Specifically, we study if a distributed implementation of the renowned Stochastic Gradient Descent (SGD) learning algorithm is…

机器学习 · 计算机科学 2021-06-25 Rachid Guerraoui , Nirupam Gupta , Rafaël Pinot , Sébastien Rouault , John Stephan