English
Related papers

Related papers: Federated Variance-Reduced Stochastic Gradient Des…

200 papers

Inherent client drifts caused by data heterogeneity, as well as vulnerability to Byzantine attacks within the system, hinder effective model training and convergence in federated learning (FL). This paper presents two new frameworks, named…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-13 Bingnan Xiao , Feng Zhu , Jingjing Zhang , Wei Ni , Xin Wang

Federated Learning (FL) emerges as a distributed machine learning approach that addresses privacy concerns by training AI models locally on devices. Decentralized Federated Learning (DFL) extends the FL paradigm by eliminating the central…

Machine Learning · Computer Science 2025-11-17 Diego Cajaraville-Aboy , Ana Fernández-Vilas , Rebeca P. Díaz-Redondo , Manuel Fernández-Veiga

Decentralized learning has gained great popularity to improve learning efficiency and preserve data privacy. Each computing node makes equal contribution to collaboratively learn a Deep Learning model. The elimination of centralized…

Machine Learning · Computer Science 2021-10-22 Shangwei Guo , Tianwei Zhang , Han Yu , Xiaofei Xie , Lei Ma , Tao Xiang , Yang Liu

In this work we study the problem of Byzantine-robust learning when data among clients is heterogeneous. We focus on poisoning attacks targeting the convergence of SGD. Although this problem has received great attention; the main Byzantine…

Machine Learning · Computer Science 2022-10-18 Latifa Errami , El Houcine Bergou

The problem of designing distributed optimization algorithms that are resilient to Byzantine adversaries has received significant attention. For the Byzantine-resilient distributed optimization problem, the goal is to (approximately)…

Optimization and Control · Mathematics 2024-12-30 Kananart Kuwaranancharoen , Shreyas Sundaram

There has been a growing need to provide Byzantine-resilience in distributed model training. Existing robust distributed learning algorithms focus on developing sophisticated robust aggregators at the parameter servers, but pay less…

Machine Learning · Computer Science 2021-10-12 Lingjiao Chen , Leshang Chen , Hongyi Wang , Susan Davidson , Edgar Dobriban

State-of-the-art machine learning models are routinely trained on large-scale distributed clusters. Crucially, such systems can be compromised when some of the computing devices exhibit abnormal (Byzantine) behavior and return arbitrary…

Machine Learning · Computer Science 2022-01-25 Konstantinos Konstantinidis , Aditya Ramamoorthy

\textit{Federated learning} (FL) is a nascent distributed learning paradigm to train a shared global model without violating users' privacy. FL has been shown to be vulnerable to various Byzantine attacks, where malicious participants could…

Cryptography and Security · Computer Science 2023-08-08 Wei Wan , Shengshan Hu , Minghui Li , Jianrong Lu , Longling Zhang , Leo Yu Zhang , Hai Jin

Machine learning has begun to play a central role in many applications. A multitude of these applications typically also involve datasets that are distributed across multiple computing devices/machines due to either design constraints…

Machine Learning · Statistics 2022-06-16 Cheng Fang , Zhixiong Yang , Waheed U. Bajwa

This paper investigates the robustness of over-the-air federated learning to Byzantine attacks. The simple averaging of the model updates via over-the-air computation makes the learning task vulnerable to random or intended modifications of…

Machine Learning · Computer Science 2022-06-24 Houssem Sifaou , Geoffrey Ye Li

Recently, decentralized learning has emerged as a popular peer-to-peer signal and information processing paradigm that enables model training across geographically distributed agents in a scalable manner, without the presence of any central…

Machine Learning · Computer Science 2024-07-12 Haoxiang Ye , Qing Ling

Federated learning is a novel framework that enables resource-constrained edge devices to jointly learn a model, which solves the problem of data protection and data islands. However, standard federated learning is vulnerable to Byzantine…

Machine Learning · Computer Science 2021-09-07 Kun Zhai , Qiang Ren , Junli Wang , Chungang Yan

Recent years have witnessed a growing interest in the topic of min-max optimization, owing to its relevance in the context of generative adversarial networks (GANs), robust control and optimization, and reinforcement learning. Motivated by…

Machine Learning · Computer Science 2022-04-08 Arman Adibi , Aritra Mitra , George J. Pappas , Hamed Hassani

This paper proposes a Robust Gradient Classification Framework (RGCF) for Byzantine fault tolerance in distributed stochastic gradient descent. The framework consists of a pattern recognition filter which we train to be able to classify…

Machine Learning · Computer Science 2023-01-19 Shashank Reddy Chirra , Kalyan Varma Nadimpalli , Shrisha Rao

In this paper, we investigate the problem of decentralized online resource allocation in the presence of Byzantine attacks. In this problem setting, some agents may be compromised due to external manipulations or internal failures, causing…

Optimization and Control · Mathematics 2026-05-27 Runhua Wang , Qing Ling , Hoi-To Wai , Zhi Tian

Federated Learning (FL) enables clients to collaboratively train a global model without sharing their private data. However, the presence of malicious (Byzantine) clients poses significant challenges to the robustness of FL, particularly…

Machine Learning · Computer Science 2026-05-26 Javad Parsa , Amir Hossein Daghestani , André M. H. Teixeira , Mikael Johansson

How to achieve precise distributed optimization despite unknown attacks, especially the Byzantine attacks, is one of the critical challenges for multiagent systems. This paper addresses a distributed resilient optimization for linear…

Systems and Control · Electrical Eng. & Systems 2024-10-18 Chenhang Yan , Liping Yan , Yuezu Lv , Bolei Dong , Yuanqing Xia

Federated Learning (FL) enables heterogeneous clients to collaboratively train a shared model without centralizing their raw data, offering an inherent level of privacy. However, gradients and model updates can still leak sensitive…

Machine Learning · Computer Science 2026-04-07 Rustem Islamov , Grigory Malinovsky , Alexander Gaponov , Aurelien Lucchi , Peter Richtárik , Eduard Gorbunov

One of the most common defense strategies against Byzantine clients in federated learning (FL) is to employ a robust aggregator mechanism that makes the training more resilient. While many existing Byzantine robust aggregators provide…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Joseph Geo Benjamin , Mothilal Asokan , Mohammad Yaqub , Karthik Nandakumar

This paper addresses the problem of combining Byzantine resilience with privacy in machine learning (ML). Specifically, we study if a distributed implementation of the renowned Stochastic Gradient Descent (SGD) learning algorithm is…

Machine Learning · Computer Science 2021-06-25 Rachid Guerraoui , Nirupam Gupta , Rafaël Pinot , Sébastien Rouault , John Stephan
‹ Prev 1 4 5 6 7 8 10 Next ›