English
Related papers

Related papers: Fast and Robust Distributed Learning in High Dimen…

200 papers

This paper deals with distributed finite-sum optimization for learning over networks in the presence of malicious Byzantine attacks. To cope with such attacks, most resilient approaches so far combine stochastic gradient descent (SGD) with…

Machine Learning · Computer Science 2023-07-19 Zhaoxian Wu , Qing Ling , Tianyi Chen , Georgios B. Giannakis

We investigate robust federated learning, where a group of workers collaboratively train a shared model under the orchestration of a central server in the presence of Byzantine adversaries capable of arbitrary and potentially malicious…

Machine Learning · Computer Science 2025-11-05 Lihan Xu , Yanjie Dong , Gang Wang , Runhao Zeng , Xiaoyi Fan , Xiping Hu

Implementations of SGD on distributed systems create new vulnerabilities, which can be identified and misused by one or more adversarial agents. Recently, it has been shown that well-known Byzantine-resilient gradient aggregation schemes…

Machine Learning · Computer Science 2022-09-26 Ali Ramezani-Kebrya , Iman Tabrizian , Fartash Faghri , Petar Popovski

This paper considers the Byzantine fault-tolerance problem in distributed stochastic gradient descent (D-SGD) method - a popular algorithm for distributed multi-agent machine learning. In this problem, each agent samples data points…

Machine Learning · Computer Science 2021-04-20 Nirupam Gupta , Shuo Liu , Nitin H. Vaidya

Distributed learning paradigms, such as federated and decentralized learning, allow for the coordination of models across a collection of agents, and without the need to exchange raw data. Instead, agents compute model updates locally based…

Machine Learning · Computer Science 2022-04-04 Stefan Vlaski , Christian Schroth , Michael Muma , Abdelhak M. Zoubir

This work considers resilient, cooperative state estimation in unreliable multi-agent networks. A network of agents aims to collaboratively estimate the value of an unknown vector parameter, while an {\em unknown} subset of agents suffer…

Systems and Control · Computer Science 2018-10-25 Lili Su , Shahin Shahrampour

Federated learning is a newly emerging distributed learning framework that facilitates the collaborative training of a shared global model among distributed participants with their privacy preserved. However, federated learning systems are…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-14 Minghui Li , Wei Wan , Jianrong Lu , Shengshan Hu , Junyu Shi , Leo Yu Zhang , Man Zhou , Yifeng Zheng

In federated learning, most existing robust aggregation rules (AGRs) combat Byzantine attacks in the IID setting, where client data is assumed to be independent and identically distributed. In this paper, we address label skewness, a more…

Machine Learning · Computer Science 2024-03-21 Wenxuan Bao , Jun Wu , Jingrui He

This paper addresses the problem of combining Byzantine resilience with privacy in machine learning (ML). Specifically, we study if a distributed implementation of the renowned Stochastic Gradient Descent (SGD) learning algorithm is…

Machine Learning · Computer Science 2021-06-25 Rachid Guerraoui , Nirupam Gupta , Rafaël Pinot , Sébastien Rouault , John Stephan

Federated learning enables training collaborative machine learning models at scale with many participants whilst preserving the privacy of their datasets. Standard federated learning techniques are vulnerable to Byzantine failures, biased…

Machine Learning · Statistics 2019-09-12 Luis Muñoz-González , Kenneth T. Co , Emil C. Lupu

Federated Learning (FL) emerged as a widely studied paradigm for distributed learning. Despite its many advantages, FL remains vulnerable to adversarial attacks, especially under data heterogeneity. We propose a new Byzantine-robust FL…

Machine Learning · Computer Science 2025-09-12 Sena Ergisi , Luis Maßny , Rawad Bitar

Federated Learning (FL) enables multiple clients to collaboratively train models without sharing raw data, but is vulnerable to Byzantine attacks and data heterogeneity, which can severely degrade performance. Existing Byzantine-robust…

Machine Learning · Computer Science 2025-10-28 Shiyuan Zuo , Xingrun Yan , Rongfei Fan , Li Shen , Puning Zhao , Jie Xu , Han Hu

Federated reinforcement learning (FRL) allows agents to jointly learn a global decision-making policy under the guidance of a central server. While FRL has advantages, its decentralized design makes it prone to poisoning attacks. To…

Cryptography and Security · Computer Science 2025-02-13 Minghong Fang , Xilong Wang , Neil Zhenqiang Gong

Byzantine-robust learning has emerged as a prominent fault-tolerant distributed machine learning framework. However, most techniques focus on the static setting, wherein the identity of Byzantine workers remains unchanged throughout the…

Machine Learning · Computer Science 2024-06-18 Ron Dorfman , Naseem Yehya , Kfir Y. Levy

Federated Learning (FL) enables multiple clients to collaboratively train models without sharing raw data, but it is highly vulnerable to Byzantine attacks. Existing robust approaches can neutralize these threats but incur substantial…

Machine Learning · Computer Science 2026-05-28 Shiyuan Zuo , Jiashuo Li , Rongfei Fan , Han Hu , Jie Xu

Adversarial attacks pose a major challenge to distributed learning systems, prompting the development of numerous robust learning methods. However, most existing approaches suffer from the curse of dimensionality, i.e. the error increases…

Machine Learning · Computer Science 2025-11-19 Wenyu Liu , Tianqiang Huang , Pengfei Zhang , Zong Ke , Minghui Min , Puning Zhao

This paper focuses on decentralized stochastic optimization in the presence of Byzantine attacks. During the optimization process, an unknown number of malfunctioning or malicious workers, termed as Byzantine workers, disobey the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-13 Zhaoxian Wu , Tianyi Chen , Qing Ling

This paper studies distributed diffusion adaptation over clustered multi-task networks in the presence of impulsive interferences and Byzantine attacks. We develop a robust resilient diffusion least mean Geman-McClure-estimation (RDLMG)…

Machine Learning · Computer Science 2022-06-28 Tao Yu , Rodrigo C. de Lamare , Yi Yu

This paper considers the problem of Byzantine fault-tolerance in distributed multi-agent optimization. In this problem, each agent has a local cost function, and in the fault-free case, the goal is to design a distributed algorithm that…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-22 Shuo Liu , Nirupam Gupta , Nitin H. Vaidya

This paper considers a distributed optimization problem in the presence of Byzantine agents capable of introducing untrustworthy information into the communication network. A resilient distributed subgradient algorithm is proposed based on…

Optimization and Control · Mathematics 2023-03-22 Jingxuan Zhu , Yixuan Lin , Alvaro Velasquez , Ji Liu
‹ Prev 1 3 4 5 6 7 10 Next ›