English
Related papers

Related papers: Robust Federated Learning in a Heterogeneous Envir…

200 papers

Federated learning is a machine learning paradigm that leverages edge computing on client devices to optimize models while maintaining user privacy by ensuring that local data remains on the device. However, since all data is collected by…

Machine Learning · Computer Science 2025-06-11 Jingqiao Tang , Ryan Bausback , Feng Bao , Richard Archibald

Federated learning is a popular paradigm for machine learning. Ideally, federated learning works best when all clients share a similar data distribution. However, it is not always the case in the real world. Therefore, the topic of…

Machine Learning · Computer Science 2022-12-20 Yuchuan Huang , Chen Hu

In this paper, we establish tight lower bounds for Byzantine-robust distributed first-order stochastic optimization methods in both strongly convex and non-convex stochastic optimization. We reveal that when the distributed nodes have…

Optimization and Control · Mathematics 2025-03-21 Qiankun Shi , Jie Peng , Kun Yuan , Xiao Wang , Qing Ling

As a prevalent distributed learning paradigm, Federated Learning (FL) trains a global model on a massive amount of devices with infrequent communication. This paper investigates a class of composite optimization and statistical recovery…

Machine Learning · Computer Science 2022-10-04 Yajie Bao , Michael Crawshaw , Shan Luo , Mingrui Liu

Federated learning (FL) algorithms usually sample a fraction of clients in each round (partial participation) when the number of participants is large and the server's communication bandwidth is limited. Recent works on the convergence…

Machine Learning · Computer Science 2021-12-22 Bing Luo , Wenli Xiao , Shiqiang Wang , Jianwei Huang , Leandros Tassiulas

Federated learning (FL) has emerged as a promising approach to training machine learning models across decentralized data sources while preserving data privacy, particularly in manufacturing and shared production environments. However, the…

Machine Learning · Computer Science 2024-08-20 Tatjana Legler , Vinit Hegiste , Ahmed Anwar , Martin Ruskowski

Recent studies have revealed that federated learning (FL), once considered secure due to clients not sharing their private data with the server, is vulnerable to attacks such as client-side training data distribution inference, where a…

Cryptography and Security · Computer Science 2024-04-05 Yichang Xu , Ming Yin , Minghong Fang , Neil Zhenqiang Gong

The demand for collaborative and private bandit learning across multiple agents is surging due to the growing quantity of data generated from distributed systems. Federated bandit learning has emerged as a promising framework for private,…

Machine Learning · Computer Science 2024-03-04 Ethan Blaser , Chuanhao Li , Hongning Wang

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

Machine Learning · Computer Science 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

State-of-the-art machine learning models are routinely trained on large-scale distributed clusters. Crucially, such systems can be compromised when some of the computing devices exhibit abnormal (Byzantine) behavior and return arbitrary…

Machine Learning · Computer Science 2022-01-25 Konstantinos Konstantinidis , Aditya Ramamoorthy

Federated learning brings potential benefits of faster learning, better solutions, and a greater propensity to transfer when heterogeneous data from different parties increases diversity. However, because federated learning tasks tend to be…

Machine Learning · Computer Science 2021-01-18 Duc Thien Nguyen , Shiau Hoong Lim , Laura Wynter , Desmond Cai

Federated machine learning is a versatile and flexible tool to utilize distributed data from different sources, especially when communication technology develops rapidly and an unprecedented amount of data could be collected on mobile…

Machine Learning · Computer Science 2024-03-12 Tianyi Zhang , Shirui Zhang , Ziwei Chen , Dianbo Liu

Federated Learning (FL) enables collaborative learning of large-scale distributed clients without data sharing. However, due to the disparity of computing resources among massive mobile computing devices, the performance of traditional…

Machine Learning · Computer Science 2023-11-27 Ruixuan Liu , Ming Hu , Zeke Xia , Jun Xia , Pengyu Zhang , Yihao Huang , Yang Liu , Mingsong Chen

Federated learning is a distributed machine learning paradigm, which aims to train a model using the local data of many distributed clients. A key challenge in federated learning is that the data samples across the clients may not be…

Machine Learning · Computer Science 2022-06-27 Farzan Farnia , Amirhossein Reisizadeh , Ramtin Pedarsani , Ali Jadbabaie

Distributed stochastic optimization has drawn great attention recently due to its effectiveness in solving large-scale machine learning problems. Though numerous algorithms have been proposed and successfully applied to general practical…

Optimization and Control · Mathematics 2023-12-15 Kun Huang , Xiao Li , Shi Pu

Federated learning has exhibited vulnerabilities to Byzantine attacks, where the Byzantine attackers can send arbitrary gradients to a central server to destroy the convergence and performance of the global model. A wealth of robust…

Machine Learning · Computer Science 2023-06-06 Yuchen Liu , Chen Chen , Lingjuan Lyu , Fangzhao Wu , Sai Wu , Gang Chen

Federated learning is a paradigm that enables local devices to jointly train a server model while keeping the data decentralized and private. In federated learning, since local data are collected by clients, it is hardly guaranteed that the…

Machine Learning · Computer Science 2022-03-01 Seunghan Yang , Hyoungseob Park , Junyoung Byun , Changick Kim

Federated learning involves training statistical models over remote devices or siloed data centers, such as mobile phones or hospitals, while keeping data localized. Training in heterogeneous and potentially massive networks introduces…

Machine Learning · Computer Science 2020-06-24 Tian Li , Anit Kumar Sahu , Ameet Talwalkar , Virginia Smith

Federated learning (FL) is a rapidly growing privacy-preserving collaborative machine learning paradigm. In practical FL applications, local data from each data silo reflect local usage patterns. Therefore, there exists heterogeneity of…

Machine Learning · Computer Science 2022-02-01 Shenglai Zeng , Zonghang Li , Hongfang Yu , Yihong He , Zenglin Xu , Dusit Niyato , Han Yu

With an increasing number of smart devices like internet of things (IoT) devices deployed in the field, offloadingtraining of neural networks (NNs) to a central server becomes more and more infeasible. Recent efforts toimprove users'…

Machine Learning · Computer Science 2023-07-19 Kilian Pfeiffer , Martin Rapp , Ramin Khalili , Jörg Henkel