English
Related papers

Related papers: Straggler-Resilient Federated Learning: Leveraging…

200 papers

Federated Learning has become an important learning paradigm due to its privacy and computational benefits. As the field advances, two key challenges that still remain to be addressed are: (1) system heterogeneity - variability in the…

Machine Learning · Computer Science 2022-06-02 Disha Makhija , Nhat Ho , Joydeep Ghosh

We present a class of methods for robust, personalized federated learning, called Fed+, that unifies many federated learning algorithms. The principal advantage of this class of methods is to better accommodate the real-world…

Machine Learning · Computer Science 2022-07-13 Achintya Kundu , Pengqian Yu , Laura Wynter , Shiau Hong Lim

In this paper, we propose Helios, a heterogeneity-aware FL framework to tackle the straggler issue. Helios identifies individual devices' heterogeneous training capability, and therefore the expected neural network model training volumes…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-02 Zirui Xu , Fuxun Yu , Jinjun Xiong , Xiang Chen

In Federated Learning (FL), the distributed nature and heterogeneity of client data present both opportunities and challenges. While collaboration among clients can significantly enhance the learning process, not all collaborations are…

Machine Learning · Computer Science 2024-07-18 Nazarii Tupitsa , Samuel Horváth , Martin Takáč , Eduard Gorbunov

Federated learning enables joint training of machine learning models from distributed clients without sharing their local data. One key challenge in federated learning is to handle non-identically distributed data across the clients, which…

Machine Learning · Computer Science 2023-12-25 Tiejin Chen , Yuanpu Cao , Yujia Wang , Cho-Jui Hsieh , Jinghui Chen

Federated Learning (FL) allows training machine learning models in privacy-constrained scenarios by enabling the cooperation of edge devices without requiring local data sharing. This approach raises several challenges due to the different…

Machine Learning · Computer Science 2022-12-02 Riccardo Zaccone , Andrea Rizzardi , Debora Caldarola , Marco Ciccone , Barbara Caputo

Federated Learning is a framework that jointly trains a model \textit{with} complete knowledge on a remotely placed centralized server, but \textit{without} the requirement of accessing the data stored in distributed machines. Some work…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-26 Jia Qian , Lars Kai Hansen , Xenofon Fafoutis , Prayag Tiwari , Hari Mohan Pandey

Federated learning (FL) is a paradigm where many clients collaboratively train a model under the coordination of a central server, while keeping the training data locally stored. However, heterogeneous data distributions over different…

Machine Learning · Computer Science 2022-05-27 Yaqi Sun , Shijing Si , Jianzong Wang , Yuhan Dong , Zhitao Zhu , Jing Xiao

Federated learning is an emerging distributed machine learning method, enables a large number of clients to train a model without exchanging their local data. The time cost of communication is an essential bottleneck in federated learning,…

Machine Learning · Computer Science 2023-09-19 Hao Sun , Li Shen , Shixiang Chen , Jingwei Sun , Jing Li , Guangzhong Sun , Dacheng Tao

Learning from distributed data without accessing them is undoubtedly a challenging and non-trivial task. Nevertheless, the necessity for distributed training of a statistical model has been increasing, due to the privacy concerns of local…

Machine Learning · Statistics 2024-08-02 Seok-Ju Hahn

Federated Learning (FL) is a distributed learning paradigm where clients collaboratively train a model while keeping their own data private. With an increasing scale of clients and models, FL encounters two key challenges, client drift due…

Machine Learning · Computer Science 2025-01-20 Jianhui Sun , Xidong Wu , Heng Huang , Aidong Zhang

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Federated learning is a paradigm of joint learning in which clients collaborate by sharing model parameters instead of data. However, in the non-iid setting, the global model experiences client drift, which can seriously affect the final…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jiaze Li , Haoran Xu , Wanyi Wu , Changwei Wang , Shuaiguang Li , Jianzhong Ju , Zhenbo Luo , Jian Luan , Youyang Qu , Longxiang Gao , Xudong Yang , Lumin Xing

Personalized Federated Learning (PFL) is a new Federated Learning (FL) approach to address the heterogeneity issue of the datasets generated by distributed user equipments (UEs). However, most existing PFL implementations rely on…

Machine Learning · Computer Science 2022-09-28 Chaoqun You , Daquan Feng , Kun Guo , Howard H. Yang , Tony Q. S. Quek

Federated learning has been extensively studied and is the prevalent method for privacy-preserving distributed learning in edge devices. Correspondingly, continual learning is an emerging field targeted towards learning multiple tasks…

Machine Learning · Computer Science 2022-03-28 Yeshwanth Venkatesha , Youngeun Kim , Hyoungseob Park , Yuhang Li , Priyadarshini Panda

Federated learning involves training machine learning models over devices or data silos, such as edge processors or data warehouses, while keeping the data local. Training in heterogeneous and potentially massive networks introduces bias…

Machine Learning · Computer Science 2021-06-18 Zichen Ma , Yu Lu , Zihan Lu , Wenye Li , Jinfeng Yi , Shuguang Cui

We present a federated learning framework that is designed to robustly deliver good predictive performance across individual clients with heterogeneous data. The proposed approach hinges upon a superquantile-based learning objective that…

Machine Learning · Computer Science 2023-08-04 Krishna Pillutla , Yassine Laguel , Jérôme Malick , Zaid Harchaoui

Recently, federated learning has emerged as a promising approach for training a global model using data from multiple organizations without leaking their raw data. Nevertheless, directly applying federated learning to real-world tasks faces…

Machine Learning · Computer Science 2022-04-19 Bingzhe Wu , Zhipeng Liang , Yuxuan Han , Yatao Bian , Peilin Zhao , Junzhou Huang

Federated learning is an approach to train machine learning models on the edge of the networks, as close as possible where the data is produced, motivated by the emerging problem of the inability to stream and centrally store the large…

Machine Learning · Computer Science 2022-10-07 Kuo-Yun Liang , Abhishek Srinivasan , Juan Carlos Andresen

Federated learning harnesses the power of distributed optimization to train a unified machine learning model across separate clients. However, heterogeneous data distributions and computational workloads can lead to inconsistent updates and…

Machine Learning · Computer Science 2024-10-15 Aayushya Agarwal , Gauri Joshi , Larry Pileggi