English
Related papers

Related papers: Rethinking the Starting Point: Collaborative Pre-T…

200 papers

Since its debut in 2016, Federated Learning (FL) has been tied to the inner workings of Deep Neural Networks (DNNs). On the one hand, this allowed its development and widespread use as DNNs proliferated. On the other hand, it neglected all…

Machine Learning · Computer Science 2023-10-19 Gianluca Mittone , Walter Riviera , Iacopo Colonnelli , Robert Birke , Marco Aldinucci

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Federated Learning (FL) enables multiple clients to collaboratively train a shared model while preserving data privacy. However, the high memory demand during model training severely limits the deployment of FL on resource-constrained…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-14 Yebo Wu , Jingguang Li , Chunlin Tian , Kahou Tam , Li Li , Chengzhong Xu

Federated learning (FL) enables collaborative model training across decentralized medical institutions while preserving data privacy. However, medical FL benchmarks remain scarce, with existing efforts focusing mainly on unimodal or bimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Aavash Chhetri , Bibek Niroula , Pratik Shrestha , Yash Raj Shrestha , Lesley A Anderson , Prashnna K Gyawali , Loris Bazzani , Binod Bhattarai

Federated learning (FL) enables collaborative model training without centralizing data. However, the traditional FL framework is cloud-based and suffers from high communication latency. On the other hand, the edge-based FL framework that…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-28 Zhenxiao Zhang , Zhidong Gao , Yuanxiong Guo , Yanmin Gong

Federated Learning (FL) enables the multiple participating devices to collaboratively contribute to a global neural network model while keeping the training data locally. Unlike the centralized training setting, the non-IID and imbalanced…

Machine Learning · Computer Science 2024-04-16 Moming Duan , Duo Liu , Xinyuan Ji , Renping Liu , Liang Liang , Xianzhang Chen , Yujuan Tan

Few-shot learning (FSL) is a central problem in meta-learning, where learners must efficiently learn from few labeled examples. Within FSL, feature pre-training has recently become an increasingly popular strategy to significantly improve…

Machine Learning · Computer Science 2023-11-07 Ruohan Wang , Isak Falk , Massimiliano Pontil , Carlo Ciliberto

Federated learning (FL) stands as a paradigmatic approach that facilitates model training across heterogeneous and diverse datasets originating from various data providers. However, conventional FLs fall short of achieving consistent…

Machine Learning · Computer Science 2024-08-28 Jiashi Gao , Xin Yao , Xuetao Wei

Federated learning (FL) is proving to be one of the most promising paradigms for leveraging distributed resources, enabling a set of clients to collaboratively train a machine learning model while keeping the data decentralized. The…

Machine Learning · Computer Science 2022-09-12 Mirko Nardi , Lorenzo Valerio , Andrea Passarella

Federated Learning (FL) has become an active and promising distributed machine learning paradigm. As a result of statistical heterogeneity, recent studies clearly show that the performance of popular FL methods (e.g., FedAvg) deteriorates…

Machine Learning · Computer Science 2021-06-24 Hua Huang , Fanhua Shang , Yuanyuan Liu , Hongying Liu

Federated Learning (FL) enables collaborative learning of large-scale distributed clients without data sharing. However, due to the disparity of computing resources among massive mobile computing devices, the performance of traditional…

Machine Learning · Computer Science 2023-11-27 Ruixuan Liu , Ming Hu , Zeke Xia , Jun Xia , Pengyu Zhang , Yihao Huang , Yang Liu , Mingsong Chen

Federated Learning (FL) aims at unburdening the training of deep models by distributing computation across multiple devices (clients) while safeguarding data privacy. On top of that, Federated Continual Learning (FCL) also accounts for data…

Machine Learning · Computer Science 2025-05-27 Riccardo Salami , Pietro Buzzega , Matteo Mosconi , Mattia Verasani , Simone Calderara

Federated learning (FL) is a popular privacy-preserving paradigm that enables distributed clients to collaboratively train models with a central server while keeping raw data locally. In practice, distinct model architectures, varying data…

Machine Learning · Computer Science 2024-05-28 Yuting Ma , Lechao Cheng , Yaxiong Wang , Zhun Zhong , Xiaohua Xu , Meng Wang

Federated Learning (FL) is emerging as a popular, promising decentralized learning framework that enables collaborative training among clients, with no need to share private data between them or to a centralized server. However, considering…

Machine Learning · Computer Science 2023-10-12 Yue Niu , Saurav Prakash , Souvik Kundu , Sunwoo Lee , Salman Avestimehr

Model agnostic meta-learning (MAML) is one of the most widely used gradient-based meta-learning, consisting of two optimization loops: an inner loop and outer loop. MAML learns the new task from meta-initialization parameters with an inner…

Machine Learning · Computer Science 2024-06-10 Jongyun Shin , Seunjin Han , Jangho Kim

Federated Learning (FL) enables distributed machine learning training while preserving privacy, representing a paradigm shift for data-sensitive and decentralized environments. Despite its rapid advancements, FL remains a complex and…

Machine Learning · Computer Science 2025-05-14 Frederico Vicente , Cláudia Soares , Dušan Jakovetić

Federated learning (FL) is a trending training paradigm to utilize decentralized training data. FL allows clients to update model parameters locally for several epochs, then share them to a global model for aggregation. This training…

Machine Learning · Computer Science 2022-08-09 Xiaoxiao Li , Zhao Song , Jiaming Yang

Federated Learning (FL) empowers multiple clients to collaboratively train machine learning models without sharing local data, making it highly applicable in heterogeneous Internet of Things (IoT) environments. However, intrinsic…

Machine Learning · Computer Science 2025-01-29 Xi Chen , Qin Li , Haibin Cai , Ting Wang

An oft-cited challenge of federated learning is the presence of heterogeneity. \emph{Data heterogeneity} refers to the fact that data from different clients may follow very different distributions. \emph{System heterogeneity} refers to the…

Machine Learning · Computer Science 2022-10-18 John Nguyen , Jianyu Wang , Kshitiz Malik , Maziar Sanjabi , Michael Rabbat

Federated learning (FL) is a general principle for decentralized clients to train a server model collectively without sharing local data. FL is a promising framework with practical applications, but its standard training paradigm requires…

Machine Learning · Computer Science 2024-07-23 Haozhe Feng , Tianyu Pang , Chao Du , Wei Chen , Shuicheng Yan , Min Lin