English
Related papers

Related papers: HeteroFL: Computation and Communication Efficient …

200 papers

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

Federated learning (FL) enables multiple clients to train models collaboratively without sharing local data, which has achieved promising results in different areas, including the Internet of Things (IoT). However, end IoT devices do not…

Machine Learning · Computer Science 2023-03-07 Jiaqi Wang , Shenglai Zeng , Zewei Long , Yaqing Wang , Houping Xiao , Fenglong Ma

Federated Learning (FL) is a paradigm for large-scale distributed learning which faces two key challenges: (i) efficient training from highly heterogeneous user data, and (ii) protecting the privacy of participating users. In this work, we…

Machine Learning · Computer Science 2023-01-06 Maxence Noble , Aurélien Bellet , Aymeric Dieuleveut

Learning from distributed data without accessing them is undoubtedly a challenging and non-trivial task. Nevertheless, the necessity for distributed training of a statistical model has been increasing, due to the privacy concerns of local…

Machine Learning · Statistics 2024-08-02 Seok-Ju Hahn

Today data is often scattered among billions of resource-constrained edge devices with security and privacy constraints. Federated Learning (FL) has emerged as a viable solution to learn a global model while keeping data private, but the…

Machine Learning · Computer Science 2021-12-08 Sijie Cheng , Jingwen Wu , Yanghua Xiao , Yang Liu , Yang Liu

Federated learning is a distributed learning framework that takes full advantage of private data samples kept on edge devices. In real-world federated learning systems, these data samples are often decentralized and Non-Independently…

Machine Learning · Computer Science 2023-03-03 Dun Zeng , Xiangjing Hu , Shiyu Liu , Yue Yu , Qifan Wang , Zenglin Xu

Concerned with user data privacy, this paper presents a new federated learning (FL) method that trains machine learning models on edge devices without accessing sensitive data. Traditional FL methods, although privacy-protective, fail to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-03 Duy Phuong Nguyen , Sixing Yu , J. Pablo Muñoz , Ali Jannesari

SplitFed Learning (SFL) combines federated learning and split learning to enable collaborative training across distributed edge devices; however, it faces significant challenges in heterogeneous environments with diverse computational and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-27 Abdullah Al Asif , Sixing Yu , Juan Pablo Munoz , Arya Mazaheri , Ali Jannesari

Federated Learning is an emerging learning paradigm that allows training models from samples distributed across a large network of clients while respecting privacy and communication restrictions. Despite its success, federated learning…

Machine Learning · Computer Science 2022-06-07 Isidoros Tziotis , Zebang Shen , Ramtin Pedarsani , Hamed Hassani , Aryan Mokhtari

One underlying assumption of recent federated learning (FL) paradigms is that all local models usually share the same network architecture and size, which becomes impractical for devices with different hardware resources. A scalable…

Machine Learning · Computer Science 2022-05-27 Dezhong Yao , Wanning Pan , Michael J O'Neill , Yutong Dai , Yao Wan , Hai Jin , Lichao Sun

Federated Learning (FL) is a way for machines to learn from data that is kept locally, in order to protect the privacy of clients. This is typically done using local SGD, which helps to improve communication efficiency. However, such a…

Machine Learning · Computer Science 2023-06-01 Yongxin Guo , Xiaoying Tang , Tao Lin

Collaborative learning across heterogeneous model architectures presents significant challenges in ensuring interoperability and preserving privacy. We propose a communication-efficient distributed learning framework that supports model…

Machine Learning · Computer Science 2025-09-30 Mounssif Krouka , Mehdi Bennis

Federated Learning (FL) is currently the most widely adopted framework for collaborative training of (deep) machine learning models under privacy constraints. Albeit it's popularity, it has been observed that Federated Learning yields…

Machine Learning · Computer Science 2019-10-07 Felix Sattler , Klaus-Robert Müller , Wojciech Samek

Federated Learning (FL) is a distributed machine learning paradigm designed for privacy-sensitive applications that run on resource-constrained devices with non-Identically and Independently Distributed (IID) data. Traditional FL frameworks…

Machine Learning · Computer Science 2024-09-24 Omid Tavallaie , Kanchana Thilakarathna , Suranga Seneviratne , Aruna Seneviratne , Albert Y. Zomaya

Federated learning (FL) and split learning (SL) are two popular distributed machine learning approaches. Both follow a model-to-data scenario; clients train and test machine learning models without sharing raw data. SL provides better model…

Machine Learning · Computer Science 2022-02-18 Chandra Thapa , M. A. P. Chamikara , Seyit Camtepe , Lichao Sun

Federated learning (FL) has been proposed as a privacy-preserving approach in distributed machine learning. A federated learning architecture consists of a central server and a number of clients that have access to private, potentially…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-06 Gergely Dániel Németh , Miguel Ángel Lozano , Novi Quadrianto , Nuria Oliver

Federated Learning (FL) trains deep models across edge devices without centralizing raw data, preserving user privacy. However, client heterogeneity slows down convergence and limits global model accuracy. Clustered FL (CFL) mitigates this…

Machine Learning · Computer Science 2026-02-10 Minghao Li , Dmitrii Avdiukhin , Rana Shahout , Nikita Ivkin , Vladimir Braverman , Minlan Yu

Federated learning is a distributed machine learning approach where multiple clients collaboratively train a model without sharing their local data, which contributes to preserving privacy. A challenge in federated learning is managing…

Machine Learning · Computer Science 2025-03-04 Rickard Brännvall

Federated learning (FL) is a promising and powerful approach for training deep learning models without sharing the raw data of clients. During the training process of FL, the central server and distributed clients need to exchange a vast…

Machine Learning · Computer Science 2021-04-27 Zhefeng Qiao , Xianghao Yu , Jun Zhang , Khaled B. Letaief

In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with…

Machine Learning · Computer Science 2020-04-07 Muhammad Asad , Ahmed Moustafa , Takayuki Ito , Muhammad Aslam