English
Related papers

Related papers: Heterogeneity-Aware Memory Efficient Federated Lea…

200 papers

Federated Learning (FL) is a distributed learning paradigm that empowers edge devices to collaboratively learn a global model leveraging local data. Simulating FL on GPU is essential to expedite FL algorithm prototyping and evaluations.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-26 Min Zhang , Fuxun Yu , Yongbo Yu , Minjia Zhang , Ang Li , Xiang Chen

Federated learning becomes a prominent approach when different entities want to learn collaboratively a common model without sharing their training data. However, Federated learning has two main drawbacks. First, it is quite bandwidth…

Cryptography and Security · Computer Science 2021-03-02 Raouf Kerkouche , Gergely Ács , Claude Castelluccia , Pierre Genevès

Spiking neural networks (SNNs) are biologically inspired energy-efficient models that use sparse binary spike-based communication between neurons, making them attractive for resource-constrained edge devices. Federated learning enables such…

Machine Learning · Computer Science 2026-05-18 Sanja Karilanova , Subhrakanti Dey , Ayça Özçelikkale

Data-Free Meta-Learning (DFML) aims to extract knowledge from a collection of pre-trained models without requiring the original data, presenting practical benefits in contexts constrained by data privacy concerns. Current DFML methods…

Machine Learning · Computer Science 2024-12-10 Yongxian Wei , Zixuan Hu , Zhenyi Wang , Li Shen , Chun Yuan , Dacheng Tao

Devices participating in federated learning (FL) typically have heterogeneous communication, computation, and memory resources. However, in synchronous FL, all devices need to finish training by the same deadline dictated by the server. Our…

Machine Learning · Computer Science 2023-06-29 Kilian Pfeiffer , Martin Rapp , Ramin Khalili , Jörg Henkel

Federated learning often suffers from slow and unstable convergence due to the heterogeneous characteristics of participating client datasets. Such a tendency is aggravated when the client participation ratio is low since the information…

Machine Learning · Computer Science 2024-04-02 Geeho Kim , Jinkyu Kim , Bohyung Han

Federated Learning (FL) offers a collaborative training framework, allowing multiple clients to contribute to a shared model without compromising data privacy. Due to the heterogeneous nature of local datasets, updated client models may…

Machine Learning · Computer Science 2023-11-14 Chia-Hsiang Kao , Yu-Chiang Frank Wang

Smart energy performance monitoring and optimisation at the supplier and consumer levels is essential to realising smart cities. In order to implement a more sustainable energy management plan, it is crucial to conduct a better energy…

Machine Learning · Computer Science 2022-10-04 Mohammad Al-Quraan , Ahsan Khan , Anthony Centeno , Ahmed Zoha , Muhammad Ali Imran , Lina Mohjazi

Federated machine learning is a versatile and flexible tool to utilize distributed data from different sources, especially when communication technology develops rapidly and an unprecedented amount of data could be collected on mobile…

Machine Learning · Computer Science 2024-03-12 Tianyi Zhang , Shirui Zhang , Ziwei Chen , Dianbo Liu

Federated learning (FL) enables collaborative model training across distributed clients while preserving data privacy. However, data and system heterogeneity often cause catastrophic forgetting and unbounded drift in model updates, leading…

Machine Learning · Computer Science 2026-04-28 Taehwan Yoon , Bongjun Choi , Wesley De Neve

Federated Learning (FL) has emerged as a vital paradigm in modern machine learning that enables collaborative training across decentralized data sources without exchanging raw data. This approach not only addresses privacy concerns but also…

Machine Learning · Computer Science 2025-08-19 Zahra Kharaghani , Ali Dadras , Tommy Löfstedt

Federated learning (FL) enables collaborative model training across distributed devices while preserving data privacy. However, balancing energy efficiency and fair participation while ensuring high model accuracy remains challenging in…

Machine Learning · Computer Science 2025-11-20 Ouiame Marnissi , Hajar EL Hammouti , El Houcine Bergou

Federated learning (FL) has received a surge of interest in recent years thanks to its benefits in data privacy protection, efficient communication, and parallel data processing. Also, with appropriate algorithmic designs, one could achieve…

Machine Learning · Computer Science 2022-08-19 Xin Zhang , Minghong Fang , Zhuqing Liu , Haibo Yang , Jia Liu , Zhengyuan Zhu

Federated learning shows promise as a privacy-preserving collaborative learning technique. Existing heterogeneous federated learning mainly focuses on skewing the label distribution across clients. However, most approaches suffer from…

Machine Learning · Computer Science 2023-12-18 Shunxin Guo , Hongsong Wang , Xin Geng

Federated learning (FL) promotes decentralized training while prioritizing data confidentiality. However, its application on resource-constrained devices is challenging due to the high demand for computation and memory resources to train…

Machine Learning · Computer Science 2024-03-25 Hong Huang , Weiming Zhuang , Chen Chen , Lingjuan Lyu

Federated learning refers to conducting training on multiple distributed devices and collecting model weights from them to derive a shared machine-learning model. This allows the model to get benefit from a rich source of data available…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-15 Wuji Zhu

As AI evolves, collaboration among heterogeneous models helps overcome data scarcity by enabling knowledge transfer across institutions and devices. Traditional Federated Learning (FL) only supports homogeneous models, limiting…

Machine Learning · Computer Science 2025-06-05 Jianqing Zhang , Xinghao Wu , Yanbing Zhou , Xiaoting Sun , Qiqi Cai , Yang Liu , Yang Hua , Zhenzhe Zheng , Jian Cao , Qiang Yang

Model merging has attracted significant attention as a powerful paradigm for model reuse, facilitating the integration of task-specific models into a singular, versatile framework endowed with multifarious capabilities. Previous studies,…

Machine Learning · Computer Science 2025-01-03 Zhengqi Xu , Han Zheng , Jie Song , Li Sun , Mingli Song

Owing to the increasing need for massive data analysis and model training at the network edge, as well as the rising concerns about the data privacy, a new distributed training framework called federated learning (FL) has emerged. In each…

Networking and Internet Architecture · Computer Science 2019-11-05 Wenqi Shi , Sheng Zhou , Zhisheng Niu

Federated learning is used for decentralized training of machine learning models on a large number (millions) of edge mobile devices. It is challenging because mobile devices often have limited communication bandwidth and local computation…

Machine Learning · Computer Science 2021-11-09 Hakim Sidahmed , Zheng Xu , Ankush Garg , Yuan Cao , Mingqing Chen