English
Related papers

Related papers: Breaking the Memory Wall for Heterogeneous Federat…

200 papers

In this paper, a Federated Learning (FL) simulation platform is introduced. The target scenario is Acoustic Model training based on this platform. To our knowledge, this is the first attempt to apply FL techniques to Speech Recognition…

Machine Learning · Computer Science 2020-08-07 Dimitrios Dimitriadis , Kenichi Kumatani , Robert Gmyr , Yashesh Gaur , Sefik Emre Eskimez

Federated Learning (FL) is an emerging paradigm that enables distributed users to collaboratively and iteratively train machine learning models without sharing their private data. Motivated by the effectiveness and robustness of…

Machine Learning · Computer Science 2022-11-16 Jinyu Chen , Wenchao Xu , Song Guo , Junxiao Wang , Jie Zhang , Haozhao Wang

Federated Learning (FL) plays a critical role in distributed systems. In these systems, data privacy and confidentiality hold paramount importance, particularly within edge-based data processing systems such as IoT devices deployed in smart…

Machine Learning · Computer Science 2024-03-08 Humaid Ahmed Desai , Amr Hilal , Hoda Eldardiry

Federated Learning (FL), as a distributed learning paradigm, trains models over distributed clients' data. FL is particularly beneficial for distributed training of Diffusion Models (DMs), which are high-quality image generators that…

Machine Learning · Computer Science 2025-07-10 Qianyu Long , Qiyuan Wang , Christos Anagnostopoulos , Daning Bi

Federated Learning (FL) enables a large number of users to jointly learn a shared machine learning (ML) model, coordinated by a centralized server, where the data is distributed across multiple devices. This approach enables the server or…

Cryptography and Security · Computer Science 2020-04-07 Kalikinkar Mandal , Guang Gong

The increasing demand for privacy-preserving collaborative learning has given rise to a new computing paradigm called federated learning (FL), in which clients collaboratively train a machine learning (ML) model without revealing their…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-31 Zhifeng Jiang , Wei Wang , Bo Li , Qiang Yang

Federated Continual Learning (FCL) has emerged as a robust solution for collaborative model training in dynamic environments, where data samples are continuously generated and distributed across multiple devices. This survey provides a…

Machine Learning · Computer Science 2025-07-17 Parisa Hamedi , Roozbeh Razavi-Far , Ehsan Hallaji

Federated Learning (FL) is a privacy-focused machine learning paradigm that collaboratively trains models directly on edge devices. Simulation plays an essential role in FL adoption, helping develop novel aggregation and client sampling…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-21 Lorenzo Sani , Pedro Porto Buarque de Gusmão , Alex Iacob , Wanru Zhao , Xinchi Qiu , Yan Gao , Javier Fernandez-Marques , Nicholas Donald Lane

Many studies integrate federated learning (FL) with self-supervised learning (SSL) to take advantage of raw data distributed across edge devices. However, edge devices often struggle with high computational and communication costs imposed…

Machine Learning · Computer Science 2025-12-02 Ye Lin Tun , Chu Myaet Thwal , Huy Q. Le , Minh N. H. Nguyen , Eui-Nam Huh , Choong Seon Hong

Federated learning (FL) is a kind of distributed machine learning framework, where the global model is generated on the centralized aggregation server based on the parameters of local models, addressing concerns about privacy leakage caused…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-22 Chenhao Xu , Youyang Qu , Yong Xiang , Longxiang Gao

Federated learning has received significant attention for its ability to simultaneously protect customer privacy and leverage distributed data from multiple devices for model training. However, conventional approaches often focus on…

Machine Learning · Computer Science 2025-10-07 Jiahao Zeng , Wolong Xing , Liangtao Shi , Xin Huang , Jialin Wang , Zhile Cao , Zhenkui Shi

Data Heterogeneity is a major challenge of Federated Learning performance. Recently, momentum based optimization techniques have beed proved to be effective in mitigating the heterogeneity issue. Along with the model updates, the momentum…

Machine Learning · Computer Science 2024-12-02 Chenguang Xiao , Shuo Wang

Federated learning (FL) is a distributed machine learning paradigm enabling collaborative model training while preserving data privacy. In today's landscape, where most data is proprietary, confidential, and distributed, FL has become a…

Machine Learning · Computer Science 2025-03-11 Zilinghan Li , Shilan He , Ze Yang , Minseok Ryu , Kibaek Kim , Ravi Madduri

Federated learning (FL) promises to enable collaborative machine learning across healthcare sites whilst preserving data privacy. Practical deployment remains limited by statistical heterogeneity arising from differences in patient…

Initializing with pre-trained models when learning on downstream tasks is becoming standard practice in machine learning. Several recent works explore the benefits of pre-trained initialization in a federated learning (FL) setting, where…

Machine Learning · Computer Science 2025-02-13 Divyansh Jhunjhunwala , Pranay Sharma , Zheng Xu , Gauri Joshi

Federated learning (FL) enables collaborative training of a global model in the centralized server with data from multiple parties while preserving privacy. However, data heterogeneity can significantly degrade the performance of the global…

Machine Learning · Computer Science 2025-11-11 Yong Zhang , Feng Liang , Guanghu Yuan , Min Yang , Chengming Li , Xiping Hu

Federated Semi-Supervised Learning (FSSL) aims to collaboratively train a global model across clients by leveraging partially-annotated local data in a privacy-preserving manner. In FSSL, data heterogeneity is a challenging issue, which…

Machine Learning · Computer Science 2026-02-25 Duowen Chen , Yan Wang

Federated learning (FL) and split learning (SL) are two effective distributed learning paradigms in wireless networks, enabling collaborative model training across mobile devices without sharing raw data. While FL supports low-latency…

Machine Learning · Computer Science 2025-11-26 Kun Guo , Xuefei Li , Xijun Wang , Howard H. Yang , Wei Feng , Tony Q. S. Quek

Federated Learning (FL) has become an established technique to facilitate privacy-preserving collaborative training across a multitude of clients. However, new approaches to FL often discuss their contributions involving small deep-learning…

Machine Learning · Computer Science 2026-05-05 Herbert Woisetschläger , Alexander Isenko , Shiqiang Wang , Ruben Mayer , Hans-Arno Jacobsen

Federated Learning (FL) enables collaborations among clients for train machine learning models while protecting their data privacy. Existing FL simulation platforms that are designed from the perspectives of traditional distributed…