English
Related papers

Related papers: Knowledge Distillation for Federated Learning: a P…

200 papers

As a promising distributed machine learning paradigm, Federated Learning (FL) trains a central model with decentralized data without compromising user privacy, which has made it widely used by Artificial Intelligence Internet of Things…

Machine Learning · Computer Science 2022-05-13 Tian Liu , Zhiwei Ling , Jun Xia , Xin Fu , Shui Yu , Mingsong Chen

Federated Averaging, and many federated learning algorithm variants which build upon it, have a limitation: all clients must share the same model architecture. This results in unused modeling capacity on many clients, which limits model…

Machine Learning · Computer Science 2023-10-05 Jared Lichtarge , Ehsan Amid , Shankar Kumar , Tien-Ju Yang , Rohan Anil , Rajiv Mathews

While Federated Learning (FL) is gaining popularity for training machine learning models in a decentralized fashion, numerous challenges persist, such as asynchronization, computational expenses, data heterogeneity, and gradient and…

Machine Learning · Computer Science 2025-03-13 Chun-Yin Huang , Ruinan Jin , Can Zhao , Daguang Xu , Xiaoxiao Li

Federated learning (FL) provides a privacy-preserving solution for fine-tuning pre-trained large language models (LLMs) using distributed private datasets, enabling task-specific adaptation while preserving data privacy. However,…

Machine Learning · Computer Science 2025-01-09 Na Yan , Yang Su , Yansha Deng , Robert Schober

Federated Learning (FL) has emerged as a promising approach to enable collaborative learning among multiple clients while preserving data privacy. However, cross-domain FL tasks, where clients possess data from different domains or…

Machine Learning · Computer Science 2024-04-02 Yuwen Yang , Chang Liu , Xun Cai , Suizhi Huang , Hongtao Lu , Yue Ding

Federated learning (FL) is a recently proposed distributed machine learning paradigm dealing with distributed and private data sets. Based on the data partition pattern, FL is often categorized into horizontal, vertical, and hybrid…

Machine Learning · Computer Science 2021-02-19 Xinwei Zhang , Wotao Yin , Mingyi Hong , Tianyi Chen

Model-Heterogeneous Federated Learning (Hetero-FL) has attracted growing attention for its ability to aggregate knowledge from heterogeneous models while keeping private data locally. To better aggregate knowledge from clients, ensemble…

Machine Learning · Computer Science 2025-10-15 Yichen Li , Xiuying Wang , Wenchao Xu , Haozhao Wang , Yining Qi , Jiahua Dong , Ruixuan Li

Data heterogeneity among Federated Learning (FL) users poses a significant challenge, resulting in reduced global model performance. The community has designed various techniques to tackle this issue, among which Knowledge Distillation…

Machine Learning · Computer Science 2024-10-08 Momin Ahmad Khan , Yasra Chandio , Fatima Muhammad Anwar

The increasing demand for intelligent services and privacy protection of mobile and Internet of Things (IoT) devices motivates the wide application of Federated Edge Learning (FEL), in which devices collaboratively train on-device Machine…

Machine Learning · Computer Science 2024-03-06 Zhiyuan Wu , Sheng Sun , Yuwei Wang , Min Liu , Xuefeng Jiang , Runhan Li , Bo Gao

Federated Learning (FL) is a machine learning paradigm where local nodes collaboratively train a central model while the training data remains decentralized. Existing FL methods typically share model parameters or employ co-distillation to…

Cryptography and Security · Computer Science 2022-09-13 Xuan Gong , Abhishek Sharma , Srikrishna Karanam , Ziyan Wu , Terrence Chen , David Doermann , Arun Innanje

Federated learning (FL) enables multiple clients to collaboratively train a global model while keeping local data decentralized. Data heterogeneity (non-IID) across clients has imposed significant challenges to FL, which makes local models…

Machine Learning · Computer Science 2025-04-22 Yuting He , Yiqiang Chen , XiaoDong Yang , Hanchao Yu , Yi-Hua Huang , Yang Gu

Heterogeneity of data distributed across clients limits the performance of global models trained through federated learning, especially in the settings with highly imbalanced class distributions of local datasets. In recent years,…

Machine Learning · Computer Science 2023-04-11 Huancheng Chen , Johnny , Wang , Haris Vikalo

Concerned with user data privacy, this paper presents a new federated learning (FL) method that trains machine learning models on edge devices without accessing sensitive data. Traditional FL methods, although privacy-protective, fail to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-03 Duy Phuong Nguyen , Sixing Yu , J. Pablo Muñoz , Ali Jannesari

Federated Learning (FL) is an innovative distributed machine learning paradigm that enables neural network training across devices without centralizing data. While this addresses issues of information sharing and data privacy, challenges…

Machine Learning · Computer Science 2024-12-09 Jiayu Liu , Yong Wang , Nianbin Wang , Jing Yang , Xiaohui Tao

Federated learning (FL) is emerging as a new paradigm to train machine learning models in distributed systems. Rather than sharing, and disclosing, the training dataset with the server, the model parameters (e.g. neural networks weights and…

Signal Processing · Electrical Eng. & Systems 2020-05-27 Stefano Savazzi , Monica Nicoli , Vittorio Rampa

Federated learning (FL) refers to a distributed machine learning framework involving learning from several decentralized edge clients without sharing local dataset. This distributed strategy prevents data leakage and enables on-device…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-28 Taki Hasan Rafi , Faiza Anan Noor , Tahmid Hussain , Dong-Kyu Chae , Zhaohui Yang

Federated learning (FL) is a new paradigm for distributed machine learning that allows a global model to be trained across multiple clients without compromising their privacy. Although FL has demonstrated remarkable success in various…

Machine Learning · Computer Science 2023-06-06 Haolin Wang , Xuefeng Liu , Jianwei Niu , Shaojie Tang , Jiaxing Shen

Federated learning (FL) is an emerging paradigm that permits a large number of clients with heterogeneous data to coordinate learning of a unified global model without the need to share data amongst each other. A major challenge in…

Machine Learning · Computer Science 2023-11-16 Irene Tenison , Sai Aravind Sreeramadas , Vaikkunth Mugunthan , Edouard Oyallon , Irina Rish , Eugene Belilovsky

Federated learning (FL) is a privacy-preserving distributed machine learning paradigm that enables collaborative training among geographically distributed and heterogeneous devices without gathering their data. Extending FL beyond the…

Machine Learning · Computer Science 2023-04-04 Jin Wang , Jia Hu , Jed Mills , Geyong Min , Ming Xia

Federated Learning (FL) is designed to protect the data privacy of each client during the training process by transmitting only models instead of the original data. However, the trained model may memorize certain information about the…

Machine Learning · Computer Science 2022-01-25 Chen Wu , Sencun Zhu , Prasenjit Mitra