English
Related papers

Related papers: Federated Distillation: A Survey

200 papers

This paper addresses the challenge of mitigating data heterogeneity among clients within a Federated Learning (FL) framework. The model-drift issue, arising from the noniid nature of client data, often results in suboptimal personalization…

Machine Learning · Computer Science 2024-02-19 Kawa Atapour , S. Jamal Seyedmohammadi , Jamshid Abouei , Arash Mohammadi , Konstantinos N. Plataniotis

The robustness of federated learning (FL) is vital for the distributed training of an accurate global model that is shared among large number of clients. The collaborative learning framework by typically aggregating model updates is…

Federated learning is widely used in medical applications for training global models without needing local data access. However, varying computational capabilities and network architectures (system heterogeneity), across clients pose…

Machine Learning · Computer Science 2024-05-14 Luyuan Xie , Manqing Lin , Tianyu Luan , Cong Li , Yuejian Fang , Qingni Shen , Zhonghai Wu

In this paper, to deal with the heterogeneity in federated learning (FL) systems, a knowledge distillation (KD) driven training framework for FL is proposed, where each user can select its neural network model on demand and distill…

Machine Learning · Computer Science 2023-03-14 Xiucheng Wang , Nan Cheng , Longfei Ma , Ruijin Sun , Rong Chai , Ning Lu

With increasing concerns for data privacy and ownership, recent years have witnessed a paradigm shift in machine learning (ML). An emerging paradigm, federated learning (FL), has gained great attention and has become a novel design for…

Cryptography and Security · Computer Science 2022-08-24 Xu Cheng , Chendan Li , Xiufeng Liu

Federated learning (FL) is a powerful distributed machine learning framework where a server aggregates models trained by different clients without accessing their private data. Hierarchical FL, with a client-edge-cloud aggregation…

Machine Learning · Computer Science 2023-01-10 Lumin Liu , Jun Zhang , Shenghui Song , Khaled B. Letaief

Federated learning (FL) has been developed as a promising framework to leverage the resources of edge devices, enhance customers' privacy, comply with regulations, and reduce development costs. Although many methods and applications have…

Machine Learning · Computer Science 2022-02-03 Jie Ding , Eric Tramel , Anit Kumar Sahu , Shuang Wu , Salman Avestimehr , Tao Zhang

Federated learning (FL) is a privacy-preserving learning technique that enables distributed computing devices to train shared learning models across data silos collaboratively. Existing FL works mostly focus on designing advanced FL…

Machine Learning · Computer Science 2023-02-20 Yash Travadi , Le Peng , Xuan Bi , Ju Sun , Mochen Yang

Many application scenarios call for training a machine learning model among multiple participants. Federated learning (FL) was proposed to enable joint training of a deep learning model using the local data in each party without revealing…

Machine Learning · Computer Science 2021-02-12 Kai-Fung Chu , Lintao Zhang

One of the main challenges of federated learning (FL) is handling non-independent and identically distributed (non-IID) client data, which may occur in practice due to unbalanced datasets and use of different data sources across clients.…

Machine Learning · Computer Science 2024-10-23 Peng Wu , Tales Imbiriba , Pau Closas

Federated Learning (FL) has emerged as a means of distributed learning using local data stored at clients with a coordinating server. Recent studies showed that FL can suffer from poor performance and slower convergence when training data…

Machine Learning · Computer Science 2023-08-17 Van Sy Mai , Richard J. La , Tao Zhang

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez

Federated learning (FL) is an emerging technology that enables the training of machine learning models from multiple clients while keeping the data distributed and private. Based on the participating clients and the model training scale,…

Machine Learning · Computer Science 2022-06-28 Chao Huang , Jianwei Huang , Xin Liu

Federated learning (FL) faces significant challenges in Internet of Things (IoT) networks due to device limitations in energy and communication resources, especially when considering the large size of FL models. From an energy perspective,…

Signal Processing · Electrical Eng. & Systems 2025-05-28 Rafael Valente da Silva , Onel L. Alcaraz López , Richard Demo Souza

Federated learning (FL) enables a decentralized machine learning paradigm for multiple clients to collaboratively train a generalized global model without sharing their private data. Most existing works simply propose typical FL systems for…

Machine Learning · Computer Science 2023-11-08 Huy Q. Le , Minh N. H. Nguyen , Chu Myaet Thwal , Yu Qiao , Chaoning Zhang , Choong Seon Hong

In Federated Learning (FL), the distributed nature and heterogeneity of client data present both opportunities and challenges. While collaboration among clients can significantly enhance the learning process, not all collaborations are…

Machine Learning · Computer Science 2024-07-18 Nazarii Tupitsa , Samuel Horváth , Martin Takáč , Eduard Gorbunov

Federated learning (FL) is a promising technique that enables a large amount of edge computing devices to collaboratively train a global learning model. Due to privacy concerns, the raw data on devices could not be available for centralized…

Machine Learning · Computer Science 2020-11-24 Miao Yang , Akitanoshou Wong , Hongbin Zhu , Haifeng Wang , Hua Qian

The Federated Learning (FL) workflow of training a centralized model with distributed data is growing in popularity. However, until recently, this was the realm of contributing clients with similar computing capability. The fast expanding…

Machine Learning · Computer Science 2022-03-23 Hongrui Shi , Valentin Radu

In recent years, data are typically distributed in multiple organizations while the data security is becoming increasingly important. Federated Learning (FL), which enables multiple parties to collaboratively train a model without…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-13 Ji Liu , Xuehai Zhou , Lei Mo , Shilei Ji , Yuan Liao , Zheng Li , Qin Gu , Dejing Dou

The traditional cloud-centric approach for Deep Learning (DL) requires training data to be collected and processed at a central server which is often challenging in privacy-sensitive domains like healthcare. Towards this, a new learning…

Cryptography and Security · Computer Science 2021-11-08 Andreas Grafberger , Mohak Chadha , Anshul Jindal , Jianfeng Gu , Michael Gerndt