English
Related papers

Related papers: Communication-Efficient Federated Distillation wit…

200 papers

Communication constraints are one of the major challenges preventing the wide-spread adoption of Federated Learning systems. Recently, Federated Distillation (FD), a new algorithmic paradigm for Federated Learning with fundamentally…

Machine Learning · Computer Science 2020-12-02 Felix Sattler , Arturo Marban , Roman Rischke , Wojciech Samek

Federated Learning (FL) seeks to train a model collaboratively without sharing private training data from individual clients. Despite its promise, FL encounters challenges such as high communication costs for large-scale models and the…

Machine Learning · Computer Science 2024-04-15 Lin Li , Jianping Gou , Baosheng Yu , Lan Du , Zhang Yiand Dacheng Tao

Federated Learning (FL) is a promising technique for the collaborative training of deep neural networks across multiple devices while preserving data privacy. Despite its potential benefits, FL is hindered by excessive communication costs…

Machine Learning · Computer Science 2024-02-27 Vasileios Tsouvalas , Aaqib Saeed , Tanir Ozcelebi , Nirvana Meratnia

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

Machine Learning · Computer Science 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

Cooperative training methods for distributed machine learning are typically based on the exchange of local gradients or local model parameters. The latter approach is known as Federated Learning (FL). An alternative solution with reduced…

Signal Processing · Electrical Eng. & Systems 2020-02-05 Jin-Hyun Ahn , Osvaldo Simeone , Joonhyuk Kang

Federated Learning (FL) enables the training of Deep Learning models without centrally collecting possibly sensitive raw data. The most used algorithms for FL are parameter-averaging based schemes (e.g., Federated Averaging) that, however,…

Machine Learning · Computer Science 2025-04-08 Alessio Mora , Irene Tenison , Paolo Bellavista , Irina Rish

Federated learning (FL) is a machine learning paradigm in which distributed local nodes collaboratively train a central model without sharing individually held private data. Existing FL methods either iteratively share local model…

Machine Learning · Computer Science 2023-12-25 Xuan Gong , Shanglin Li , Yuxiang Bao , Barry Yao , Yawen Huang , Ziyan Wu , Baochang Zhang , Yefeng Zheng , David Doermann

Federated Learning (FL) is a machine learning paradigm where many local nodes collaboratively train a central model while keeping the training data decentralized. This is particularly relevant for clinical applications since patient data…

Federated learning (FL) is a prevailing distributed learning paradigm, where a large number of workers jointly learn a model without sharing their training data. However, high communication costs could arise in FL due to large-scale (deep)…

Machine Learning · Computer Science 2021-06-15 Haibo Yang , Jia Liu , Elizabeth S. Bentley

Federated learning (FL) offers a solution to train a global machine learning model while still maintaining data privacy, without needing access to data stored locally at the clients. However, FL suffers performance degradation when client…

Machine Learning · Computer Science 2021-08-13 Zihan Chen , Kai Fong Ernest Chong , Tony Q. S. Quek

On-device machine learning (ML) enables the training process to exploit a massive amount of user-generated private data samples. To enjoy this benefit, inter-device communication overhead should be minimized. With this end, we propose…

Machine Learning · Computer Science 2023-10-20 Eunjeong Jeong , Seungeun Oh , Hyesung Kim , Jihong Park , Mehdi Bennis , Seong-Lyun Kim

Federated Learning (FL) is a promising paradigm that offers significant advancements in privacy-preserving, decentralized machine learning by enabling collaborative training of models across distributed devices without centralizing data.…

Machine Learning · Computer Science 2024-06-03 Khiem Le , Nhan Luong-Ha , Manh Nguyen-Duc , Danh Le-Phuoc , Cuong Do , Kok-Seng Wong

Federated learning (FL) enables on-device training over distributed networks consisting of a massive amount of modern smart devices, such as smartphones and IoT (Internet of Things) devices. However, the leading optimization algorithm in…

Machine Learning · Computer Science 2019-09-04 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

Federated Learning (FL) is a distributed machine learning approach that enables model training in communication efficient and privacy-preserving manner. The standard optimization method in FL is Federated Averaging (FedAvg), which performs…

Machine Learning · Computer Science 2023-09-21 Zeyi Tao , Jindi Wu , Qun Li

Federated Learning (FL) is a machine learning paradigm where local nodes collaboratively train a central model while the training data remains decentralized. Existing FL methods typically share model parameters or employ co-distillation to…

Cryptography and Security · Computer Science 2022-09-13 Xuan Gong , Abhishek Sharma , Srikrishna Karanam , Ziyan Wu , Terrence Chen , David Doermann , Arun Innanje

Federated learning (FL) is able to manage edge devices to cooperatively train a model while maintaining the training data local and private. One common assumption in FL is that all edge devices share the same machine learning model in…

Machine Learning · Computer Science 2022-07-07 Chan Yun Hin , Ngai Edith

Federated Learning (FL) enables multiple machines to collaboratively train a machine learning model without sharing of private training data. Yet, especially for heterogeneous models, a key bottleneck remains the transfer of knowledge…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Sunny Soni , Aaqib Saeed , Yuki M. Asano

Federated Learning (FL) is an emerging distributed learning paradigm under privacy constraint. Data heterogeneity is one of the main challenges in FL, which results in slow convergence and degraded performance. Most existing approaches only…

Machine Learning · Computer Science 2023-10-27 Lin Zhang , Li Shen , Liang Ding , Dacheng Tao , Ling-Yu Duan

Federated Learning (FL) is a machine learning setting where many devices collaboratively train a machine learning model while keeping the training data decentralized. In most of the current training schemes the central model is refined by…

Machine Learning · Computer Science 2021-03-30 Tao Lin , Lingjing Kong , Sebastian U. Stich , Martin Jaggi

One-shot Federated learning (FL) is a powerful technology facilitating collaborative training of machine learning models in a single round of communication. While its superiority lies in communication efficiency and privacy preservation…

Machine Learning · Computer Science 2024-12-09 Junyuan Zhang , Songhua Liu , Xinchao Wang
‹ Prev 1 2 3 10 Next ›