English
Related papers

Related papers: Federated Learning via Decentralized Dataset Disti…

200 papers

Communication constraints are one of the major challenges preventing the wide-spread adoption of Federated Learning systems. Recently, Federated Distillation (FD), a new algorithmic paradigm for Federated Learning with fundamentally…

Machine Learning · Computer Science 2020-12-02 Felix Sattler , Arturo Marban , Roman Rischke , Wojciech Samek

Federated Learning (FL) is a machine learning setting where many devices collaboratively train a machine learning model while keeping the training data decentralized. In most of the current training schemes the central model is refined by…

Machine Learning · Computer Science 2021-03-30 Tao Lin , Lingjing Kong , Sebastian U. Stich , Martin Jaggi

Federated Learning (FL) has been widely concerned for it enables decentralized learning while ensuring data privacy. However, most existing methods unrealistically assume that the classes encountered by local clients are fixed over time.…

Machine Learning · Computer Science 2023-06-28 Chenghao Liu , Xiaoyang Qu , Jianzong Wang , Jing Xiao

Federated learning (FL) is a recently developed area of machine learning, in which the private data of a large number of distributed clients is used to develop a global model under the coordination of a central server without explicitly…

Machine Learning · Computer Science 2022-07-21 Amit Kumar Kundu , Joseph Jaja

Recently, innovative model aggregation methods based on knowledge distillation (KD) have been proposed for federated learning (FL). These methods not only improved the robustness of model aggregation over heterogeneous learning environment,…

Machine Learning · Computer Science 2023-12-29 Ho Man Kwan , Shenghui Song

Large models, renowned for superior performance, outperform smaller ones even without billion-parameter scales. While mobile network servers have ample computational resources to support larger models than client devices, privacy…

Machine Learning · Computer Science 2025-08-20 Wenxuan Ye , Xueli An , Onur Ayan , Junfan Wang , Xueqiang Yan , Georg Carle

Federated Edge Learning (FEL) has emerged as a promising approach for enabling edge devices to collaboratively train machine learning models while preserving data privacy. Despite its advantages, practical FEL deployment faces significant…

Machine Learning · Computer Science 2024-10-15 Quyang Pan , Sheng Sun , Zhiyuan Wu , Yuwei Wang , Min Liu , Bo Gao , Jingyuan Wang

Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessible, such as domain-specific datasets decentralized across…

Recently, the compression and deployment of powerful deep neural networks (DNNs) on resource-limited edge devices to provide intelligent services have become attractive tasks. Although knowledge distillation (KD) is a feasible solution for…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Zhiwei Hao , Yong Luo , Zhi Wang , Han Hu , Jianping An

Current federated learning algorithms take tens of communication rounds transmitting unwieldy model weights under ideal circumstances and hundreds when data is poorly distributed. Inspired by recent work on dataset distillation and…

Machine Learning · Computer Science 2021-06-08 Yanlin Zhou , George Pu , Xiyao Ma , Xiaolin Li , Dapeng Wu

In this paper, we introduce DistDD, a novel approach within the federated learning framework that reduces the need for repetitive communication by distilling data directly on clients' devices. Unlike traditional federated learning that…

Machine Learning · Computer Science 2024-10-14 Peiran Wang , Haohan Wang

Federated Learning (FL) is an emerging machine learning paradigm that enables the collaborative training of a shared global model across distributed clients while keeping the data decentralized. Recent works on designing systems for…

Machine Learning · Computer Science 2024-02-13 Mohak Chadha , Pulkit Khera , Jianfeng Gu , Osama Abboud , Michael Gerndt

Concerned with user data privacy, this paper presents a new federated learning (FL) method that trains machine learning models on edge devices without accessing sensitive data. Traditional FL methods, although privacy-protective, fail to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-03 Duy Phuong Nguyen , Sixing Yu , J. Pablo Muñoz , Ali Jannesari

Federated learning (FL) enables a decentralized machine learning paradigm for multiple clients to collaboratively train a generalized global model without sharing their private data. Most existing works simply propose typical FL systems for…

Machine Learning · Computer Science 2023-11-08 Huy Q. Le , Minh N. H. Nguyen , Chu Myaet Thwal , Yu Qiao , Chaoning Zhang , Choong Seon Hong

Federated learning is a distributed machine learning approach in which clients train models locally with their own data and upload them to a server so that their trained results are shared between them without uploading raw data to the…

Machine Learning · Computer Science 2023-09-07 Yuto Hoshino , Hiroki Kawakami , Hiroki Matsutani

Decentralized Federated Learning (DFL) trains models in a collaborative and privacy-preserving manner while removing model centralization risks and improving communication bottlenecks. However, DFL faces challenges in efficient…

Decentralized Federated Learning (DFL) struggles with the slow adaptation of late-joining delayed clients and high communication costs in asynchronous environments. These limitations significantly hinder overall performance. To address…

Machine Learning · Computer Science 2025-08-06 Jiahui Bai , Hai Dong , A. K. Qin

Federated learning provides a privacy-preserving manner to collaboratively train models on data distributed over multiple local clients via the coordination of a global server. In this paper, we focus on label distribution skew in federated…

Machine Learning · Computer Science 2024-09-23 Jianghu Lu , Shikun Li , Kexin Bao , Pengju Wang , Zhenxing Qian , Shiming Ge

The rapid growth of Internet of Things (IoT) devices has generated vast amounts of data, leading to the emergence of federated learning as a novel distributed machine learning paradigm. Federated learning enables model training at the edge,…

Signal Processing · Electrical Eng. & Systems 2023-11-03 Abdelaziz Salama , Achilleas Stergioulis , Syed Ali Zaidi , Des McLernon

Federated Learning (FL) has achieved significant achievements recently, enabling collaborative model training on distributed data over edge devices. Iterative gradient or model exchanges between devices and the centralized server in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-19 Ji Liu , Tianshi Che , Yang Zhou , Ruoming Jin , Huaiyu Dai , Dejing Dou , Patrick Valduriez