English
Related papers

Related papers: Reviving Stale Updates: Data-Free Knowledge Distil…

200 papers

In practical federated learning (FL), the large communication overhead between clients and the server is often a significant bottleneck. Gradient compression methods can effectively reduce this overhead, while error feedback (EF) restores…

Machine Learning · Computer Science 2026-02-13 Diying Yang , Yingwei Hou , Weigang Wu

Federated learning (FL) is a new machine learning framework which trains a joint model across a large amount of decentralized computing devices. Existing methods, e.g., Federated Averaging (FedAvg), are able to provide an optimization…

Machine Learning · Computer Science 2021-02-15 Xingyu Li , Zhe Qu , Bo Tang , Zhuo Lu

Federated Learning (FL) has attracted much interest due to the significant advantages it brings to training deep neural network (DNN) models. However, since communications and computation resources are limited, training DNN models in FL…

Machine Learning · Computer Science 2026-03-17 Ran Greidi , Kobi Cohen

Federated learning (FL) has provided a new methodology for coordinating a group of clients to train a machine learning model collaboratively, bringing an efficient paradigm in edge intelligence. Despite its promise, FL faces several…

Machine Learning · Computer Science 2025-03-07 Ziruo Hao , Zhenhua Cui , Tao Yang , Bo Hu , Xiaofeng Wu , Hui Feng

Federated Learning (FL) is a promising distributed machine learning framework that allows collaborative learning of a global model across decentralized devices without uploading their local data. However, in real-world FL scenarios, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-11 Md Sirajul Islam , Sanjeev Panta , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Federated Learning (FL) marks a transformative approach to distributed model training by combining locally optimized models from various clients into a unified global model. While FL preserves data privacy by eliminating centralized…

Machine Learning · Computer Science 2026-01-08 Pranab Sahoo , Ashutosh Tripathi , Sriparna Saha , Samrat Mondal

Decentralized federated learning (DFL) captures FL settings where both (i) model updates and (ii) model aggregations are exclusively carried out by the clients without a central server. Existing DFL works have mostly focused on settings…

Machine Learning · Computer Science 2025-03-07 Shahryar Zehtabi , Dong-Jun Han , Rohit Parasnis , Seyyedali Hosseinalipour , Christopher G. Brinton

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Federated learning (FL) enables collaboratively training a model while keeping the training data decentralized and private. However, one significant impediment to training a model using FL, especially large models, is the resource…

Machine Learning · Computer Science 2023-12-12 Seyed Mahmoud Sajjadi Mohammadabadi , Syed Zawad , Feng Yan , Lei Yang

Despite achieving remarkable performance, Federated Learning (FL) encounters two important problems, i.e., low training efficiency and limited computational resources. In this paper, we propose a new FL framework, i.e., FedDUMAP, with three…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-13 Ji Liu , Juncheng Jia , Hong Zhang , Yuhui Yun , Leye Wang , Yang Zhou , Huaiyu Dai , Dejing Dou

Federated Learning (FL) is a distributed training paradigm that enables clients scattered across the world to cooperatively learn a global model without divulging confidential data. However, FL faces a significant challenge in the form of…

Machine Learning · Computer Science 2023-11-16 Xidong Wu , Wan-Yi Lin , Devin Willmott , Filipe Condessa , Yufei Huang , Zhenzhen Li , Madan Ravi Ganesh

Federated learning (FL) scenarios inherently generate a large communication overhead by frequently transmitting neural network updates between clients and server. To minimize the communication cost, introducing sparsity in conjunction with…

Machine Learning · Computer Science 2022-04-12 Daniel Becking , Heiner Kirchhoffer , Gerhard Tech , Paul Haase , Karsten Müller , Heiko Schwarz , Wojciech Samek

Federated learning (FL) is a decentralized learning paradigm widely adopted in resource-constrained Internet of Things (IoT) environments. These devices, typically relying on TinyML models, collaboratively train global models by sharing…

Machine Learning · Computer Science 2026-02-10 Pouria Arefijamal , Mahdi Ahmadlou , Bardia Safaei , Jörg Henkel

Federated Learning (FL) has emerged as a key approach for distributed machine learning, enhancing online personalization while ensuring user data privacy. Instead of sending private data to a central server as in traditional approaches, FL…

Information Retrieval · Computer Science 2023-09-19 Francesco Fabbri , Xianghang Liu , Jack R. McKenzie , Bartlomiej Twardowski , Tri Kurniawan Wijaya

Federated learning (FL) operates in heterogeneous environments, where variations in data distributions and asymmetric model design often result in negative transfer. While federated knowledge distillation (FKD) avoids direct model parameter…

Machine Learning · Computer Science 2026-05-08 Quang-Huy Nguyen , Jiaqi Wang , Wei-shinn Ku

Privacy-preserving machine learning has become a key conundrum for multi-party artificial intelligence. Federated learning (FL) and Split Learning (SL) are two frameworks that enable collaborative learning while keeping the data private (on…

Machine Learning · Computer Science 2022-12-15 Frédéric Berdoz , Abhishek Singh , Martin Jaggi , Ramesh Raskar

As a promising distributed machine learning paradigm, Federated Learning (FL) trains a central model with decentralized data without compromising user privacy, which has made it widely used by Artificial Intelligence Internet of Things…

Machine Learning · Computer Science 2022-05-13 Tian Liu , Zhiwei Ling , Jun Xia , Xin Fu , Shui Yu , Mingsong Chen

Federated Learning (FL) enables collaborative model training across distributed clients while preserving data privacy, yet faces challenges in non-independent and identically distributed (non-IID) settings due to client drift, which impairs…

Machine Learning · Computer Science 2026-02-12 Mohammad Partohaghighi , Roummel Marcia , Bruce J. West , YangQuan Chen

With the wealth of information produced by social networks, smartphones, medical or financial applications, speculations have been raised about the sensitivity of such data in terms of users' personal privacy and data security. To address…

Machine Learning · Computer Science 2019-08-21 Vito Walter Anelli , Yashar Deldjoo , Tommaso Di Noia , Antonio Ferrara

Federated Learning (FL) is a novel distributed machine learning which allows thousands of edge devices to train model locally without uploading data concentrically to the server. But since real federated settings are resource-constrained,…

Machine Learning · Computer Science 2024-04-16 Li Li , Moming Duan , Duo Liu , Yu Zhang , Ao Ren , Xianzhang Chen , Yujuan Tan , Chengliang Wang