English
Related papers

Related papers: Adaptive Self-Distillation for Minimizing Client D…

200 papers

Federated Learning (FL) is an emerging machine learning paradigm that enables the collaborative training of a shared global model across distributed clients while keeping the data decentralized. Recent works on designing systems for…

Machine Learning · Computer Science 2024-02-13 Mohak Chadha , Pulkit Khera , Jianfeng Gu , Osama Abboud , Michael Gerndt

The federated learning (FL) framework trains a machine learning model using decentralized data stored at edge client devices by periodically aggregating locally trained models. Popular optimization algorithms of FL use vanilla (stochastic)…

Machine Learning · Computer Science 2021-06-07 Jianyu Wang , Zheng Xu , Zachary Garrett , Zachary Charles , Luyang Liu , Gauri Joshi

Federated learning (FL) is a distributed machine learning framework where the global model of a central server is trained via multiple collaborative steps by participating clients without sharing their data. While being a flexible…

Machine Learning · Computer Science 2024-05-03 Junhyung Lyle Kim , Mohammad Taha Toghani , César A. Uribe , Anastasios Kyrillidis

Federated learning (FL) is a distributed paradigm that coordinates massive local clients to collaboratively train a global model via stage-wise local training processes on the heterogeneous dataset. Previous works have implicitly studied…

Machine Learning · Computer Science 2026-04-15 Li Shen , Yan Sun , Dacheng Tao

Federated Learning (FL) suffers from severe performance degradation due to the data heterogeneity among clients. Existing works reveal that the fundamental reason is that data heterogeneity can cause client drift where the local model…

Machine Learning · Computer Science 2025-01-22 Haoran Xu , Jiaze Li , Wanyi Wu , Hao Ren

Personalization in federated learning (FL) functions as a coordinator for clients with high variance in data or behavior. Ensuring the convergence of these clients' models relies on how closely users collaborate with those with similar…

Machine Learning · Computer Science 2023-02-24 Eunjeong Jeong , Marios Kountouris

Federated Learning (FL) has emerged as a powerful paradigm for decentralized machine learning, enabling collaborative model training across diverse clients without sharing raw data. However, traditional FL approaches often face limitations…

Machine Learning · Computer Science 2025-10-22 Ali Forootani , Raffaele Iervolino

The performance of Federated Learning (FL) hinges on the effectiveness of utilizing knowledge from distributed datasets. Traditional FL methods adopt an aggregate-then-adapt framework, where clients update local models based on a global…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yuan Wang , Huazhu Fu , Renuga Kanagavelu , Qingsong Wei , Yong Liu , Rick Siow Mong Goh

Federated Learning (FL) allows edge devices (or clients) to keep data locally while simultaneously training a shared high-quality global model. However, current research is generally based on an assumption that the training data of local…

Machine Learning · Computer Science 2021-10-27 Zhe Zhang , Shiyao Ma , Jiangtian Nie , Yi Wu , Qiang Yan , Xiaoke Xu , Dusit Niyato

In federated learning, the heterogeneity of client data has a great impact on the performance of model training. Many heterogeneity issues in this process are raised by non-independently and identically distributed (non-IID) data. To…

Machine Learning · Computer Science 2026-03-25 Xiufang Shi , Wei Zhang , Yuheng Li , Mincheng Wu , Zhenyu Wen , Shibo He , Tejal Shah , Rajiv Ranjan

While Federated Learning (FL) is gaining popularity for training machine learning models in a decentralized fashion, numerous challenges persist, such as asynchronization, computational expenses, data heterogeneity, and gradient and…

Machine Learning · Computer Science 2025-03-13 Chun-Yin Huang , Ruinan Jin , Can Zhao , Daguang Xu , Xiaoxiao Li

Federated Learning (FL) is an emerging distributed learning paradigm under privacy constraint. Data heterogeneity is one of the main challenges in FL, which results in slow convergence and degraded performance. Most existing approaches only…

Machine Learning · Computer Science 2023-10-27 Lin Zhang , Li Shen , Liang Ding , Dacheng Tao , Ling-Yu Duan

Federated Learning (FL) is a distributed machine learning paradigm facilitating participants to collaboratively train a model without revealing their local data. However, when FL is deployed into the wild, some intelligent clients can…

Machine Learning · Computer Science 2025-10-03 Andrea Augello , Ashish Gupta , Giuseppe Lo Re , Sajal K. Das

Federated learning algorithms perform reasonably well on independent and identically distributed (IID) data. They, on the other hand, suffer greatly from heterogeneous environments, i.e., Non-IID data. Despite the fact that many research…

Machine Learning · Computer Science 2023-09-15 Yeachan Kim , Bonggun Shin

Federated Learning (FL) enables a group of clients to jointly train a machine learning model with the help of a centralized server. Clients do not need to submit their local data to the server during training, and hence the local training…

Machine Learning · Computer Science 2023-01-10 Liling Zhang , Xinyu Lei , Yichun Shi , Hongyu Huang , Chao Chen

Federated learning (FL) is a popular privacy-preserving paradigm that enables distributed clients to collaboratively train models with a central server while keeping raw data locally. In practice, distinct model architectures, varying data…

Machine Learning · Computer Science 2024-05-28 Yuting Ma , Lechao Cheng , Yaxiong Wang , Zhun Zhong , Xiaohua Xu , Meng Wang

Federated learning (FL) enables collaborative model training across distributed edge devices while preserving data privacy, and typically operates in a round-based synchronous manner. However, synchronous FL suffers from latency bottlenecks…

Machine Learning · Computer Science 2026-03-17 Asaf Goren , Natalie Lang , Nir Shlezinger , Alejandro Cohen

Traditionally, federated learning (FL) aims to train a single global model while collaboratively using multiple clients and a server. Two natural challenges that FL algorithms face are heterogeneity in data across clients and collaboration…

Machine Learning · Computer Science 2022-07-06 Kaan Ozkara , Navjot Singh , Deepesh Data , Suhas Diggavi

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

Federated learning (FL) is a distributed learning method that offers medical institutes the prospect of collaboration in a global model while preserving the privacy of their patients. Although most medical centers conduct similar medical…

Machine Learning · Computer Science 2022-07-08 Yousef Yeganeh , Azade Farshad , Johann Boschmann , Richard Gaus , Maximilian Frantzen , Nassir Navab