English
Related papers

Related papers: Complement Sparsification: Low-Overhead Model Prun…

200 papers

Federated Learning (FL) trains deep models across edge devices without centralizing raw data, preserving user privacy. However, client heterogeneity slows down convergence and limits global model accuracy. Clustered FL (CFL) mitigates this…

Machine Learning · Computer Science 2026-02-10 Minghao Li , Dmitrii Avdiukhin , Rana Shahout , Nikita Ivkin , Vladimir Braverman , Minlan Yu

Federated Learning (FL) enables multiple clients to collaboratively learn a machine learning model without exchanging their own local data. In this way, the server can exploit the computational power of all clients and train the model on a…

Machine Learning · Computer Science 2023-07-04 Song Wang , Xingbo Fu , Kaize Ding , Chen Chen , Huiyuan Chen , Jundong Li

Sparse training is often adopted in cross-device federated learning (FL) environments where constrained devices collaboratively train a machine learning model on private data by exchanging pseudo-gradients across heterogeneous networks.…

Machine Learning · Computer Science 2025-04-08 Adriano Guastella , Lorenzo Sani , Alex Iacob , Alessio Mora , Paolo Bellavista , Nicholas D. Lane

This work addresses the problem of optimizing communications between server and clients in federated learning (FL). Current sampling approaches in FL are either biased, or non optimal in terms of server-clients communications and training…

Machine Learning · Computer Science 2021-05-24 Yann Fraboni , Richard Vidal , Laetitia Kameni , Marco Lorenzi

Federated learning (FL) can achieve privacy-safe and reliable collaborative training without collecting users' private data. Its excellent privacy security potential promotes a wide range of FL applications in Internet-of-Things (IoT),…

Machine Learning · Computer Science 2023-09-26 Xiaofeng Liu , Qing Wang , Yunfeng Shao , Yinchuan Li

Decentralized Federated Learning (DFL) enables collaborative model training without a central server but faces challenges in efficiency, stability, and trustworthiness due to communication and computational limitations among distributed…

Machine Learning · Computer Science 2025-03-18 Shan Sha , Shenglong Zhou , Lingchen Kong , Geoffrey Ye Li

The practical deployment of Federated Learning (FL) on resource-constrained devices is fundamentally limited by the high cost of training large models and the instability caused by heterogeneous (non-IID) client data. Conventional pruning…

Machine Learning · Computer Science 2026-05-13 Christian Internò , Elena Raponi , Markus Olhofer , Ali Raza , Thomas Bäck , Niki van Stein , Yaochu Jin , Barbara Hammer

Federated learning (FL) operates based on model exchanges between the server and the clients, and it suffers from significant client-side computation and communication burden. Split federated learning (SFL) arises a promising solution by…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-23 Yiannis Papageorgiou , Yannis Thomas , Alexios Filippakopoulos , Ramin Khalili , Iordanis Koutsopoulos

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Federated learning (FL) is a powerful distributed machine learning framework where a server aggregates models trained by different clients without accessing their private data. Hierarchical FL, with a client-edge-cloud aggregation…

Machine Learning · Computer Science 2023-01-10 Lumin Liu , Jun Zhang , Shenghui Song , Khaled B. Letaief

Federated Learning (FL) is currently the most widely adopted framework for collaborative training of (deep) machine learning models under privacy constraints. Albeit it's popularity, it has been observed that Federated Learning yields…

Machine Learning · Computer Science 2019-10-07 Felix Sattler , Klaus-Robert Müller , Wojciech Samek

Federated Learning (FL) enables collaborative model training across decentralized clients while preserving data privacy by keeping raw data local. However, FL suffers from significant communication overhead due to the frequent exchange of…

Machine Learning · Computer Science 2025-11-11 Chaimaa Medjadji , Sadi Alawadi , Feras M. Awaysheh , Guilain Leduc , Sylvain Kubler , Yves Le Traon

Federated learning (FL) is a distributed learning technique that trains a shared model over distributed data in a privacy-preserving manner. Unfortunately, FL's performance degrades when there is (i) variability in client characteristics in…

Machine Learning · Computer Science 2021-10-28 Muhammad Tahir Munir , Muhammad Mustansar Saeed , Mahad Ali , Zafar Ayyub Qazi , Ihsan Ayyub Qazi

In a real federated learning (FL) system, communication overhead for passing model parameters between the clients and the parameter server (PS) is often a bottleneck. Hierarchical federated learning (HFL) that poses multiple edge servers…

Machine Learning · Computer Science 2024-08-20 Xingrun Yan , Shiyuan Zuo , Rongfei Fan , Han Hu , Li Shen , Puning Zhao , Yong Luo

Federated training of large deep neural networks can often be restrictive due to the increasing costs of communicating the updates with increasing model sizes. Various model pruning techniques have been designed in centralized settings to…

Machine Learning · Computer Science 2022-08-25 Dimitris Stripelis , Umang Gupta , Nikhil Dhinagar , Greg Ver Steeg , Paul Thompson , José Luis Ambite

Federated Learning (FL) is a privacy-preserving machine learning technique that allows decentralized collaborative model training across a set of distributed clients, by avoiding raw data exchange. A fundamental component of FL is the…

Machine Learning · Computer Science 2025-05-20 Sara Alosaime , Arshad Jhumka

Federated Learning (FL), as a distributed learning paradigm, trains models over distributed clients' data. FL is particularly beneficial for distributed training of Diffusion Models (DMs), which are high-quality image generators that…

Machine Learning · Computer Science 2025-07-10 Qianyu Long , Qiyuan Wang , Christos Anagnostopoulos , Daning Bi

Automatic Speech Recognition models require large amount of speech data for training, and the collection of such data often leads to privacy concerns. Federated learning has been widely used and is considered to be an effective…

Machine Learning · Computer Science 2022-09-15 Rongmei Lin , Yonghui Xiao , Tien-Ju Yang , Ding Zhao , Li Xiong , Giovanni Motta , Françoise Beaufays

Statistical heterogeneity across clients in a Federated Learning (FL) system increases the algorithm convergence time and reduces the generalization performance, resulting in a large communication overhead in return for a poor model. To…

Machine Learning · Computer Science 2023-04-26 Mohamad Mestoukirdi , Matteo Zecchin , David Gesbert , Qianrui Li

Federated Learning (FL) is a promising paradigm that offers significant advancements in privacy-preserving, decentralized machine learning by enabling collaborative training of models across distributed devices without centralizing data.…

Machine Learning · Computer Science 2024-06-03 Khiem Le , Nhan Luong-Ha , Manh Nguyen-Duc , Danh Le-Phuoc , Cuong Do , Kok-Seng Wong