English
Related papers

Related papers: Communication-Efficient Federated Distillation wit…

200 papers

Federated Learning (FL) enables collaborative model training without centralizing data. However, real-world deployments must simultaneously address statistical heterogeneity across client data (non-IID), system heterogeneity in device…

Machine Learning · Computer Science 2026-05-21 Chaimaa Medjadji , Sylvain Kubler , Yves Le Traon , Guilain Leduc , Sadi Alawadi , Feras M. Awaysheh

While Federated Learning (FL) is gaining popularity for training machine learning models in a decentralized fashion, numerous challenges persist, such as asynchronization, computational expenses, data heterogeneity, and gradient and…

Machine Learning · Computer Science 2025-03-13 Chun-Yin Huang , Ruinan Jin , Can Zhao , Daguang Xu , Xiaoxiao Li

Federated Learning (FL) enables participant devices to collaboratively train deep learning models without sharing their data with the server or other devices, effectively addressing data privacy and computational concerns. However, FL faces…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-30 Asadullah Tariq , Tariq Qayyum , Mohamed Adel Serhani , Farag Sallabi , Ikbal Taleb , Ezedin S. Barka

Federated learning (FL) is a privacy-preserving distributed machine learning paradigm that enables collaborative training among geographically distributed and heterogeneous devices without gathering their data. Extending FL beyond the…

Machine Learning · Computer Science 2023-04-04 Jin Wang , Jia Hu , Jed Mills , Geyong Min , Ming Xia

Federated Learning (FL) is a collaborative machine learning framework that allows multiple users to train models utilizing their local data in a distributed manner. However, considerable statistical heterogeneity in local data across…

Machine Learning · Computer Science 2024-09-10 Qi Le , Enmao Diao , Xinran Wang , Vahid Tarokh , Jie Ding , Ali Anwar

Federated learning (FL) for large language models (LLMs) offers a privacy-preserving scheme, enabling clients to collaboratively fine-tune locally deployed LLMs or smaller language models (SLMs) without exchanging raw data. While…

Machine Learning · Computer Science 2025-10-02 Xinlu Zhang , Na Yan , Yang Su , Yansha Deng , Toktam Mahmoodi

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez

In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with…

Machine Learning · Computer Science 2020-04-07 Muhammad Asad , Ahmed Moustafa , Takayuki Ito , Muhammad Aslam

Federated Learning (FL) is a promising distributed method for edge-level machine learning, particularly for privacysensitive applications such as those in military and medical domains, where client data cannot be shared or transferred to a…

Machine Learning · Computer Science 2024-06-27 Lucas Grativol Ribeiro , Mathieu Leonardon , Guillaume Muller , Virginie Fresse , Matthieu Arzel

Federated Learning (FL) is an evolving machine learning method in which multiple clients participate in collaborative learning without sharing their data with each other and the central server. In real-world applications such as hospitals…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Hussain Ahmad Madni , Rao Muhammad Umer , Gian Luca Foresti

Federated learning (FL) typically faces data heterogeneity, i.e., distribution shifting among clients. Sharing clients' information has shown great potentiality in mitigating data heterogeneity, yet incurs a dilemma in preserving privacy…

Machine Learning · Computer Science 2023-10-12 Zhiqin Yang , Yonggang Zhang , Yu Zheng , Xinmei Tian , Hao Peng , Tongliang Liu , Bo Han

Federated learning (FL) achieves collaborative learning without the need for data sharing, thus preventing privacy leakage. To extend FL into a fully decentralized algorithm, researchers have applied distributed optimization algorithms to…

Networking and Internet Architecture · Computer Science 2023-12-20 Akihito Taya , Yuuki Nishiyama , Kaoru Sezaki

Data heterogeneity presents significant challenges for federated learning (FL). Recently, dataset distillation techniques have been introduced, and performed at the client level, to attempt to mitigate some of these challenges. In this…

Machine Learning · Computer Science 2023-12-05 Yuqi Jia , Saeed Vahidian , Jingwei Sun , Jianyi Zhang , Vyacheslav Kungurtsev , Neil Zhenqiang Gong , Yiran Chen

Concerned with user data privacy, this paper presents a new federated learning (FL) method that trains machine learning models on edge devices without accessing sensitive data. Traditional FL methods, although privacy-protective, fail to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-03 Duy Phuong Nguyen , Sixing Yu , J. Pablo Muñoz , Ali Jannesari

Federated distillation (FD) paradigm has been recently proposed as a promising alternative to federated learning (FL) especially in wireless sensor networks with limited communication resources. However, all state-of-the art FD algorithms…

Signal Processing · Electrical Eng. & Systems 2022-10-12 Yaya Etiabi , Marwa Chafii , El Mehdi Amhoud

Federated learning (FL) is a novel machine learning setting that enables on-device intelligence via decentralized training and federated optimization. Deep neural networks' rapid development facilitates the learning techniques for modeling…

Machine Learning · Computer Science 2021-09-27 Shaoxiong Ji , Wenqi Jiang , Anwar Walid , Xue Li

Federated Learning (FL) presents significant potential for collaborative optimization without data sharing. Since synthetic data is sent to the server, leveraging the popular concept of dataset distillation, this FL framework protects real…

Machine Learning · Computer Science 2025-10-29 Haozhi Shi , Weiying Xie , Hangyu Ye , Daixun Li , Jitao Ma , Yunsong Li , Leyuan Fang

Federated learning is widely used to learn intelligent models from decentralized data. In federated learning, clients need to communicate their local model updates in each iteration of model learning. However, model updates are large in…

Machine Learning · Computer Science 2022-05-04 Chuhan Wu , Fangzhao Wu , Lingjuan Lyu , Yongfeng Huang , Xing Xie

Decentralized Federated Learning (DFL) trains models in a collaborative and privacy-preserving manner while removing model centralization risks and improving communication bottlenecks. However, DFL faces challenges in efficient…

Federated learning (FL) is a general framework for learning across an axis of group partitioned data (heterogeneous clients) while preserving data privacy, under the orchestration of a central server. FL methods often compute gradients of…

Machine Learning · Computer Science 2024-11-26 Keith Rush , Zachary Charles , Zachary Garrett