English
Related papers

Related papers: Communication-Efficient Federated Learning through…

200 papers

Federated Learning (FL) is a privacy-protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity…

Machine Learning · Computer Science 2021-08-20 Zirui Zhu , Ziyi Ye

Data heterogeneity presents significant challenges for federated learning (FL). Recently, dataset distillation techniques have been introduced, and performed at the client level, to attempt to mitigate some of these challenges. In this…

Machine Learning · Computer Science 2023-12-05 Yuqi Jia , Saeed Vahidian , Jingwei Sun , Jianyi Zhang , Vyacheslav Kungurtsev , Neil Zhenqiang Gong , Yiran Chen

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez

Federated Learning (FL) is a collaborative machine learning framework that allows multiple users to train models utilizing their local data in a distributed manner. However, considerable statistical heterogeneity in local data across…

Machine Learning · Computer Science 2024-09-10 Qi Le , Enmao Diao , Xinran Wang , Vahid Tarokh , Jie Ding , Ali Anwar

Reducing communication overhead in federated learning (FL) is challenging but crucial for large-scale distributed privacy-preserving machine learning. While methods utilizing sparsification or others can largely lower the communication…

Machine Learning · Computer Science 2023-03-21 Yuhao Zhou , Mingjia Shi , Yuanxi Li , Qing Ye , Yanan Sun , Jiancheng Lv

The success of current Large-Language Models (LLMs) hinges on extensive training data that is collected and stored centrally, called Centralized Learning (CL). However, such a collection manner poses a privacy threat, and one potential…

Machine Learning · Computer Science 2025-11-18 Huiwen Wu , Xiaogang Xu , Deyi Zhang , Xiaohan Li , Jiafei Wu , Zhe Liu

Federated Learning (FL) is an evolving distributed machine learning approach that safeguards client privacy by keeping data on edge devices. However, the variation in data among clients poses challenges in training models that excel across…

Machine Learning · Computer Science 2025-03-04 Yongxin Guo , Xiaoying Tang , Tao Lin

Federated learning (FL) enables distribution of machine learning workloads from the cloud to resource-limited edge devices. Unfortunately, current deep networks remain not only too compute-heavy for inference and training on edge devices,…

Machine Learning · Computer Science 2021-12-21 Sameer Bibikar , Haris Vikalo , Zhangyang Wang , Xiaohan Chen

With the advent of interconnected and sensor-equipped edge devices, Federated Learning (FL) has gained significant attention, enabling decentralized learning while maintaining data privacy. However, FL faces two challenges in real-world…

Machine Learning · Computer Science 2023-12-13 Manuel Röder , Leon Heller , Maximilian Münch , Frank-Michael Schleif

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative model training without sharing local data. Despite its advantages, FL suffers from substantial communication overhead, which can affect…

Machine Learning · Computer Science 2025-09-15 Shiwei Li , Qunwei Li , Haozhao Wang , Ruixuan Li , Jianbin Lin , Wenliang Zhong

Federated Learning (FL) enables model training across decentralized devices by communicating solely local model updates to an aggregation server. Although such limited data sharing makes FL more secure than centralized approached, FL…

Cryptography and Security · Computer Science 2024-06-14 Vasileios Tsouvalas , Samaneh Mohammadi , Ali Balador , Tanir Ozcelebi , Francesco Flammini , Nirvana Meratnia

On-device machine learning (ML) enables the training process to exploit a massive amount of user-generated private data samples. To enjoy this benefit, inter-device communication overhead should be minimized. With this end, we propose…

Machine Learning · Computer Science 2023-10-20 Eunjeong Jeong , Seungeun Oh , Hyesung Kim , Jihong Park , Mehdi Bennis , Seong-Lyun Kim

Federated Learning (FL) has emerged as a key approach for distributed machine learning, enhancing online personalization while ensuring user data privacy. Instead of sending private data to a central server as in traditional approaches, FL…

Information Retrieval · Computer Science 2023-09-19 Francesco Fabbri , Xianghang Liu , Jack R. McKenzie , Bartlomiej Twardowski , Tri Kurniawan Wijaya

Federated Learning (FL) is currently the most widely adopted framework for collaborative training of (deep) machine learning models under privacy constraints. Albeit it's popularity, it has been observed that Federated Learning yields…

Machine Learning · Computer Science 2019-10-07 Felix Sattler , Klaus-Robert Müller , Wojciech Samek

Personalized federated learning (FL) aims to train model(s) that can perform well for individual clients that are highly data and system heterogeneous. Most work in personalized FL, however, assumes using the same model architecture at all…

Machine Learning · Computer Science 2021-09-17 Yae Jee Cho , Jianyu Wang , Tarun Chiruvolu , Gauri Joshi

We address the prominent communication bottleneck in federated learning (FL). We specifically consider stochastic FL, in which models or compressed model updates are specified by distributions rather than deterministic parameters.…

Machine Learning · Computer Science 2025-02-04 Maximilian Egger , Rawad Bitar , Antonia Wachter-Zeh , Nir Weinberger , Deniz Gündüz

With the prevalence of Large Learning Models (LLM), Split Federated Learning (SFL), which divides a learning model into server-side and client-side models, has emerged as an appealing technology to deal with the heavy computational burden…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Yipeng Liang , Qimei Chen , Guangxu Zhu , Muhammad Kaleem Awan , Hao Jiang

Federated Learning (FL) enables large-scale distributed training of machine learning models, while still allowing individual nodes to maintain data locally. However, executing FL at scale comes with inherent practical challenges: 1)…

Machine Learning · Computer Science 2025-05-23 Hossein Zakerinia , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

Cross-device Federated Learning is an increasingly popular machine learning setting to train a model by leveraging a large population of client devices with high privacy and security guarantees. However, communication efficiency remains a…

Machine Learning · Computer Science 2022-07-27 Karthik Prasad , Sayan Ghosh , Graham Cormode , Ilya Mironov , Ashkan Yousefpour , Pierre Stock

Federated learning (FL) is a distributed learning paradigm that enables a large number of devices to collaboratively learn a model without sharing their raw data. Despite its practical efficiency and effectiveness, the iterative on-device…

Machine Learning · Computer Science 2020-12-16 Bing Luo , Xiang Li , Shiqiang Wang , Jianwei Huang , Leandros Tassiulas