English
Related papers

Related papers: EcoFed: Efficient Communication for DNN Partitioni…

200 papers

With the prevalence of Large Learning Models (LLM), Split Federated Learning (SFL), which divides a learning model into server-side and client-side models, has emerged as an appealing technology to deal with the heavy computational burden…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Yipeng Liang , Qimei Chen , Guangxu Zhu , Muhammad Kaleem Awan , Hao Jiang

Federated learning (FL) is a promising and powerful approach for training deep learning models without sharing the raw data of clients. During the training process of FL, the central server and distributed clients need to exchange a vast…

Machine Learning · Computer Science 2021-04-27 Zhefeng Qiao , Xianghao Yu , Jun Zhang , Khaled B. Letaief

Federated learning (FL) is a distributed machine learning paradigm that enables multiple clients to train a shared model collaboratively while preserving privacy. However, the scaling of real-world FL systems is often limited by two…

Machine Learning · Computer Science 2024-12-31 Xinyi Hu

Federated learning (FL) and federated distillation (FD) are distributed learning paradigms that train UE models with enhanced privacy, each offering different trade-offs between noise robustness and learning speed. To mitigate their…

Machine Learning · Computer Science 2026-01-09 Yongjun Kim , Hyeongjun Park , Hwanjin Kim , Junil Choi

Federated learning (FL) has been gaining attention for its ability to share knowledge while maintaining user data, protecting privacy, increasing learning efficiency, and reducing communication overhead. Decentralized FL (DFL) is a…

Machine Learning · Computer Science 2024-05-07 Liangqi Yuan , Ziran Wang , Lichao Sun , Philip S. Yu , Christopher G. Brinton

Distributed Deep Neural Network (DNN) training is a technique to reduce the training overhead by distributing the training tasks into multiple accelerators, according to a parallelization strategy. However, high-performance compute and…

Hardware Architecture · Computer Science 2025-06-10 Saeed Rashidi , William Won , Sudarshan Srinivasan , Puneet Gupta , Tushar Krishna

Federated Learning (FL) enables decentralized model training across multiple clients while optionally preserving data privacy. However, communication efficiency remains a critical bottleneck, particularly for large-scale models. In this…

Machine Learning · Computer Science 2025-11-11 Arnaud Descours , Léonard Deroose , Jan Ramon

In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with…

Machine Learning · Computer Science 2020-04-07 Muhammad Asad , Ahmed Moustafa , Takayuki Ito , Muhammad Aslam

Federated learning (FL) is a key enabler for efficient communication and computing, leveraging devices' distributed computing capabilities. However, applying FL in practice is challenging due to the local devices' heterogeneous energy,…

Machine Learning · Computer Science 2022-12-23 Won Joon Yun , Yunseok Kwak , Hankyul Baek , Soyi Jung , Mingyue Ji , Mehdi Bennis , Jihong Park , Joongheon Kim

This study develops a federated learning (FL) framework overcoming largely incremental communication costs due to model sizes in typical frameworks without compromising model performance. To this end, based on the idea of leveraging an…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-07 Sohei Itahara , Takayuki Nishio , Yusuke Koda , Masahiro Morikura , Koji Yamamoto

Federated learning (FL) is a popular technique for distributing machine learning (ML) across a set of edge devices. In this paper, we study fully decentralized FL, where in addition to devices conducting training locally, they carry out…

Machine Learning · Computer Science 2025-11-20 Shahryar Zehtabi , Seyyedali Hosseinalipour , Christopher G. Brinton

To address data locality and privacy restrictions, Federated Learning (FL) has recently been adopted to fine-tune large language models (LLMs), enabling improved performance on various downstream tasks without requiring aggregated data.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-11 Han Liu , Ruoyao Wen , Srijith Nair , Jia Liu , Wenjing Lou , Chongjie Zhang , William Yeoh , Yevgeniy Vorobeychik , Ning Zhang

Federated Learning (FL) has emerged as a new paradigm for training machine learning models distributively without sacrificing data security and privacy. Learning models on edge devices such as mobile phones is one of the most common use…

Machine Learning · Computer Science 2023-02-10 Sixing Yu , Phuong Nguyen , Ali Anwar , Ali Jannesari

Unmanned aerial vehicles (UAV) or drones play many roles in a modern smart city such as the delivery of goods, mapping real-time road traffic and monitoring pollution. The ability of drones to perform these functions often requires the…

Machine Learning · Computer Science 2023-04-14 Deng Pan , Mohammad Ali Khoshkholghi , Toktam Mahmoodi

Recent advances in distributed learning raise environmental concerns due to the large energy needed to train and move data to/from data centers. Novel paradigms, such as federated learning (FL), are suitable for decentralized model training…

Machine Learning · Computer Science 2021-11-15 Stefano Savazzi , Sanaz Kianoush , Vittorio Rampa , Mehdi Bennis

Federated Learning (FL) plays a critical role in distributed systems. In these systems, data privacy and confidentiality hold paramount importance, particularly within edge-based data processing systems such as IoT devices deployed in smart…

Machine Learning · Computer Science 2024-03-08 Humaid Ahmed Desai , Amr Hilal , Hoda Eldardiry

Communication constraints are one of the major challenges preventing the wide-spread adoption of Federated Learning systems. Recently, Federated Distillation (FD), a new algorithmic paradigm for Federated Learning with fundamentally…

Machine Learning · Computer Science 2020-12-02 Felix Sattler , Arturo Marban , Roman Rischke , Wojciech Samek

Federated learning (FL) has been recognized as a viable solution for local-privacy-aware collaborative model training in wireless edge networks, but its practical deployment is hindered by the high communication overhead caused by frequent…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-22 Shuai Wang , Yanqing Xu , Chaoqun You , Mingjie Shao , Tony Q. S. Quek

The widespread adoption of smartphones and smart wearable devices has led to the widespread use of Centralized Federated Learning (CFL) for training powerful machine learning models while preserving data privacy. However, CFL faces…

Machine Learning · Computer Science 2025-03-18 Chengyan Jiang , Jiamin Fan , Talal Halabi , Israat Haque

Federated learning (FL) is a machine learning paradigm that targets model training without gathering the local data dispersed over various data sources. Standard FL, which employs a single server, can only support a limited number of users,…

Machine Learning · Computer Science 2024-02-29 Bin Wang , Jun Fang , Hongbin Li , Yonina C. Eldar