English
Related papers

Related papers: Federated Split Learning with Model Pruning and Gr…

200 papers

Federated learning (FL) and split learning (SL) are state-of-the-art distributed machine learning techniques to enable machine learning training without accessing raw data on clients or end devices. However, their \emph{comparative training…

Machine Learning · Computer Science 2021-03-05 Yansong Gao , Minki Kim , Chandra Thapa , Sharif Abuadbba , Zhi Zhang , Seyit A. Camtepe , Hyoungshick Kim , Surya Nepal

In this letter, we propose an energy-efficient split learning (SL) framework for fine-tuning large language models (LLMs) using geo-distributed personal data at the network edge, where LLMs are split and alternately across massive mobile…

Machine Learning · Computer Science 2025-01-15 Zuguang Li , Shaohua Wu , Liang Li , Songge Zhang

Federated Split Learning has been identified as an efficient approach to address the computational resource constraints of clients in classical federated learning, while guaranteeing data privacy for distributed model training across data…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-30 Yimeng Shan , Zhaorui Zhang , Sheng Di , Yu Liu , Xiaoyi Lu , Benben Liu

Despite achieving remarkable performance, Federated Learning (FL) suffers from two critical challenges, i.e., limited computational resources and low training efficiency. In this paper, we propose a novel FL framework, i.e., FedDUAP, with…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-26 Hong Zhang , Ji Liu , Juncheng Jia , Yang Zhou , Huaiyu Dai , Dejing Dou

Federated learning (FL) is recognized as a key enabling technology to support distributed artificial intelligence (AI) services in future 6G. By supporting decentralized data training and collaborative model training among devices, FL…

Signal Processing · Electrical Eng. & Systems 2021-11-02 Shaoming Huang , Pengfei Zhang , Yijie Mao , Lixiang Lian , Yuanming Shi

Split learning (SL) is an emergent distributed learning framework which can mitigate the computation and wireless communication overhead of federated learning. It splits a machine learning model into a device-side model and a server-side…

Computer Science and Game Theory · Computer Science 2022-12-13 Minsu Kim , Alexander DeRieux , Walid Saad

Federated Learning (FL) is a novel distributed machine learning which allows thousands of edge devices to train model locally without uploading data concentrically to the server. But since real federated settings are resource-constrained,…

Machine Learning · Computer Science 2024-04-16 Li Li , Moming Duan , Duo Liu , Yu Zhang , Ao Ren , Xianzhang Chen , Yujuan Tan , Chengliang Wang

Federated learning is a machine learning approach that enables multiple devices (i.e., agents) to train a shared model cooperatively without exchanging raw data. This technique keeps data localized on user devices, ensuring privacy and…

Machine Learning · Computer Science 2025-07-16 Dimitrios Kritsiolis , Constantine Kotropoulos

We demonstrate that merely analog transmissions and match filtering can realize the function of an edge server in federated learning (FL). Therefore, a network with massively distributed user equipments (UEs) can achieve large-scale FL…

Information Theory · Computer Science 2022-04-19 Howard H. Yang , Zihan Chen , Tony Q. S. Quek

Federated learning enables collaborative model training without sharing raw data, but its performance can degrade substantially under heterogeneous client data distributions. A single global model often cannot satisfy diverse client…

Machine Learning · Computer Science 2026-05-27 Yunseok Kang , Jaeyoung Song

Fine-tuning a large language model (LLM) using the local data of edge users can enable personalized services and applications. For privacy protection, the prevalent solution adopts distributed learning for fine-tuning and integrates…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-24 Songge Zhang , Guoliang Cheng , Zuguang Li , Wen Wu

Federated Learning (FL), an emerging paradigm for fast intelligent acquisition at the network edge, enables joint training of a machine learning model over distributed data sets and computing resources with limited disclosure of local data.…

Information Theory · Computer Science 2020-03-02 Hong Xing , Osvaldo Simeone , Suzhi Bi

Emerging technologies and applications including Internet of Things (IoT), social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-19 Shiqiang Wang , Tiffany Tuor , Theodoros Salonidis , Kin K. Leung , Christian Makaya , Ting He , Kevin Chan

Split learning (SL) is a distributed learning paradigm that can enable computation-intensive artificial intelligence (AI) applications by partitioning AI models between mobile devices and edge servers. %fully utilizing distributed computing…

Machine Learning · Computer Science 2026-04-15 Zuguang Li , Wen Wu , Shaohua Wu , Xuemin , Shen

Federated Learning (FL) trains machine learning models on edge devices with distributed data. However, the computational and memory limitations of these devices restrict the training of large models using FL. Split Federated Learning (SFL)…

Machine Learning · Computer Science 2025-04-02 Di Wu , Weibo He , Wanglei Feng , Zhenyu Wen , Bin Qian , Blesson Varghese

A Federated Learning (FL) system collaboratively trains neural networks across devices and a server but is limited by significant on-device computation costs. Split Federated Learning (SFL) systems mitigate this by offloading a block of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-11 Zihan Zhang , Leon Wong , Blesson Varghese

The deployment of federated learning in a wireless network, called federated edge learning (FEEL), exploits low-latency access to distributed mobile data to efficiently train an AI model while preserving data privacy. In this work, we study…

Information Theory · Computer Science 2021-03-11 Zhenyi Lin , Xiaoyang Li , Vincent K. N. Lau , Yi Gong , Kaibin Huang

The prevalent communication efficient federated learning (FL) frameworks usually take advantages of model gradient compression or model distillation. However, the unbalanced local data distributions (either in quantity or quality) of…

Machine Learning · Computer Science 2023-01-31 Beibei Li , Zerui Shao , Ao Liu , Peiran Wang

We are interested in developing a unified machine learning model over many mobile devices for practical learning tasks, where each device only has very few training data. This is a commonly encountered situation in mobile computing…

Machine Learning · Computer Science 2021-04-02 Chenyou Fan , Jianwei Huang

Personalized Federated Learning (PFL) is widely employed in IoT applications to handle high-volume, non-iid client data while ensuring data privacy. However, heterogeneous edge devices owned by clients may impose varying degrees of resource…

Machine Learning · Computer Science 2025-04-15 Ziru Niu , Hai Dong , A. K. Qin