English
Related papers

Related papers: ASFL: An Adaptive Model Splitting and Resource All…

200 papers

Split federated learning (SFL) has emerged as a promising paradigm to democratize machine learning (ML) on edge devices by enabling layer-wise model partitioning. However, existing SFL approaches suffer significantly from the straggler…

Machine Learning · Computer Science 2025-06-11 Zheng Lin , Zhe Chen , Xianhao Chen , Wei Ni , Yue Gao

Federated learning (FL) is usually performed on resource-constrained edge devices, e.g., with limited memory for the computation. If the required memory to train a model exceeds this limit, the device will be excluded from the training.…

Machine Learning · Computer Science 2023-11-28 Kilian Pfeiffer , Ramin Khalili , Jörg Henkel

Addressing the challenges of deploying large language models in wireless communication networks, this paper combines low-rank adaptation technology (LoRA) with the splitfed learning framework to propose the federated split learning for…

Networking and Internet Architecture · Computer Science 2024-07-15 Kai Zhao , Zhaohui Yang , Chongwen Huang , Xiaoming Chen , Zhaoyang Zhang

6G facilitates deployment of Federated Learning (FL) in the Space-Air-Ground Integrated Network (SAGIN), yet FL confronts challenges such as resource constrained and unbalanced data distribution. To address these issues, this paper proposes…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-06 Haitao Zhao , Xiaoyu Tang , Bo Xu , Jinlong Sun , Linghao Zhang

Federated learning (FL) is a promising distributed learning framework where distributed clients collaboratively train a machine learning model coordinated by a server. To tackle the stragglers issue in asynchronous FL, we consider that each…

Machine Learning · Computer Science 2023-11-29 Jiarong Yang , Yuan Liu , Fangjiong Chen , Wen Chen , Changle Li

Split learning (SL) is a collaborative learning framework, which can train an artificial intelligence (AI) model between a device and an edge server by splitting the AI model into a device-side model and a server-side model at a cut layer.…

Networking and Internet Architecture · Computer Science 2023-01-03 Wen Wu , Mushu Li , Kaige Qu , Conghao Zhou , Xuemin , Shen , Weihua Zhuang , Xu Li , Weisen Shi

Federated learning (FL) and split learning (SL) are state-of-the-art distributed machine learning techniques to enable machine learning training without accessing raw data on clients or end devices. However, their \emph{comparative training…

Machine Learning · Computer Science 2021-03-05 Yansong Gao , Minki Kim , Chandra Thapa , Sharif Abuadbba , Zhi Zhang , Seyit A. Camtepe , Hyoungshick Kim , Surya Nepal

Recent advances in distributed learning raise environmental concerns due to the large energy needed to train and move data to/from data centers. Novel paradigms, such as federated learning (FL), are suitable for decentralized model training…

Machine Learning · Computer Science 2021-11-15 Stefano Savazzi , Sanaz Kianoush , Vittorio Rampa , Mehdi Bennis

Federated learning (FL) is a promising technique that enables a large amount of edge computing devices to collaboratively train a global learning model. Due to privacy concerns, the raw data on devices could not be available for centralized…

Machine Learning · Computer Science 2020-11-24 Miao Yang , Akitanoshou Wong , Hongbin Zhu , Haifeng Wang , Hua Qian

In Federated Learning (FL), clients may have weak devices that cannot train the full model or even hold it in their memory space. To implement large-scale FL applications, thus, it is crucial to develop a distributed learning method that…

Machine Learning · Computer Science 2024-06-24 Sunwoo Lee , Tuo Zhang , Saurav Prakash , Yue Niu , Salman Avestimehr

Federated learning can train models without directly providing local data to the server. However, the frequent updating of the local model brings the problem of large communication overhead. Recently, scholars have achieved the…

Machine Learning · Computer Science 2024-05-07 Ying Zhuansun , Dandan Li , Xiaohong Huang , Caijun Sun

The emerging machine learning paradigm of decentralized federated learning (DFL) has the promise of greatly boosting the deployment of artificial intelligence (AI) by directly learning across distributed agents without centralized…

Machine Learning · Computer Science 2024-08-12 Yudi Huang , Tingyang Sun , Ting He

Federated learning (FL) can lead to significant communication overhead and reliance on a central server. To address these challenges, decentralized federated learning (DFL) has been proposed as a more resilient framework. DFL involves…

Machine Learning · Computer Science 2023-08-15 Zhigang Yan , Dong Li

Federated learning (FL) supports training models on geographically distributed devices. However, traditional FL systems adopt a centralized synchronous strategy, putting high communication pressure and model generalization challenge.…

Machine Learning · Computer Science 2021-11-17 Jing Cao , Zirui Lian , Weihong Liu , Zongwei Zhu , Cheng Ji

Split federated learning (SFL) is a recent distributed approach for collaborative model training among multiple clients. In SFL, a global model is typically split into two parts, where clients train one part in a parallel federated manner,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-10 Pengchao Han , Chao Huang , Geng Tian , Ming Tang , Xin Liu

Fine-tuning foundation models is critical for superior performance on personalized downstream tasks, compared to using pre-trained models. Collaborative learning can leverage local clients' datasets for fine-tuning, but limited client data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-15 Tianjun Yuan , Jiaxiang Geng , Pengchao Han , Xianhao Chen , Bing Luo

Federated Learning is a new learning scheme for collaborative training a shared prediction model while keeping data locally on participating devices. In this paper, we study a new model of multiple federated learning services at the…

Machine Learning · Computer Science 2020-12-01 Minh N. H. Nguyen , Nguyen H. Tran , Yan Kyaw Tun , Zhu Han , Choong Seon Hong

We advocate a new resource allocation framework, which we term resource rationing, for wireless federated learning (FL). Unlike existing resource allocation methods for FL, resource rationing focuses on balancing resources across learning…

Signal Processing · Electrical Eng. & Systems 2021-04-15 Cong Shen , Jie Xu , Sihui Zheng , Xiang Chen

Federated learning (FL) is an effective technique to directly involve edge devices in machine learning training while preserving client privacy. However, the substantial communication overhead of FL makes training challenging when edge…

Machine Learning · Computer Science 2022-12-06 Shiqi He , Qifan Yan , Feijie Wu , Lanjun Wang , Mathias Lécuyer , Ivan Beschastnikh

Although Federated Learning (FL) is promising to enable collaborative learning among Artificial Intelligence of Things (AIoT) devices, it suffers from the problem of low classification performance due to various heterogeneity factors (e.g.,…

Machine Learning · Computer Science 2024-04-10 Chentao Jia , Ming Hu , Zekai Chen , Yanxin Yang , Xiaofei Xie , Yang Liu , Mingsong Chen