English
Related papers

Related papers: Efficient Split Federated Learning for Large Langu…

200 papers

The development of artificial intelligence (AI) provides opportunities for the promotion of deep neural network (DNN)-based applications. However, the large amount of parameters and computational complexity of DNN makes it difficult to…

Machine Learning · Computer Science 2023-10-25 Ce Xu , Jinxuan Li , Yuan Liu , Yushi Ling , Miaowen Wen

Split Learning (SL) is a promising collaborative machine learning approach, enabling resource-constrained devices to train models without sharing raw data, while reducing computational load and preserving privacy simultaneously. However,…

Machine Learning · Computer Science 2024-11-22 Yunrui Sun , Gang Hu , Yinglei Teng , Dunbo Cai

Collaboratively fine-tuning (FT) large language models (LLMs) over heterogeneous mobile devices fosters immense potential applications of personalized intelligence. However, such a vision faces critical system challenges. Conventional…

Machine Learning · Computer Science 2025-08-12 Xingke Yang , Liang Li , Sicong Li , Liwei Guan , Hao Wang , Xiaoqi Qi , Jiang Liu , Xin Fu , Miao Pan

Despite their exceptional performance on various tasks after fine-tuning, pre-trained language models (PLMs) face significant challenges due to growing privacy concerns with data in centralized training methods. We consider federated…

Machine Learning · Computer Science 2024-05-28 Yuxuan Yan , Qianqian Yang , Shunpu Tang , Zhiguo Shi

Federated fine-tuning (FedFT) has been proposed to fine-tune the pre-trained language models in a distributed manner. However, there are two critical challenges for efficient FedFT in practical applications, i.e., resource constraints and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-31 Jun Liu , Yunming Liao , Hongli Xu , Yang Xu , Jianchun Liu , Chen Qian

Federated Learning (FL) has gained popularity for fine-tuning large language models (LLMs) across multiple nodes, each with its own private data. While LoRA has been widely adopted for parameter efficient federated fine-tuning, recent…

Machine Learning · Computer Science 2025-03-11 Navyansh Mahla , Sunny Gupta , Amit Sethi

We study few-shot Natural Language Understanding (NLU) tasks with Large Language Models (LLMs) in federated learning (FL) scenarios. It is a challenging task due to limited labeled data and communication capacities in FL, especially with…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-27 Jingang Jiang , Xiangyang Liu , Chenyou Fan

Large Language Models (LLM) and foundation models are popular as they offer new opportunities for individuals and businesses to improve natural language processing, interact with data, and retrieve information faster. However, training or…

Machine Learning · Computer Science 2024-05-03 Herbert Woisetschläger , Alexander Isenko , Shiqiang Wang , Ruben Mayer , Hans-Arno Jacobsen

As a paradigm of distributed machine learning, federated learning typically requires all edge devices to train a complete model locally. However, with the increasing scale of artificial intelligence models, the limited resources on edge…

Machine Learning · Computer Science 2024-12-11 Junhe Zhang , Wanli Ni , Dongyu Wang

Pre-trained Language Models (PLMs) have demonstrated their superiority and versatility in modern Natural Language Processing (NLP), effectively adapting to various downstream tasks through further fine-tuning. Federated Parameter-Efficient…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-19 Fei Wu , Jia Hu , Geyong Min , Shiqiang Wang

Hybrid Language Models (HLMs) combine the low-latency efficiency of Small Language Models (SLMs) on edge devices with the high accuracy of Large Language Models (LLMs) on centralized servers. Unlike traditional end-to-end LLM inference,…

Machine Learning · Computer Science 2025-07-02 Faranaksadat Solat , Joohyung Lee , Mohamed Seif , Dusit Niyato , H. Vincent Poor

Pre-trained large language models (LLMs) have become a cornerstone of modern natural language processing, with their capabilities extending across a wide range of applications and languages. However, the fine-tuning of multilingual LLMs,…

Computation and Language · Computer Science 2025-07-08 Wanru Zhao , Yihong Chen , Royson Lee , Xinchi Qiu , Yan Gao , Hongxiang Fan , Nicholas D. Lane

Large language models (LLMs) have not yet effectively leveraged the vast amounts of edge-device data, and federated learning (FL) offers a promising paradigm to collaboratively fine-tune LLMs without transferring private edge data to the…

Machine Learning · Computer Science 2026-02-02 Arian Raje , Baris Askin , Divyansh Jhunjhunwala , Gauri Joshi

Large language models (LLMs) are increasingly accessed as remotely hosted services by edge and enterprise clients that cannot run frontier models locally. Since models vary widely in capability and price, routing queries to models that…

Machine Learning · Computer Science 2026-02-02 Baris Askin , Shivam Patel , Anupam Nayak , Andrea Vigano , Jiin Woo , Gauri Joshi , Carlee Joe-Wong

As AI models expand in size, it has become increasingly challenging to deploy federated learning (FL) on resource-constrained edge devices. To tackle this issue, split federated learning (SFL) has emerged as an FL framework with reduced…

Machine Learning · Computer Science 2025-04-22 Zheng Lin , Wei Wei , Zhe Chen , Chan-Tong Lam , Xianhao Chen , Yue Gao , Jun Luo

Federated learning (FL) is a promising paradigm to enable collaborative model training with decentralized data. However, the training process of Large Language Models (LLMs) generally incurs the update of significant parameters, which…

Machine Learning · Computer Science 2024-02-13 Tianshi Che , Ji Liu , Yang Zhou , Jiaxiang Ren , Jiwen Zhou , Victor S. Sheng , Huaiyu Dai , Dejing Dou

The current paradigm of training large language models (LLMs) on public available Web data is becoming unsustainable as high-quality data sources in specialized domains near exhaustion. Federated Learning (FL) emerges as a practical…

Computation and Language · Computer Science 2026-03-26 Guochen Yan , Luyuan Xie , Qingni Shen , Yuejian Fang , Zhonghai Wu

Large language models (LLMs) have driven profound transformations in wireless networks. However, within wireless environments, the training of LLMs faces significant challenges related to security and privacy. Federated Learning (FL), with…

Machine Learning · Computer Science 2025-06-17 Feibo Jiang , Li Dong , Siwei Tu , Yubo Peng , Kezhi Wang , Kun Yang , Cunhua Pan , Dusit Niyato

Deploying foundation models (FMs) on uncrewed aerial vehicles (UAVs) promises broad ``low-altitude economy'' applications. Split federated learning (SFL)-based fine-tuning leverages distributed data while keeping raw data local and reduces…

Information Theory · Computer Science 2025-11-20 Zizhen Zhou , Ying-Chang Liang , Yanyu Cheng , Wei Yang Bryan Lim

Adapting large AI models (LAMs) to personalized edge data is challenging because wireless devices have limited memory, computation, and uplink capacity. Federated fine-tuning preserves data privacy but still requires each device to host the…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-26 Xianke Qiang , Zheng Chang , Li Wang , Ying-Chang Liang