English
Related papers

Related papers: Energy-Efficient Split Learning for Fine-Tuning La…

200 papers

Fine-tuning a large language model (LLM) using the local data of edge users can enable personalized services and applications. For privacy protection, the prevalent solution adopts distributed learning for fine-tuning and integrates…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-24 Songge Zhang , Guoliang Cheng , Zuguang Li , Wen Wu

Fine-tuning is the process of adapting the pre-trained large language models (LLMs) for downstream tasks. Due to substantial parameters, fine-tuning LLMs on mobile devices demands considerable memory resources, and suffers from high…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-17 Songge Zhang , Guoliang Cheng , Xinyu Huang , Zuguang Li , Wen Wu , Lingyang Song , Xuemin Shen

In this paper, we propose an edge-assisted split federated learning framework to facilitate large language model (LLM) fine-tuning on heterogeneous mobile devices while alleviating memory pressures on both mobile devices and the edge…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-04 Xiaopei Chen , Liang Li , Fei Ji , Wen Wu

Split learning (SL) is a promising approach for training artificial intelligence (AI) models, in which devices collaborate with a server to train an AI model in a distributed manner, based on a same fixed split point. However, due to the…

Machine Learning · Computer Science 2025-03-14 Zuguang Li , Wen Wu , Shaohua Wu , Wei Wang

Fine-tuning large language models (LLMs) on private, on-device data can empower tailored personalized AI agents. However, fine-tuning LLMs on resource-constrained edge devices faces significant challenges, including excessive computation…

Machine Learning · Computer Science 2025-03-26 Jian Ma , Xinchen Lyu , Jun Jiang , Qimei Cui , Haipeng Yao , Xiaofeng Tao

The increasingly deeper neural networks hinder the democratization of privacy-enhancing distributed learning, such as federated learning (FL), to resource-constrained devices. To overcome this challenge, in this paper, we advocate the…

Machine Learning · Computer Science 2024-01-25 Zheng Lin , Guangyu Zhu , Yiqin Deng , Xianhao Chen , Yue Gao , Kaibin Huang , Yuguang Fang

Fine-tuning pre-trained large language models (LLMs) in a distributed manner poses significant challenges on resource-constrained edge networks. To address this challenge, we propose SflLLM, a novel framework that integrates split federated…

Machine Learning · Computer Science 2025-07-03 Kai Zhao , Zhaohui Yang , Ye Hu , Mingzhe Chen , Chen Zhu , Zhaoyang Zhang

Smart farming systems encounter significant challenges, including limited resources, the need for data privacy, and poor connectivity in rural areas. To address these issues, we present eEnergy-Split, an energy-efficient framework that…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Keiwan Soltani , Vishesh Kumar Tanwar , Ashish Gupta , Sajal K. Das

Large language models (LLMs) have transformed natural language processing but face critical deployment challenges in device-edge systems due to resource limitations and communication overhead. To address these issues, collaborative…

Signal Processing · Electrical Eng. & Systems 2025-07-18 Jiahong Ning , Ce Zheng , Tingting Yang

Training large language models (LLMs) at the network edge faces fundamental challenges arising from device resource constraints, severe data heterogeneity, and heightened privacy risks. To address these challenges, we propose ELSA…

Machine Learning · Computer Science 2026-03-10 Xiaohong Yang , Tong Xie , Minghui Liwang , Chikai Shang , Yang Lu , Zhenzhen Jiao , Liqun Fu , Seyyedali Hosseinalipour

Split learning (SL) is a distributed learning paradigm that can enable computation-intensive artificial intelligence (AI) applications by partitioning AI models between mobile devices and edge servers. %fully utilizing distributed computing…

Machine Learning · Computer Science 2026-04-15 Zuguang Li , Wen Wu , Shaohua Wu , Xuemin , Shen

Split Learning (SL) recently emerged as an efficient paradigm for distributed Machine Learning (ML) suitable for the Internet Of Things (IoT)-Cloud systems. However, deploying SL on resource-constrained edge IoT platforms poses a…

Machine Learning · Computer Science 2025-02-14 Romina Soledad Molina , Vukan Ninkovic , Dejan Vukobratovic , Maria Liz Crespo , Marco Zennaro

As mobile devices increasingly become focal points for advanced applications, edge computing presents a viable solution to their inherent computational limitations, particularly in deploying large language models (LLMs). However, despite…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-01 Chang Liu , Jun Zhao

Split learning (SL) is a collaborative learning framework, which can train an artificial intelligence (AI) model between a device and an edge server by splitting the AI model into a device-side model and a server-side model at a cut layer.…

Networking and Internet Architecture · Computer Science 2023-01-03 Wen Wu , Mushu Li , Kaige Qu , Conghao Zhou , Xuemin , Shen , Weihua Zhuang , Xu Li , Weisen Shi

Split learning (SL) is an emergent distributed learning framework which can mitigate the computation and wireless communication overhead of federated learning. It splits a machine learning model into a device-side model and a server-side…

Computer Science and Game Theory · Computer Science 2022-12-13 Minsu Kim , Alexander DeRieux , Walid Saad

Optimizing the deployment of large language models (LLMs) in edge computing environments is critical for enhancing privacy and computational efficiency. Toward efficient wireless LLM inference in edge computing, this study comprehensively…

Machine Learning · Computer Science 2024-09-12 Yuxuan Chen , Rongpeng Li , Xiaoxue Yu , Zhifeng Zhao , Honggang Zhang

Large Artificial Intelligence Models (LAMs) powered by massive datasets, extensive parameter scales, and extensive computational resources, leading to significant transformations across various industries. Yet, their practical deployment on…

Machine Learning · Computer Science 2026-04-22 Xianke Qiang , Hongda Liu , Xinran Zhang , Zheng Chang , Ying-Chang Liang

To enable the pre-trained models to be fine-tuned with local data on edge devices without sharing data with the cloud, we design an efficient split fine-tuning (SFT) framework for edge and cloud collaborative learning. We propose three…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-01 Shaohuai Shi , Qing Yang , Yang Xiang , Shuhan Qi , Xuan Wang

Large language models (LLMs) have shown great potential in natural language processing and content generation. However, current LLMs heavily rely on cloud computing, leading to prolonged latency, high bandwidth cost, and privacy concerns.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-24 Mingjin Zhang , Jiannong Cao , Xiaoming Shen , Zeyang Cui

Addressing the challenges of deploying large language models in wireless communication networks, this paper combines low-rank adaptation technology (LoRA) with the splitfed learning framework to propose the federated split learning for…

Networking and Internet Architecture · Computer Science 2024-07-15 Kai Zhao , Zhaohui Yang , Chongwen Huang , Xiaoming Chen , Zhaoyang Zhang
‹ Prev 1 2 3 10 Next ›