English
Related papers

Related papers: Deploying Large AI Models on Resource-Limited Devi…

200 papers

The traditional framework of federated learning (FL) requires each client to re-train their models in every iteration, making it infeasible for resource-constrained mobile devices to train deep-learning (DL) models. Split learning (SL)…

Machine Learning · Computer Science 2023-03-21 Manas Wadhwa , Gagan Raj Gupta , Ashutosh Sahu , Rahul Saini , Vidhi Mittal

Federated fine-tuning offers a promising approach for tuning Large Language Models (LLMs) on edge devices while preserving data privacy. However, fine-tuning these models on edge devices remains challenging due to high memory,…

Machine Learning · Computer Science 2025-12-19 Mohamed Aboelenien Ahmed , Kilian Pfeiffer , Ramin Khalili , Heba Khdr , Jörg Henkel

Robust machine learning (ML) models can be developed by leveraging large volumes of data and distributing the computational tasks across numerous devices or servers. Federated learning (FL) is a technique in the realm of ML that facilitates…

Large models (LMs) have immense potential in Internet of Things (IoT) systems, enabling applications such as intelligent voice assistants, predictive maintenance, and healthcare monitoring. However, training LMs on edge servers raises data…

Machine Learning · Computer Science 2025-01-30 Zuguang Li , Wen Wu , Shaohua Wu , Qiaohua Lin , Yaping Sun , Hui Wang

As the number of sensors becomes massive in Internet of Things (IoT) networks, the amount of data is humongous. To process data in real-time while protecting user privacy, federated learning (FL) has been regarded as an enabling technique…

Information Theory · Computer Science 2023-10-05 Jianyang Ren , Wanli Ni , Hui Tian , Gaofeng Nie

As AI models expand in size, it has become increasingly challenging to deploy federated learning (FL) on resource-constrained edge devices. To tackle this issue, split federated learning (SFL) has emerged as an FL framework with reduced…

Machine Learning · Computer Science 2025-04-22 Zheng Lin , Wei Wei , Zhe Chen , Chan-Tong Lam , Xianhao Chen , Yue Gao , Jun Luo

Federated learning (FL) enables multiple clients to collaboratively train a machine learning model without sharing their raw data. However, the limited computation resources of the clients may result in a high delay and energy consumption…

Machine Learning · Computer Science 2026-03-06 Chuiyang Meng , Ming Tang , Vincent W. S. Wong

Adapting large AI models (LAMs) to personalized edge data is challenging because wireless devices have limited memory, computation, and uplink capacity. Federated fine-tuning preserves data privacy but still requires each device to host the…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-26 Xianke Qiang , Zheng Chang , Li Wang , Ying-Chang Liang

Deploying Large Language Models (LLMs) on edge devices presents significant challenges due to computational constraints, memory limitations, inference speed, and energy consumption. Model quantization has emerged as a key technique to…

In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with…

Machine Learning · Computer Science 2020-04-07 Muhammad Asad , Ahmed Moustafa , Takayuki Ito , Muhammad Aslam

Large Language Models (LLMs) are transforming the landscape of mobile intelligence. Federated Learning (FL), a method to preserve user data privacy, is often employed in fine-tuning LLMs to downstream mobile tasks, an approach known as…

Artificial Intelligence · Computer Science 2024-01-23 Mengwei Xu , Dongqi Cai , Yaozong Wu , Xiang Li , Shangguang Wang

Federated Learning (FL) has emerged as a promising paradigm for enabling collaborative machine learning while preserving data privacy, making it particularly suitable for Internet of Things (IoT) environments. However, resource-constrained…

Machine Learning · Computer Science 2025-09-17 Wilfrid Sougrinoma Compaoré , Yaya Etiabi , El Mehdi Amhoud , Mohamad Assaad

In this paper, we propose a novel distributed learning scheme, named group-based split federated learning (GSFL), to speed up artificial intelligence (AI) model training. Specifically, the GSFL operates in a split-then-federated manner,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-31 Songge Zhang , Wen Wu , Penghui Hu , Shaofeng Li , Ning Zhang

The explosive growth of smart devices (e.g., mobile phones, vehicles, drones) with sensing, communication, and computation capabilities gives rise to an unprecedented amount of data. The generated massive data together with the rapid…

Networking and Internet Architecture · Computer Science 2023-10-10 Yong Zhou , Yuanming Shi , Haibo Zhou , Jingjing Wang , Liqun Fu , Yang Yang

Fine-tuning unlocks large language models (LLMs) for specialized applications, but its high computational cost often puts it out of reach for resource-constrained organizations. While cloud platforms could provide the needed resources, data…

Cryptography and Security · Computer Science 2026-04-28 Zihan Liu , Yizhen Wang , Rui Wang , Xiu Tang , Sai Wu

Recent advances in distributed learning raise environmental concerns due to the large energy needed to train and move data to/from data centers. Novel paradigms, such as federated learning (FL), are suitable for decentralized model training…

Machine Learning · Computer Science 2021-11-15 Stefano Savazzi , Sanaz Kianoush , Vittorio Rampa , Mehdi Bennis

Federated Learning (FL) has emerged as a solution for distributed model training across decentralized, privacy-preserving devices, but the different energy capacities of participating devices (system heterogeneity) constrain real-world…

Machine Learning · Computer Science 2025-10-28 Roberto Pereira , Cristian J. Vaca-Rubio , Luis Blanco

Deploying Large Language Models (LLMs) on edge devices enhances privacy but faces performance hurdles due to limited resources. We introduce a systematic methodology to evaluate on-device LLMs, balancing capability, efficiency, and resource…

As a promising paradigm federated Learning (FL) is widely used in privacy-preserving machine learning, which allows distributed devices to collaboratively train a model while avoiding data transmission among clients. Despite its immense…

Machine Learning · Computer Science 2023-08-29 Jinglong Shen , Xiucheng Wang , Nan Cheng , Longfei Ma , Conghao Zhou , Yuan Zhang

Federated learning (FL) and split learning (SL) are state-of-the-art distributed machine learning techniques to enable machine learning training without accessing raw data on clients or end devices. However, their \emph{comparative training…

Machine Learning · Computer Science 2021-03-05 Yansong Gao , Minki Kim , Chandra Thapa , Sharif Abuadbba , Zhi Zhang , Seyit A. Camtepe , Hyoungshick Kim , Surya Nepal