English
Related papers

Related papers: Deploying Large AI Models on Resource-Limited Devi…

200 papers

With the prevalence of Large Learning Models (LLM), Split Federated Learning (SFL), which divides a learning model into server-side and client-side models, has emerged as an appealing technology to deal with the heavy computational burden…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Yipeng Liang , Qimei Chen , Guangxu Zhu , Muhammad Kaleem Awan , Hao Jiang

Split Learning (SL) recently emerged as an efficient paradigm for distributed Machine Learning (ML) suitable for the Internet Of Things (IoT)-Cloud systems. However, deploying SL on resource-constrained edge IoT platforms poses a…

Machine Learning · Computer Science 2025-02-14 Romina Soledad Molina , Vukan Ninkovic , Dejan Vukobratovic , Maria Liz Crespo , Marco Zennaro

Federated Learning (FL) trains machine learning models on edge devices with distributed data. However, the computational and memory limitations of these devices restrict the training of large models using FL. Split Federated Learning (SFL)…

Machine Learning · Computer Science 2025-04-02 Di Wu , Weibo He , Wanglei Feng , Zhenyu Wen , Bin Qian , Blesson Varghese

Nowadays, devices are equipped with advanced sensors with higher processing/computing capabilities. Further, widespread Internet availability enables communication among sensing devices. As a result, vast amounts of data are generated on…

Machine Learning · Computer Science 2020-02-26 Ahmed Imteaj , Urmish Thakker , Shiqiang Wang , Jian Li , M. Hadi Amini

The growing complexity of neural networks hinders the deployment of distributed machine learning on resource-constrained devices. Split learning (SL) offers a promising solution by partitioning the large model and offloading the primary…

Machine Learning · Computer Science 2026-04-09 Zehang Lin , Miao Yang , Haihan Zhu , Zheng Lin , Jianhao Huang , Jing Yang , Guangjin Pan , Dianxin Luan , Zihan Fang , Shunzhi Zhu , Wei Ni , John Thompson

Split Learning (SL) is a promising collaborative machine learning approach, enabling resource-constrained devices to train models without sharing raw data, while reducing computational load and preserving privacy simultaneously. However,…

Machine Learning · Computer Science 2024-11-22 Yunrui Sun , Gang Hu , Yinglei Teng , Dunbo Cai

Large Language Models (LLM) and foundation models are popular as they offer new opportunities for individuals and businesses to improve natural language processing, interact with data, and retrieve information faster. However, training or…

Machine Learning · Computer Science 2024-05-03 Herbert Woisetschläger , Alexander Isenko , Shiqiang Wang , Ruben Mayer , Hans-Arno Jacobsen

Nowadays, AI companies improve service quality by aggressively collecting users' data generated by edge devices, which jeopardizes data privacy. To prevent this, Federated Learning is proposed as a private learning scheme, using which users…

Machine Learning · Computer Science 2022-10-06 Jingtao Li , Runcong Kuang

In recent years, Large Language Models (LLMs) through Transformer structures have dominated many machine learning tasks, especially text processing. However, these models require massive amounts of data for training and induce high resource…

Machine Learning · Computer Science 2025-04-17 Kilian Pfeiffer , Mohamed Aboelenien Ahmed , Ramin Khalili , Jörg Henkel

Federated learning (FL) enables edge nodes to collaboratively contribute to constructing a global model without sharing their data. This is accomplished by devices computing local, private model updates that are then aggregated by a server.…

Machine Learning · Computer Science 2024-06-13 Sadi Alawadi , Addi Ait-Mlouk , Salman Toor , Andreas Hellander

As a paradigm of distributed machine learning, federated learning typically requires all edge devices to train a complete model locally. However, with the increasing scale of artificial intelligence models, the limited resources on edge…

Machine Learning · Computer Science 2024-12-11 Junhe Zhang , Wanli Ni , Dongyu Wang

Federated Learning (FL) presents a paradigm shift towards distributed model training across isolated data repositories or edge devices without explicit data sharing. Despite of its advantages, FL is inherently less efficient than…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 M S Chaitanya Kumar , Sai Satya Narayana J , Yunkai Bao , Xin Wang , Steve Drew

The increasing complexity of deep neural networks poses significant barriers to democratizing them to resource-limited edge devices. To address this challenge, split federated learning (SFL) has emerged as a promising solution by of…

Machine Learning · Computer Science 2025-06-05 Zheng Lin , Guanqiao Qu , Wei Wei , Xianhao Chen , Kin K. Leung

The rapid expansion of IoT ecosystems introduces severe challenges in scalability, security, and real-time decision-making. Traditional centralized architectures struggle with latency, privacy concerns, and excessive resource consumption,…

Machine Learning · Computer Science 2025-05-14 Yazan Otoum , Arghavan Asad , Amiya Nayak

Large language models (LLMs) have achieved near-human performance across diverse reasoning tasks, yet their deployment on resource-constrained Internet-of-Things (IoT) devices remains impractical due to massive parameter footprints and…

Machine Learning · Computer Science 2025-11-07 Mingyu Sung , Vikas Palakonda , Suhwan Im , Sunghwan Moon , Il-Min Kim , Sangseok Yun , Jae-Mo Kang

Large Foundation Models (LFMs), including multi-modal and generative models, promise to unlock new capabilities for next-generation Edge AI applications. However, performing inference with LFMs in resource-constrained and heterogeneous edge…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-12 Fernando Koch , Aladin Djuhera , Alecio Binotto

Pre-trained foundation models (FMs), with extensive number of neurons, are key to advancing next-generation intelligence services, where personalizing these models requires massive amount of task-specific data and computational resources.…

Systems and Control · Electrical Eng. & Systems 2024-07-04 Zixin Wang , Yong Zhou , Yuanming Shi , Khaled. B. Letaief

The advent of the Transformer architecture has propelled the growth of natural language processing (NLP) models, leading to remarkable achievements in numerous NLP tasks. Yet, the absence of specialized hardware like expansive GPU memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-18 Xiaofeng Wu , Jia Rao , Wei Chen

Artificial intelligence (AI) has demonstrated considerable potential in the realm of medical imaging. However, the development of high-performance AI models typically necessitates training on large-scale, centralized datasets. This approach…

Cryptography and Security · Computer Science 2025-08-29 Mengyu Sun , Ziyuan Yang , Yongqiang Huang , Hui Yu , Yingyu Chen , Shuren Qi , Andrew Beng Jin Teoh , Yi Zhang

Federated learning (FL) provides a privacy-preserving solution for fine-tuning pre-trained large language models (LLMs) using distributed private datasets, enabling task-specific adaptation while preserving data privacy. However,…

Machine Learning · Computer Science 2025-01-09 Na Yan , Yang Su , Yansha Deng , Robert Schober