English
Related papers

Related papers: Energy-Efficient Split Learning for Fine-Tuning La…

200 papers

Network slicing is a critical driver for guaranteeing the diverse service level agreements (SLA) in 5G and future networks. Inter-slice radio resource allocation (IS-RRA) in the radio access network (RAN) is very important. However, user…

Systems and Control · Electrical Eng. & Systems 2022-08-09 Heng Zhang , Guangjin Pan , Shugong Xu , Shunqing Zhang , Zhiyuan Jiang

Large language models (LLMs) such as GPTs and Mixtral-8x7B have revolutionized machine intelligence due to their exceptional abilities in generic ML tasks. Transiting LLMs from datacenters to edge devices brings benefits like better privacy…

Machine Learning · Computer Science 2025-03-10 Rongjie Yi , Liwei Guo , Shiyun Wei , Ao Zhou , Shangguang Wang , Mengwei Xu

Today's intelligent applications can achieve high performance accuracy using machine learning (ML) techniques, such as deep neural networks (DNNs). Traditionally, in a remote DNN inference problem, an edge device transmits raw data to a…

Machine Learning · Computer Science 2021-06-03 Mounssif Krouka , Anis Elgabli , Chaouki Ben Issaid , Mehdi Bennis

With the advent of Fifth Generation (5G) and Sixth Generation (6G) communication technologies, as well as the Internet of Things (IoT), semantic communication is gaining attention among researchers as current communication technologies are…

Networking and Internet Architecture · Computer Science 2024-07-31 Alakesh Kalita

In some applications, edge learning is experiencing a shift in focusing from conventional learning from scratch to new two-stage learning unifying pre-training and task-specific fine-tuning. This paper considers the problem of joint…

Information Theory · Computer Science 2024-04-02 Zhonghao Lyu , Yuchen Li , Guangxu Zhu , Jie Xu , H. Vincent Poor , Shuguang Cui

Large Language Models (LLMs) have demonstrated remarkable capabilities, leading to a significant increase in user demand for LLM services. However, cloud-based LLM services often suffer from high latency, unstable responsiveness, and…

Networking and Internet Architecture · Computer Science 2025-08-04 Jin Yang , Qiong Wu , Zhiying Feng , Zhi Zhou , Deke Guo , Xu Chen

Network slicing is a key technique in 5G and beyond for efficiently supporting diverse services. Many network slicing solutions rely on deep learning to manage complex and high-dimensional resource allocation problems. However, deep…

Networking and Internet Architecture · Computer Science 2024-01-23 Tianlun Hu , Qi Liao , Qiang Liu , Antonio Massaro , Georg Carle

In the last decade, data-driven algorithms outperformed traditional optimization-based algorithms in many research areas, such as computer vision, natural language processing, etc. However, extensive data usages bring a new challenge or…

Machine Learning · Computer Science 2021-12-02 Shih-Chun Lin , Chia-Hung Lin

To enable large model (LM) based edge intelligent service provisioning, on-device fine-tuning with locally personalized data allows for continuous and privacy-preserving LM customization. In this paper, we propose RingAda, a collaborative…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-28 Liang Li , Xiaopei Chen , Wen Wu

The increasing demand for intelligent mobile applications has made multi-agent collaboration with Transformer-based large language models (LLMs) essential in mobile edge computing (MEC) networks. However, training LLMs in such environments…

Systems and Control · Electrical Eng. & Systems 2025-09-25 Jiewei Chen , Xiumei Deng , Zehui Xiong , Shaoyong Guo , Xuesong Qiu , Ping Wang , Dusit Niyato

Large language models (LLMs) require substantial computational resources, leading to significant carbon emissions and operational costs. Although training is energy-intensive, the long-term environmental burden arises from inference,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-05 Kolichala Rajashekar , Nafiseh Sharghivand , Radu Prodan , Reza Farahani

Large language models (LLMs) have emerged as a powerful foundation for intelligent reasoning and decision-making, demonstrating substantial impact across a wide range of domains and applications. However, their massive parameter scales and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-29 Mingyu Sun , Xiao Zhang , Shen Qu , Yan Li , Mengbai Xiao , Yuan Yuan , Dongxiao Yu

Large Language Models (LLMs) have achieved remarkable success across diverse applications, yet their deployment remains challenging due to substantial computational costs, memory requirements, and energy consumption. Recent empirical…

Machine Learning · Computer Science 2026-03-24 Kaito Tanaka , Masato Ito , Yuji Nishimura , Keisuke Matsuda , Aya Nakayama

This work investigates the energy-efficient resource allocation for layered-division multiplexing (LDM) based non-orthogonal multicast and unicast transmission in cell-free massive multiple-input multiple-output (MIMO) systems, where each…

Information Theory · Computer Science 2020-07-21 Fangqing Tan , Peiran Wu , Yik-Chung Wu , Minghua Xia

Owing to the huge success of generative artificial intelligence (AI), large language models (LLMs) have emerged as a core subclass, underpinning applications such as question answering, text generation, and code completion. While…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-03 Yong-Cheng Liaw , Shuo-Han Chen

Advanced Large Language Models (LLMs) have revolutionized various fields, including communication networks, sparking an innovation wave that has led to new applications and services, and significantly enhanced solution schemes. Despite all…

Performance · Computer Science 2026-04-29 Nguyen Phuc Tran , Brigitte Jaumard , Oscar Delgado

Large Language Models (LLMs) have revolutionized many areas of artificial intelligence (AI), but their substantial resource requirements limit their deployment on mobile and edge devices. This survey paper provides a comprehensive overview…

Machine Learning · Computer Science 2025-09-03 Sanjay Surendranath Girija , Shashank Kapoor , Lakshit Arora , Dipen Pradhan , Aman Raj , Ankit Shetgaonkar

Large language models (LLMs) deployed on edge servers are increasingly used in latency-sensitive applications such as personalized assistants, recommendation, and content moderation. However, the non-stationary nature of user data…

Machine Learning · Computer Science 2025-10-07 Yufei Li , Yu Fu , Yue Dong , Cong Liu

Supernet training of LLMs is of great interest in industrial applications as it confers the ability to produce a palette of smaller models at constant cost, regardless of the number of models (of different size / latency) produced. We…

Machine Learning · Computer Science 2024-04-03 Achintya Kundu , Fabian Lim , Aaron Chew , Laura Wynter , Penny Chong , Rhui Dih Lee

The combination of Large Language Models (LLM) and Automatic Speech Recognition (ASR), when deployed on edge devices (called edge ASR-LLM), can serve as a powerful personalized assistant to enable audio-based interaction for users. Compared…