English
Related papers

Related papers: Edge Large AI Models: Collaborative Deployment and…

200 papers

Large language models (LLMs), which have shown remarkable capabilities, are revolutionizing AI development and potentially shaping our future. However, given their multimodality, the status quo cloud-based deployment faces some critical…

Machine Learning · Computer Science 2025-06-05 Zheng Lin , Guanqiao Qu , Qiyuan Chen , Xianhao Chen , Zhe Chen , Kaibin Huang

Large language models (LLMs) have advanced rapidly, emerging as versatile tools across fields thanks to their exceptional language understanding, generation, and reasoning capabilities. However, performing LLM inference at the network edge…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-28 Zhixiong Chen , Bingjie Zhu , Jiangzhou Wang , Hyundong Shin , Arumugam Nallanathan , Dusit Niyato

In the near future, Internet-of-Things (IoT) is expected to connect billions of devices (e.g., smartphones and sensors), which generate massive real-time data at the network edge. Intelligence can be distilled from the data to support…

Information Theory · Computer Science 2019-12-04 Qiao Lan , Zezhong Zhang , Yuqing Du , Zhenyi Lin , Kaibin Huang

AI agents based on multimodal large language models (LLMs) are expected to revolutionize human-computer interaction and offer more personalized assistant services across various domains like healthcare, education, manufacturing, and…

Artificial Intelligence · Computer Science 2024-02-20 Minrui Xu , Dusit Niyato , Jiawen Kang , Zehui Xiong , Shiwen Mao , Zhu Han , Dong In Kim , Khaled B. Letaief

Resource-constrained IoT devices, such as sensors and actuators, have become ubiquitous in recent years. This has led to the generation of large quantities of data in real-time, which is an appealing target for AI systems. However,…

Machine Learning · Computer Science 2021-10-07 M. G. Sarwar Murshed , Christopher Murphy , Daqing Hou , Nazar Khan , Ganesh Ananthanarayanan , Faraz Hussain

Generative artificial intelligence (GenAI) offers various services to users through content creation, which is believed to be one of the most important components in future networks. However, training and deploying big artificial…

Networking and Internet Architecture · Computer Science 2024-01-04 Yuqing Tian , Zhaoyang Zhang , Yuzhi Yang , Zirui Chen , Zhaohui Yang , Richeng Jin , Tony Q. S. Quek , Kai-Kit Wong

Large Foundation Models (LFMs), including multi-modal and generative models, promise to unlock new capabilities for next-generation Edge AI applications. However, performing inference with LFMs in resource-constrained and heterogeneous edge…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-12 Fernando Koch , Aladin Djuhera , Alecio Binotto

Large language model (LLM) inference at the network edge is a promising serving paradigm that leverages distributed edge resources to run inference near users and enhance privacy. Existing edge-based LLM inference systems typically adopt…

Systems and Control · Electrical Eng. & Systems 2025-10-14 Bingjie Zhu , Zhixiong Chen , Liqiang Zhao , Hyundong Shin , Arumugam Nallanathan

AI WiFi offload is emerging as a promising approach for providing large language model (LLM) services to resource-constrained wireless devices. However, unlike conventional edge computing, LLM inference over WiFi must jointly address…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-24 Mingqi Han , Xinghua Sun

Recently, along with the rapid development of mobile communication technology, edge computing theory and techniques have been attracting more and more attentions from global researchers and engineers, which can significantly bridge the…

Networking and Internet Architecture · Computer Science 2019-12-23 Xiaofei Wang , Yiwen Han , Chenyang Wang , Qiyang Zhao , Xu Chen , Min Chen

The proliferation of the Internet of Things (IoT) and its cutting-edge AI-enabled applications (e.g., autonomous vehicles and smart industries) combine two paradigms: data-driven systems and their deployment on the edge. Usually, edge…

Machine Learning · Computer Science 2025-08-01 Ghazal Sobhani , Md. Monzurul Amin Ifath , Tushar Sharma , Israat Haque

The rapid adoption of generative AI (GenAI), particularly Large Language Models (LLMs), has exposed critical limitations of cloud-centric deployments, including latency, cost, and privacy concerns. Meanwhile, Small Language Models (SLMs)…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-30 Roberto Morabito , SiYoung Jang

The remarkable success of foundation models has been driven by scaling laws, demonstrating that model performance improves predictably with increased training data and model size. However, this scaling trajectory faces two critical…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-10 Tao Shen , Didi Zhu , Ziyu Zhao , Zexi Li , Chao Wu , Fei Wu

Internet of Things (IoT) have widely penetrated in different aspects of modern life and many intelligent IoT services and applications are emerging. Recently, federated learning is proposed to train a globally shared model by exploiting a…

Networking and Internet Architecture · Computer Science 2020-05-05 Qiong Wu , Kaiwen He , Xu Chen

Deep Learning (DL) models have been widely deployed on IoT devices with the help of advancements in DL algorithms and chips. However, the limited resources of edge devices make these on-device DL models hard to be generalizable to diverse…

Machine Learning · Computer Science 2023-11-27 Bufang Yang , Lixing He , Neiwen Ling , Zhenyu Yan , Guoliang Xing , Xian Shuai , Xiaozhe Ren , Xin Jiang

Ubiquitous sensors and smart devices from factories and communities are generating massive amounts of data, and ever-increasing computing power is driving the core of computation and services from the cloud to the edge of the network. As an…

Networking and Internet Architecture · Computer Science 2020-06-02 Xiaofei Wang , Yiwen Han , Victor C. M. Leung , Dusit Niyato , Xueqiang Yan , Xu Chen

The Internet of Things (IoT) and Large Language Models (LLMs) have been two major emerging players in the information technology era. Although there has been significant coverage of their individual capabilities, our literature survey sheds…

Cryptography and Security · Computer Science 2025-05-26 Kushal Khatiwada , Jayden Hopper , Joseph Cheatham , Ayan Joshi , Sabur Baidya

Artificial intelligence (AI) promises to revolutionize the design, optimization and management of next-generation communication systems. In this article, we explore the integration of large AI models (LAMs) into semantic communications…

Artificial Intelligence · Computer Science 2025-03-31 Wanli Ni , Zhijin Qin , Haofeng Sun , Xiaoming Tao , Zhu Han

Large language models (LLMs) have emerged as a powerful foundation for intelligent reasoning and decision-making, demonstrating substantial impact across a wide range of domains and applications. However, their massive parameter scales and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-29 Mingyu Sun , Xiao Zhang , Shen Qu , Yan Li , Mengbai Xiao , Yuan Yuan , Dongxiao Yu

With the proliferation of versatile Internet of Things (IoT) services, smart IoT devices are increasingly deployed at the edge of wireless networks to perform collaborative machine learning tasks using locally collected data, giving rise to…

Signal Processing · Electrical Eng. & Systems 2022-11-01 Yue Wang , Zhi Tian , Xin Fan , Yan Huo , Cameron Nowzari , Kai Zeng