English
Related papers

Related papers: Generative AI on the Edge: Architecture and Perfor…

200 papers

The recent shift in Generative AI (GenAI) applications from cloud-only environments to end-user devices introduces new challenges in resource management, system efficiency, and user experience. This paper presents ConsumerBench, a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-24 Yile Gu , Rohan Kadekodi , Hoang Nguyen , Keisuke Kamahori , Yiyu Liu , Baris Kasikci

In a level-5 autonomous driving system, the autonomous driving vehicles (AVs) are expected to sense the surroundings via analyzing a large amount of data captured by a variety of onboard sensors in near-real-time. As a result, enormous…

Networking and Internet Architecture · Computer Science 2020-12-15 Bo Yang , Xuelin Cao , Kai Xiong , Chau Yuen , Yong Liang Guan , Supeng Leng , Lijun Qian , Zhu Han

Connected robotics is one of the principal use cases driving the transition towards more intelligent and capable 6G mobile cellular networks. Replacing wired connections with highly reliable, high-throughput, and low-latency 5G/6G radio…

With the rapid advancement of artificial intelligence (AI), generative AI (GenAI) has emerged as a transformative tool, enabling customized and personalized AI-generated content (AIGC) services. However, GenAI models with billions of…

Networking and Internet Architecture · Computer Science 2024-11-14 Zhang Liu , Hongyang Du , Lianfen Huang , Zhibin Gao , Dusit Niyato

6G wireless networks aim to exploit semantic awareness to optimize radio resources. By optimizing the transmission through the lens of the desired goal, the energy consumption of transmissions can also be reduced, and the latency can be…

Systems and Control · Electrical Eng. & Systems 2025-09-30 Aubida A. Al-Hameed , Mohammed M. H. Qazzaz , Maryam Hafeez , Syed A. Zaidi

A conception of mobile edge generation (MEG) is proposed, where generative artificial intelligence (GAI) models are distributed at edge servers (ESs) and user equipment (UE), enabling joint execution of generation tasks. Various distributed…

Networking and Internet Architecture · Computer Science 2024-01-18 Ruikang Zhong , Xidong Mu , Yimeng Zhang , Mona Jabor , Yuanwei Liu

Generative AI (GenAI) is reshaping enterprise architecture work in agile software organizations, yet evidence on its effects remains scattered. We report a systematic literature review (SLR), following established SLR protocols of…

Software Engineering · Computer Science 2025-10-28 Stefan Julian Kooy , Jean Paul Sebastian Piest , Rob Henk Bemthuis

Context: Generative Artificial Intelligence (GenAI) is transforming much of software development, yet its application in software architecture is still in its infancy, and no prior study has systematically addressed the topic. Aim: We aim…

This article surveys Cognitive Edge Computing as a practical and methodical pathway for deploying reasoning-capable Large Language Models (LLMs) and autonomous AI agents on resource-constrained devices at the network edge. We present a…

Machine Learning · Computer Science 2025-11-10 Xubin Wang , Qing Li , Weijia Jia

Deploying Large Language Models (LLMs) on edge devices presents significant challenges due to computational constraints, memory limitations, inference speed, and energy consumption. Model quantization has emerged as a key technique to…

This position paper argues that to achieve Level 5 autonomous 6G networks, the next generation of Artificial Intelligence in Radio Access Networks (AI-RAN) should transition away from fragmented, narrow predictive models and instead adopt…

Networking and Internet Architecture · Computer Science 2026-05-13 Pranshav Gajjar , Vijay K Shah

Sixth-generation (6G) networks are evolving towards new features and order-of-magnitude enhancement of systematic performance metrics compared to the current 5G. In particular, the 6G networks are expected to achieve extreme connectivity…

Embodied AI requires sub-second inference near the Radio Access Network (RAN), but deployments span heterogeneous tiers (on-device, RAN-edge, cloud) and must not disrupt real-time baseband processing. We report measurements from a 5G…

Networking and Internet Architecture · Computer Science 2026-03-02 Hariz Yet , Nguyen Thanh Tam , Mao V. Ngo , Lim Yi Shen , Lin Wei , Jihong Park , Binbin Chen , Tony Q. S. Quek

The concept of AI-RAN as specified by the AI-RAN alliance is geared to explore a converged 6G platform that can support management, orchestration, and deployment of both AI and RAN workloads. This concept is central to the development of a…

Networking and Internet Architecture · Computer Science 2025-09-22 Syed Danial Ali Shah , Zeinab Nezami , Maryam Hafeez , Syed Ali Raza Zaidi

Edge Artificial Intelligence (Edge AI) embeds intelligence directly into devices at the network edge, enabling real-time processing with improved privacy and reduced latency by processing data close to its source. This review systematically…

Machine Learning · Computer Science 2025-10-03 Mohamad Abou Ali , Fadi Dornaika

Generative AI (GenAI) has emerged as a transformative technology, enabling customized and personalized AI-generated content (AIGC) services. In this paper, we address challenges of edge-enabled AIGC service provisioning, which remain…

Machine Learning · Computer Science 2024-11-05 Zhang Liu , Hongyang Du , Xiangwang Hou , Lianfen Huang , Seyyedali Hosseinalipour , Dusit Niyato , Khaled Ben Letaief

The thriving of artificial intelligence (AI) applications is driving the further evolution of wireless networks. It has been envisioned that 6G will be transformative and will revolutionize the evolution of wireless from "connected things"…

Information Theory · Computer Science 2024-10-28 Khaled B. Letaief , Yuanming Shi , Jianmin Lu , Jianhua Lu

Large language models (LLMs) are becoming increasingly capable at small parameter scales. At the same time, conventional cloud-centric deployment introduces challenges around data privacy, latency, and cost that are acute in operational…

Hardware Architecture · Computer Science 2026-04-29 Harri Renney , Fouad Trad , Michael Mattarock , Zena Wood

In wireless networks, applying deep learning models to solve matching problems between different entities has become a mainstream and effective approach. However, the complex network topology in 6G multiple access presents significant…

Networking and Internet Architecture · Computer Science 2024-11-08 Xudong Wang , Hongyang Du , Dusit Niyato , Lijie Zhou , Lei Feng , Zhixiang Yang , Fanqin Zhou , Wenjing Li

Large language models (LLMs), which have shown remarkable capabilities, are revolutionizing AI development and potentially shaping our future. However, given their multimodality, the status quo cloud-based deployment faces some critical…

Machine Learning · Computer Science 2025-06-05 Zheng Lin , Guanqiao Qu , Qiyuan Chen , Xianhao Chen , Zhe Chen , Kaibin Huang