English
Related papers

Related papers: Resource-Efficient Generative AI Model Deployment …

200 papers

Motivated by the proliferation of Internet-of-Thing (IoT) devices and the rapid advances in the field of deep learning, there is a growing interest in pushing deep learning computations, conventionally handled by the cloud, to the edge of…

Machine Learning · Computer Science 2024-09-25 Marco Palena , Tania Cerquitelli , Carla Fabiana Chiasserini

In many industry scale applications, large and resource consuming machine learning models reside in powerful cloud servers. At the same time, large amounts of input data are collected at the edge of cloud. The inference results are also…

Machine Learning · Computer Science 2021-08-31 Amin Banitalebi-Dehkordi , Naveen Vedula , Jian Pei , Fei Xia , Lanjun Wang , Yong Zhang

The fusion of the Internet of Things (IoT) with Sixth-Generation (6G) technology has significant potential to revolutionize the IoT landscape. With the ultra-reliable and low-latency communication capabilities of 6G, 6G-IoT networks can…

Networking and Internet Architecture · Computer Science 2024-07-26 Jinbo Wen , Jiangtian Nie , Yue Zhong , Changyan Yi , Xiaohuan Li , Jiangming Jin , Yang Zhang , Dusit Niyato

Virtually all of the rapidly increasing data traffic consumed by mobile users requires some kind of processing, normally performed at cloud servers. A recent thrust, {\em mobile edge computing}, moves such processing to servers {\em within}…

Networking and Internet Architecture · Computer Science 2016-11-28 Francesco Malandrino , Scott Kirkpatrick , Carla-Fabiana Chiasserini

Increasing rate of progress in hardware and artificial intelligence (AI) solutions is enabling a range of software systems to be deployed closer to their users, increasing application of edge software system paradigms. Edge systems support…

Software Engineering · Computer Science 2024-06-14 Kevin Pitstick , Marc Novakouski , Grace A. Lewis , Ipek Ozkaya

Mobile networks are experiencing tremendous increase in data volume and user density. An efficient technique to alleviate this issue is to bring the data closer to the users by exploiting the caches of edge network nodes, such as fixed or…

Networking and Internet Architecture · Computer Science 2021-05-18 Nikolaos Nomikos , Spyros Zoupanos , Themistoklis Charalambous , Ioannis Krikidis , Athina Petropulu

Edge computing (EC), positioned near end devices, holds significant potential for delivering low-latency, energy-efficient, and secure services. This makes it a crucial component of the Internet of Things (IoT). However, the increasing…

Computer Science and Game Theory · Computer Science 2024-12-03 Yang Li , Xing Zhang , Bo Lei , Qianying Zhao , Min Wei , Zheyan Qu , Wenbo Wang

The high-performance generative artificial intelligence (GAI) represents the latest evolution of computational intelligence, while the blessing of future 6G networks also makes edge intelligence (EI) full of development potential. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-08 Ning Chen , Zhipeng Cheng , Xuwei Fan , Xiaoyu Xia , Lianfen Huang

Generative AI (GenAI) has transformed applications in natural language processing and content creation, yet centralized inference remains hindered by high latency, limited customizability, and privacy concerns. Deploying large models (LMs)…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Haiyuan Li , Hari Madhukumar , Shuangyi Yan , Yulei Wu , Dimitra Simeonidou

Edge Computing (EC) is about remodeling the way data is handled, processed, and delivered within a vast heterogeneous network. One of the fundamental concepts of EC is to push the data processing near the edge by exploiting front-end…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-14 Raby Hamadi , Abdullah Khanfor , Hakim Ghazzai , Yehia Massoud

The security and privacy concerns along with the amount of data that is required to be processed on regular basis has pushed processing to the edge of the computing systems. Deploying advanced Neural Networks (NN), such as deep neural…

Cryptography and Security · Computer Science 2023-03-06 Muhammad Shafique , Alberto Marchisio , Rachmad Vidya Wicaksana Putra , Muhammad Abdullah Hanif

The rapid evolution of Artificial Intelligence (AI) and Machine Learning (ML) has significantly heightened computational demands, particularly for inference-serving workloads. While traditional cloud-based deployments offer scalability,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-17 Foteini Stathopoulou , Aggelos Ferikoglou , Manolis Katsaragakis , Dimosthenis Masouros , Sotirios Xydis , Dimitrios Soudris

The thriving of artificial intelligence (AI) applications is driving the further evolution of wireless networks. It has been envisioned that 6G will be transformative and will revolutionize the evolution of wireless from "connected things"…

Information Theory · Computer Science 2024-10-28 Khaled B. Letaief , Yuanming Shi , Jianmin Lu , Jianhua Lu

Edge computing is the practice of placing computing resources at the edges of the Internet in close proximity to devices and information sources. This, much like a cache on a CPU, increases bandwidth and reduces latency for applications but…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-01 Paul Wood , Heng Zhang , Muhammad-Bilal Siddiqui , Saurabh Bagchi

6G's AI native vision of embedding advance intelligence in the network while bringing it closer to the user requires a systematic evaluation of Generative AI (GenAI) models on edge devices. Rapidly emerging solutions based on Open RAN…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-28 Zeinab Nezami , Maryam Hafeez , Karim Djemame , Syed Ali Raza Zaidi

Edge computing has revolutionized the world of mobile and wireless networks world thanks to its flexible, secure, and performing characteristics. Lately, we have witnessed the increasing use of it to make more performing the deployment of…

Machine Learning · Computer Science 2021-12-23 Hung T. Nguyen , Roberto Morabito , Kwang Taik Kim , Mung Chiang

This paper studies an edge intelligence-based IoT network in which a set of edge servers learn a shared model using federated learning (FL) based on the datasets uploaded from a multi-technology-supported IoT network. The data uploading…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-01 Yong Xiao , Yingyu Li , Guangming Shi , H. Vincent Poor

The sixth-generation (6G) mobile networks are expected to feature the ubiquitous deployment of machine learning and AI algorithms at the network edge. With rapid advancements in edge AI, the time has come to realize intelligence downloading…

Information Theory · Computer Science 2023-04-04 Kaibin Huang , Hai Wu , Zhiyan Liu , Xiaojuan Qi

The demand for smartness in embedded systems has been mounting up drastically in the past few years. Embedded system today must address the fundamental challenges introduced by cloud computing and artificial intelligence. KubeEdge [1] is an…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-21 Sean Wang , Yuxiao Hu , Jason Wu

Artificial intelligence-generated content (AIGC) service provisioning in wireless edge networks involves two phases: content generation on edge servers and content transmission to mobile devices. In this paper, we take image generation as a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-26 Jinghang Xu , Kun Guo , Wei Teng , Chenxi Liu , Wei Feng