English
Related papers

Related papers: Resource-Efficient Generative AI Model Deployment …

200 papers

We propose integrating the edge-computing paradigm into the multi-robot collaborative scheduling to maximize resource utilization for complex collaborative tasks, which many robots must perform together. Examples include collaborative…

Robotics · Computer Science 2023-11-20 Nazish Tahir , Ramviyas Parasuraman

Deep learning models are increasingly deployed to edge devices for real-time applications. To ensure stable service quality across diverse edge environments, it is highly desirable to generate tailored model architectures for different…

Machine Learning · Computer Science 2023-03-14 Hao Wen , Yuanchun Li , Zunshuai Zhang , Shiqi Jiang , Xiaozhou Ye , Ye Ouyang , Ya-Qin Zhang , Yunxin Liu

The integration of generative AI models, particularly large language models (LLMs), into real-time multi-model AI applications such as video conferencing and gaming is giving rise to a new class of workloads: real-time generative AI…

Machine Learning · Computer Science 2025-07-22 Rachid Karami , Rajeev Patwari , Hyoukjun Kwon , Ashish Sirasao

Generative AI (GenAI) services powered by large language models (LLMs) increasingly deliver real-time interactions, yet existing 5G multi-access edge computing (MEC) architectures often treat communication and computing as separate domains,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-24 Chien-Sheng Yang , Yu-Jen Ku , Yuan-Yao Lou , Nathan Tenny , Alex C. -C. Hsu

Computational offloading is a promising approach for overcoming resource constraints on client devices by moving some or all of an application's computations to remote servers. With the advent of specialized hardware accelerators, client…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-09 Nathan Ng , David Irwin , Ananthram Swami , Don Towsley , Prashant Shenoy

The network edge's role in Artificial Intelligence (AI) inference processing is rapidly expanding, driven by a plethora of applications seeking computational advantages. These applications strive for data-driven efficiency, leveraging…

Hardware Architecture · Computer Science 2023-11-08 Roberto Morabito , Mallik Tatipamula , Sasu Tarkoma , Mung Chiang

Mobile edge computing is beneficial to reduce service response time and core network traffic by pushing cloud functionalities to network edge. Equipped with storage and computation capacities, edge nodes can cache services of…

Networking and Internet Architecture · Computer Science 2020-02-05 Xiao Ma , Ao Zhou , Shan Zhang , Shangguang Wang

Ubiquitous sensors and smart devices from factories and communities are generating massive amounts of data, and ever-increasing computing power is driving the core of computation and services from the cloud to the edge of the network. As an…

Networking and Internet Architecture · Computer Science 2020-06-02 Xiaofei Wang , Yiwen Han , Victor C. M. Leung , Dusit Niyato , Xueqiang Yan , Xu Chen

With the development of Edge Computing and Artificial Intelligence (AI) technologies, edge devices are witnessed to generate data at unprecedented volume. The Edge Intelligence (EI) has led to the emergence of edge devices in various…

Information Retrieval · Computer Science 2021-06-22 Jiayan Gu , Yan Wu , Ashiq Anjum , John Panneerselvam , Yao Lu , Bo Yuan

Hierarchical edge-cloud computing-aided Internet of Things (IoT) networks offer low-latency and cost-efficient services to a growing number of data-intensive IoT devices. However, optimizing service placement, which involves determining the…

To meet next-generation IoT application demands, edge computing moves processing power and storage closer to the network edge to minimise latency and bandwidth utilisation. Edge computing is becoming popular as a result of these benefits,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-13 Aadharsh Roshan Nandhakumar , Ayush Baranwal , Priyanshukumar Choudhary , Muhammed Golec , Sukhpal Singh Gill

A novel paradigm of mobile edge generation (MEG)-enabled digital twin (DT) is proposed, which enables distributed on-device generation at mobile edge networks for real-time DT applications. First, an MEG-DT architecture is put forward to…

Signal Processing · Electrical Eng. & Systems 2024-10-16 Xiaoxia Xu , Ruikang Zhong , Xidong Mu , Yuanwei Liu , Kaibin Huang

To circumvent persistent connectivity to the cloud infrastructure, the current emphasis on computing at network edge devices in the multi-robot domain is a promising enabler for delay-sensitive jobs, yet its adoption is rife with…

Robotics · Computer Science 2023-11-20 Nazish Tahir , Ramviyas Parasuraman

The rapid adoption of generative AI (GenAI), particularly Large Language Models (LLMs), has exposed critical limitations of cloud-centric deployments, including latency, cost, and privacy concerns. Meanwhile, Small Language Models (SLMs)…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-30 Roberto Morabito , SiYoung Jang

Cache-enabled coordinated mobile edge network is an emerging network architecture, wherein serving nodes located at the network edge have the capabilities of baseband signal processing and caching files at their local cache. The main goals…

Signal Processing · Electrical Eng. & Systems 2019-12-30 Shiwen He , Wei Huang , Jiaheng Wang , Ju Ren , Yongming Huang , Yaoxue Zhang

Edge computing has emerged as a popular paradigm for running latency-sensitive applications due to its ability to offer lower network latencies to end-users. In this paper, we argue that despite its lower network latency, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-30 Ahmed Ali-Eldin , Bin Wang , Prashant Shenoy

Major bottlenecks of large-scale Federated Learning(FL) networks are the high costs for communication and computation. This is due to the fact that most of current FL frameworks only consider a star network topology where all local trained…

Information Theory · Computer Science 2021-09-23 Thinh Quang Dinh , Diep N. Nguyen , Dinh Thai Hoang , Pham Tran Vu , Eryk Dutkiewicz

Modern online platforms are increasingly employing recommendation systems to address information overload and improve user engagement. There is an evolving paradigm in this research field that recommendation network learning occurs both on…

Information Retrieval · Computer Science 2024-12-03 Zheqi Lv , Wenqiao Zhang , Zhengyu Chen , Shengyu Zhang , Kun Kuang

Edge Computing emerges as a promising alternative of Cloud Computing, with scalable compute resources and services deployed in the path between IoT devices and Cloud. Since virtualization techniques can be applied on Edge compute nodes,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-13 Joanna Georgiou , Moysis Symeonides , George Pallis , Marios D. Dikaiakos

Edge computing operates between the cloud and end users and strives to provide low-latency computing services for simultaneous users. Redundant use of multiple edge nodes can reduce latency, as edge systems often operate in uncertain…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Pei Peng , Emina Soljanin