English
Related papers

Related papers: OCTOPINF: Workload-Aware Inference Serving for Edg…

200 papers

In recent years, the development of specialized edge computing devices has significantly increased, driven by the growing demand for AI models. These devices, such as the NVIDIA Jetson series, must efficiently handle increased data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-03 Ashiyana Abdul Majeed , Mahmoud Meribout

Edge intelligence (EI) allows resource-constrained edge devices (EDs) to offload computation-intensive AI tasks (e.g., visual object detection) to edge servers (ESs) for fast execution. However, transmitting high-volume raw task data (e.g.,…

Information Theory · Computer Science 2026-02-24 Xian Li , Suzhi Bi , Ying-Jun Angela Zhang

As the volume of image data grows, data-oriented cloud computing in Internet of Video Things (IoVT) systems encounters latency issues. Task-oriented edge computing addresses this by shifting data analysis to the edge. However, limited…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Jiaqi Wu , Simin Chen , Zehua Wang , Wei Chen , Zijian Tian , F. Richard Yu , Victor C. M. Leung

With the edge computing becoming an increasingly adopted concept in system architectures, it is expected its utilization will be additionally heightened when combined with deep learning (DL) techniques. The idea behind integrating demanding…

Networking and Internet Architecture · Computer Science 2020-03-12 Mounir Bensalem , Jasenka Dizdarević , Admela Jukan

This paper proposes a novel edge computing enabled real-time video analysis system for intelligent visual devices. The proposed system consists of a tracking-assisted object detection module (TAODM) and a region of interesting module…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Xiang Chen , Wenjie Zhu , Jiayuan Chen , Tong Zhang , Changyan Yi , Jun Cai

Pervasive computing involves the placement of processing services close to end users to support intelligent applications. With the advent of the Internet of Things (IoT) and the Edge Computing (EC), one can find room for placing services at…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-05 Panagiotis Fountas , Kostas Kolomvatsos , Christos Anagnostopoulos

As deep neural networks (DNNs) are being applied to a wide range of edge intelligent applications, it is critical for edge inference platforms to have both high-throughput and low-latency at the same time. Such edge platforms with multiple…

Machine Learning · Computer Science 2023-05-03 Ziyang Zhang , Huan Li , Yang Zhao , Changyao Lin , Jie Liu

In this paper, we consider a task offloading problem in a multi-access edge computing (MEC) network, in which edge users can either use their local processing unit to compute their tasks or offload their tasks to a nearby edge server…

Networking and Internet Architecture · Computer Science 2023-08-15 Babak Badnava , Keenan Roach , Kenny Cheung , Morteza Hashemi , Ness B Shroff

Deep Learning (DL) model-based AI services are increasingly offered in a variety of predictive analytics services such as computer vision, natural language processing, speech recognition. However, the quality of the DL models can degrade…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-04 Anirban Bhattacharjee , Ajay Dev Chhokra , Hongyang Sun , Shashank Shekhar , Aniruddha Gokhale , Gabor Karsai , Abhishek Dubey

When trained as generative models, Deep Learning algorithms have shown exceptional performance on tasks involving high dimensional data such as image denoising and super-resolution. In an increasingly connected world dominated by mobile and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-10 Ian Colbert , Jake Daly , Ken Kreutz-Delgado , Srinjoy Das

Unmanned aerial vehicles (UAVs) often collaborate by collecting and offloading sensing streams to an edge server, where a deep neural network (DNN) model performs cross-stream alignment, fusion, and inference. However, the coupling between…

Signal Processing · Electrical Eng. & Systems 2026-05-06 Yanan Du , Sai Xu , Yinbo Yu

Recent advances in artificial intelligence have driven increasing intelligent applications at the network edge, such as smart home, smart factory, and smart city. To deploy computationally intensive Deep Neural Networks (DNNs) on…

Networking and Internet Architecture · Computer Science 2020-12-08 Liekang Zeng , Xu Chen , Zhi Zhou , Lei Yang , Junshan Zhang

Balancing mutually diverging performance metrics, such as end-to-end latency, accuracy, and device energy consumption, is a challenging undertaking for deep neural network (DNN) inference in Just-in-Time edge environments that are…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-03 Motahare Mounesan , Xiaojie Zhang , Saptarshi Debroy

In this paper, we propose a Distributed Intelligent Video Surveillance (DIVS) system using Deep Learning (DL) algorithms and deploy it in an edge computing environment. We establish a multi-layer edge computing architecture and a…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Jianguo Chen , Kenli Li , Qingying Deng , Keqin Li , Philip S. Yu

Almost in every heavily computation-dependent application, from 6G communication systems to autonomous driving platforms, a large portion of computing should be near to the client side. Edge computing (AI at Edge) in mobile devices is one…

Hardware Architecture · Computer Science 2024-07-29 Seyed Nima Omidsajedi , Rekha Reddy , Jianming Yi , Jan Herbst , Christoph Lipps , Hans Dieter Schotten

Vision-language models (VLMs) have demonstrated strong applicability in edge industrial applications, yet their deployment remains severely constrained by requirements for deterministic low latency and stable execution under resource…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Mengling Deng , Yuanpeng Chen , Sheng Yang , Wei Tao , Wenhai Zhang , Hui Song , Linyuanhao Qin , Kai Zhao , Xiaojun Ye , Shanhui Mo , Jingli Fan , Shuang Zhang , Bei Liu , Tiankun Zhao , Xiangjing An

The rapid proliferation of latency-sensitive and battery-constrained Internet-of-Things (IoT) applications has intensified the need for intelligent workload placement mechanisms across the Edge-Cloud computing continuum. In such…

Networking and Internet Architecture · Computer Science 2026-04-28 Anastasios Giannopoulos , Sotirios Spantideas , Panagiotis Trakadas

Modern machine learning tools such as deep neural networks (DNNs) are playing a revolutionary role in many fields such as natural language processing, computer vision, and the internet of things. Once they are trained, deep learning models…

Machine Learning · Computer Science 2022-01-19 Arjun Parthasarathy , Bhaskar Krishnamachari

The expansion of large language models is increasingly limited by the constrained memory capacity of modern GPUs. To mitigate this, Mixture-of-Experts (MoE) architectures activate only a small portion of parameters during inference,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-31 Zixu Shen , Kexin Chu , Yifan Zhang , Dawei Xiang , Runxin Wu , Wei Zhang

Processing data at high speeds is becoming increasingly critical as digital economies generate enormous data. The current paradigms for timely data processing are edge computing and data stream processing (DSP). Edge computing places…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-22 Eugene Armah , Linda Amoako Bannning