English
Related papers

Related papers: Intelligence Beyond the Edge: Inference on Intermi…

200 papers

The pervasiveness of "Internet-of-Things" in our daily life has led to a recent surge in fog computing, encompassing a collaboration of cloud computing and edge intelligence. To that effect, deep learning has been a major driving force…

Machine Learning · Computer Science 2020-05-25 Yinghan Long , Indranil Chakraborty , Kaushik Roy

Given the fast growth of intelligent devices, it is expected that a large number of high-stake artificial intelligence (AI) applications, e.g., drones, autonomous cars, tactile robots, will be deployed at the edge of wireless networks in…

Signal Processing · Electrical Eng. & Systems 2020-04-29 Kai Yang , Yong Zhou , Zhanpeng Yang , Yuanming Shi

With the rapid upsurge of deep learning tasks at the network edge, effective edge artificial intelligence (AI) inference becomes critical to provide low-latency intelligent services for mobile users via leveraging the edge computing…

Information Theory · Computer Science 2024-10-30 Xiangyu Yang , Sheng Hua , Yuanming Shi , Hao Wang , Jun Zhang , Khaled B. Letaief

Edge intelligence enables AI inference at the network edge, co-located with or near the radio access network, rather than in centralized clouds or on mobile devices. It targets low-latency, resource-constrained applications with large data…

Networking and Internet Architecture · Computer Science 2026-01-26 Jaume Anguera Peris , Joakim Jaldén

We propose distributed deep neural networks (DDNNs) over distributed computing hierarchies, consisting of the cloud, the edge (fog) and end devices. While being able to accommodate inference of a deep neural network (DNN) in the cloud, a…

Computer Vision and Pattern Recognition · Computer Science 2017-09-08 Surat Teerapittayanon , Bradley McDanel , H. T. Kung

In the Edge Inference (EI) paradigm, where a Deep Neural Network (DNN) is split across the transceivers to wirelessly communicate goal-defined features in solving a computational task, the wireless medium has been commonly treated as a…

Machine Learning · Computer Science 2025-04-03 Kyriakos Stylianopoulos , Paolo Di Lorenzo , George C. Alexandropoulos

The increasing pervasiveness of intelligent mobile applications requires to exploit the full range of resources offered by the mobile-edge-cloud network for the execution of inference tasks. However, due to the heterogeneity of such…

Networking and Internet Architecture · Computer Science 2024-04-15 Chetna Singhal , Yashuo Wu , Francesco Malandrino , Marco Levorato , Carla Fabiana Chiasserini

Ensembles of Deep Neural Networks (DNNs) have achieved qualitative predictions but they are computing and memory intensive. Therefore, the demand is growing to make them answer a heavy workload of requests with available computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

This paper introduces partitioning an inference task of a deep neural network between an edge and a host platform in the IoT environment. We present a DNN as an encoding pipeline, and propose to transmit the output feature space of an…

Computer Vision and Pattern Recognition · Computer Science 2018-02-13 Jong Hwan Ko , Taesik Na , Mohammad Faisal Amir , Saibal Mukhopadhyay

Internet of Things (IoT) systems in general consist of a lot of devices with massive connectivity. Those devices are usually constrained with limited energy supply and can only operate at low power and low rate. In this paper, we…

Signal Processing · Electrical Eng. & Systems 2019-07-29 Zhou Ni , Ziru Chen , Qinbo Zhang , Chi Zhou

Deep Neural Network (DNN) applications with edge computing presents a trade-off between responsiveness and computational resources. On one hand, edge computing can provide high responsiveness deploying computational resources close to end…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-29 Roberto G. Pacheco , Rodrigo S. Couto

With the surging popularity of edge computing, the need to efficiently perform neural network inference on battery-constrained IoT devices has greatly increased. While algorithmic developments enable neural networks to solve increasingly…

Hardware Architecture · Computer Science 2022-06-27 Maarten Molendijk , Floran de Putter , Henk Corporaal

The ever increasing number and complexity of energy-bound devices (such as the ones used in Internet of Things applications, smart phones, and mission critical systems) pose an important challenge on techniques to optimize their energy…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-25 Umer Liqat , Zorana Bankovic , Pedro Lopez-Garcia , Manuel V. Hermenegildo

Deep Neural Networks (DNNs) are the de facto algorithm for tackling cognitive tasks in real-world applications such as speech recognition and natural language processing. DNN inference comprises numerous dot product operations between…

Hardware Architecture · Computer Science 2023-11-20 Nitesh Narayana GS , Marc Ordoñez , Lokananda Hari , Franyell Silfa , Antonio González

Energy harvesting battery-free embedded devices rely only on ambient energy harvesting that enables stand-alone and sustainable IoT applications. These devices execute programs when the harvested ambient energy in their energy reservoir is…

Software Engineering · Computer Science 2022-11-24 Ferhat Erata , Arda Goknil , Eren Yıldız , Kasım Sinan Yıldırım , Ruzica Piskac , Jakub Szefer , Gökçin Sezgin

Smart sensors are an emerging technology that allows combining the data acquisition with the elaboration directly on the Edge device, very close to the sensors. To push this concept to the extreme, technology companies are proposing a new…

Signal Processing · Electrical Eng. & Systems 2024-08-01 Andrea Ronco , Lukas Schulthess , David Zehnder , Michele Magno

A novel energy-efficient edge computing paradigm is proposed for real-time deep learning-based image upsampling applications. State-of-the-art deep learning solutions for image upsampling are currently trained using either resize or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Ian Colbert , Ken Kreutz-Delgado , Srinjoy Das

Integrated sensing and communication (ISAC) is a promising solution to accelerate edge inference via the dual use of wireless signals. However, this paradigm needs to minimize the inference error and latency under ISAC co-functionality…

Signal Processing · Electrical Eng. & Systems 2024-04-17 Xibin Jin , Guoliang Li , Shuai Wang , Miaowen Wen , Chengzhong Xu , H. Vincent Poor

The success of deep neural networks (DNN) in machine perception applications such as image classification and speech recognition comes at the cost of high computation and storage complexity. Inference of uncompressed large scale DNN models…

Machine Learning · Computer Science 2020-07-06 Yihao Fang , Shervin Manzuri Shalmani , Rong Zheng

We present the concept of approximate intermittent computing and demonstrate its application. Intermittent computations stem from the erratic energy patterns caused by energy harvesting: computations unpredictably terminate whenever energy…

Hardware Architecture · Computer Science 2021-11-23 Fulvio Bambusi , Francesco Cerizzi , Yamin Lee , Luca Mottola