English
Related papers

Related papers: Intelligence Beyond the Edge: Inference on Intermi…

200 papers

In recent years, Low Earth Orbit (LEO) satellites have witnessed rapid development, with inference based on Deep Neural Network (DNN) models emerging as the prevailing technology for remote sensing satellite image recognition. However, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-23 Yijie Chen , Qiyang Zhang , Yiran Zhang , Xiao Ma , Ao Zhou

Recently, there has been a trend of shifting the execution of deep learning inference tasks toward the edge of the network, closer to the user, to reduce latency and preserve data privacy. At the same time, growing interest is being devoted…

Machine Learning · Computer Science 2023-06-07 Seyyidahmed Lahmer , Aria Khoshsirat , Michele Rossi , Andrea Zanella

Balancing mutually diverging performance metrics, such as end-to-end latency, accuracy, and device energy consumption, is a challenging undertaking for deep neural network (DNN) inference in Just-in-Time edge environments that are…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-03 Motahare Mounesan , Xiaojie Zhang , Saptarshi Debroy

Wireless sensors are everywhere. To address their energy supply, we proposed an end-to-end design for polar-coded integrated data and energy networking (IDEN), where the conventional signal processing modules, such as…

Information Theory · Computer Science 2023-03-29 Luping Xiang , Jingwen Cui , Jie Hu , Kun Yang , Lajos Hanzo

Modern internet of things (IoT) devices leverage machine learning inference using sensed data on-device rather than offloading them to the cloud. Commonly known as inference at-the-edge, this gives many benefits to the users, including…

Signal Processing · Electrical Eng. & Systems 2021-09-03 Adrian Wheeldon , Alex Yakovlev , Rishad Shafik , Jordan Morris

Recently, harvesting natural energy is gaining more attention than other conventional approaches for sustainable Internet-of-Things (IoT). System on chip (SoC) power requirement for the IoT and generating higher voltages on-chip is a…

Hardware Architecture · Computer Science 2021-03-10 Saswat K. Ram , Sauvagya R. Sahoo , Banee B. Das , Kamalakanta Mahapatra , Saraju P. Mohanty

Implementing machine learning algorithms on Internet of things (IoT) devices has become essential for emerging applications, such as autonomous driving, environment monitoring. But the limitations of computation capability and energy…

Information Theory · Computer Science 2020-05-26 Xiufeng Huang , Sheng Zhou

In split inference, a deep neural network (DNN) is partitioned to run the early part of the DNN at the edge and the later part of the DNN in the cloud. This meets two key requirements for on-device machine learning: input privacy and…

Machine Learning · Computer Science 2024-01-22 Mohammad Malekzadeh , Fahim Kawsar

Mobile systems will have to support multiple AI-based applications, each leveraging heterogeneous data sources through DNN architectures collaboratively executed within the network. To minimize the cost of the AI inference task subject to…

Deep neural networks (DNNs) have succeeded in many different perception tasks, e.g., computer vision, natural language processing, reinforcement learning, etc. The high-performed DNNs heavily rely on intensive resource consumption. For…

Machine Learning · Computer Science 2022-10-10 Zhongnan Qu

As the number of Internet of Things (IoT) devices continuously grows and application scenarios constantly enrich, the volume of sensor data experiences an explosive increase. However, substantial data demands considerable energy during…

Networking and Internet Architecture · Computer Science 2025-10-27 Zongyang Yuan , Lailong Luo , Qianzhen Zhang , Bangbang Ren , Deke Guo , Richard T. B. Ma

Computer vision on low-power edge devices enables applications including search-and-rescue and security. State-of-the-art computer vision algorithms, such as Deep Neural Networks (DNNs), are too large for inference on low-power edge…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Abhinav Goel , Caleb Tung , Xiao Hu , George K. Thiruvathukal , James C. Davis , Yung-Hsiang Lu

The effectiveness of deep neural networks (DNN) in vision, speech, and language processing has prompted a tremendous demand for energy-efficient high-performance DNN inference systems. Due to the increasing memory intensity of most DNN…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-15 Skanda Koppula , Lois Orosa , Abdullah Giray Yağlıkçı , Roknoddin Azizi , Taha Shahroodi , Konstantinos Kanellopoulos , Onur Mutlu

Deep Neural Network (DNN) splitting is one of the key enablers of edge Artificial Intelligence (AI), as it allows end users to pre-process data and offload part of the computational burden to nearby Edge Cloud Servers (ECSs). This opens new…

Signal Processing · Electrical Eng. & Systems 2024-01-31 Francesco Binucci , Mattia Merluzzi , Paolo Banelli , Emilio Calvanese Strinati , Paolo Di Lorenzo

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

As neural networks (NN) are deployed across diverse sectors, their energy demand correspondingly grows. While several prior works have focused on reducing energy consumption during training, the continuous operation of ML-powered systems…

Machine Learning · Computer Science 2024-01-10 Minghao Yan , Hongyi Wang , Shivaram Venkataraman

Distributed systems can be found in various applications, e.g., in robotics or autonomous driving, to achieve higher flexibility and robustness. Thereby, data flow centric applications such as Deep Neural Network (DNN) inference benefit…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-14 Fabian Kreß , El Mahdi El Annabi , Tim Hotfilter , Julian Hoefer , Tanja Harbaum , Juergen Becker

We consider an energy harvesting (EH) IoT network, where users make on-demand requests to a cache-enabled edge node to send status updates about various random processes, each monitored by an EH sensor. The edge node serves users' requests…

Systems and Control · Electrical Eng. & Systems 2022-12-13 Mohammad Hatami , Markus Leinonen , Marian Codreanu

As deep neural networks continue to expand and become more complex, most edge devices are unable to handle their extensive processing requirements. Therefore, the concept of distributed inference is essential to distribute the neural…

Artificial Intelligence · Computer Science 2023-07-24 Fazeela Mazhar Khan , Emna Baccour , Aiman Erbad , Mounir Hamdi

Artificial intelligence (AI) has become a pivotal force in reshaping next generation mobile networks. Edge computing holds promise in enabling AI as a service (AIaaS) for prompt decision-making by offloading deep neural network (DNN)…

Networking and Internet Architecture · Computer Science 2025-01-28 Vahid Pourakbar , Hamed Shah-Mansouri