English
Related papers

Related papers: Adaptive ResNet Architecture for Distributed Infer…

200 papers

We consider a communication cell comprised of Internet-of-Things (IoT) nodes transmitting to a common Access Point (AP). The nodes in the cell are assumed to generate data samples periodically, which are to be transmitted to the AP. The AP…

Signal Processing · Electrical Eng. & Systems 2020-12-02 Ivana Nikoloska , Josefine Holm , Anders Kalør , Petar Popovski , Nikola Zlatanov

Distributed computing systems often consist of hundreds of nodes, executing tasks with different resource requirements. Efficient resource provisioning and task scheduling in such systems are non-trivial and require close monitoring and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-10 Paul J. Pritz , Daniel Perez , Kin K. Leung

In this paper, the problem of distributed resource allocation is studied for an Internet of Things (IoT) system, composed of a heterogeneous group of nodes compromising both machine-type devices (MTDs) and human-type devices (HTDs). The…

Information Theory · Computer Science 2017-08-23 Nof Abuzainab , Walid Saad , Choong-Seon Hong , H. Vincent Poor

Recently, the applications of deep neural network (DNN) have been very prominent in many fields such as computer vision (CV) and natural language processing (NLP) due to its superior feature extraction performance. However, the…

Machine Learning · Computer Science 2022-01-11 Tao Niu , Yinglei Teng , Zhu Han , Panpan Zou

An increasing number of applications rely on complex inference tasks that are based on machine learning (ML). Currently, there are two options to run such tasks: either they are served directly by the end device (e.g., smartphones, IoT…

Networking and Internet Architecture · Computer Science 2023-08-16 T. Si Salem , G. Castellano , G. Neglia , F. Pianese , A. Araldo

Since emerging edge applications such as Internet of Things (IoT) analytics and augmented reality have tight latency constraints, hardware AI accelerators have been recently proposed to speed up deep neural network (DNN) inference run by…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-20 Qianlin Liang , Walid A. Hanafy , Ahmed Ali-Eldin , Prashant Shenoy

The use of deep learning (DL) on Internet of Things (IoT) and mobile devices offers numerous advantages over cloud-based processing. However, such devices face substantial energy constraints to prolong battery-life, or may even operate…

Machine Learning · Computer Science 2025-05-20 Josh Millar , Hamed Haddadi , Anil Madhavapeddy

Spatial-wise dynamic convolution has become a promising approach to improving the inference efficiency of deep networks. By allocating more computation to the most informative pixels, such an adaptive inference paradigm reduces the spatial…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Yizeng Han , Zhihang Yuan , Yifan Pu , Chenhao Xue , Shiji Song , Guangyu Sun , Gao Huang

The wireless sensor network is a collection of energy-constrained nodes. Their objective is to sense, collect and process information for some ad-hoc purpose. Typically the nodes are deployed in geographically inaccessible regions. Thus the…

Networking and Internet Architecture · Computer Science 2012-04-16 Subhabrata Mukherjee , Amrita Saha , Mrinal K. Naskar , Amitava Mukherjee

Recent advances in Deep Neural Networks (DNNs) have demonstrated outstanding performance across various domains. However, their large size is a challenge for deployment on resource-constrained devices such as mobile, edge, and IoT…

Machine Learning · Computer Science 2024-10-10 Divya Jyoti Bajpai , Manjesh Kumar Hanawal

Deep neural networks (DNNs) have provided brilliant performance across various tasks. However, this success often comes at the cost of unnecessarily large model sizes, high computational demands, and substantial memory footprints.…

Machine Learning · Computer Science 2025-11-26 Shaharyar Ahmed Khan Tareen , Filza Khan Tareen

The majority of IoT devices like smartwatches, smart plugs, HVAC controllers, etc., are powered by hardware with a constrained specification (low memory, clock speed and processor) which is insufficient to accommodate and execute large,…

Training deep neural networks on large datasets can often be accelerated by using multiple compute nodes. This approach, known as distributed training, can utilize hundreds of computers via specialized message-passing protocols such as Ring…

Machine Learning · Computer Science 2022-01-12 Max Ryabinin , Eduard Gorbunov , Vsevolod Plokhotnyuk , Gennady Pekhimenko

In this paper, we consider a problem in which distributively extracted features are used for performing inference in wireless networks. We elaborate on our proposed architecture, which we herein refer to as "in-network learning", provide a…

Machine Learning · Statistics 2021-09-20 Matei Moldoveanu , Abdellatif Zaidi

In this paper, we examine the internet of things system which is dedicated for smart cities, smart factory, and connected cars, etc. To support such systems in wide area with low power consumption, energy harvesting technology without wired…

Networking and Internet Architecture · Computer Science 2023-04-28 Kiseop Chung , Jin-Taek Lim

Executing deep neural networks (DNNs) on edge artificial intelligence (AI) devices enables various autonomous mobile computing applications. However, the memory budget of edge AI devices restricts the number and complexity of DNNs allowed…

Machine Learning · Computer Science 2024-01-31 Kun Wang , Jiani Cao , Zimu Zhou , Zhenjiang Li

Deep learning architectures suffer from depth-related performance degradation, limiting the effective depth of neural networks. Approaches like ResNet are able to mitigate this, but they do not completely eliminate the problem. We introduce…

Machine Learning · Computer Science 2023-11-28 Antonio Di Cecco , Carlo Metta , Marco Fantozzi , Francesco Morandin , Maurizio Parton

We propose ResIST, a novel distributed training protocol for Residual Networks (ResNets). ResIST randomly decomposes a global ResNet into several shallow sub-ResNets that are trained independently in a distributed manner for several local…

Machine Learning · Computer Science 2022-03-15 Chen Dun , Cameron R. Wolfe , Christopher M. Jermaine , Anastasios Kyrillidis

Although AI-based models have achieved high accuracy in IoT threat detection, their deployment in enterprise environments is constrained by reliance on stationary datasets that fail to reflect the dynamic nature of real-world IoT NetFlow…

Machine Learning · Computer Science 2025-12-30 Hassan Wasswa , Timothy Lynar

Jointly optimizing power allocation and device association is crucial in Internet-of-Things (IoT) networks to ensure devices achieve their data throughput requirements. Device association, which assigns IoT devices to specific access points…

Information Theory · Computer Science 2024-11-18 Nguyen Xuan Tung , Trinh Van Chien , Dinh Thai Hoang , Won Joo Hwang