English
Related papers

Related papers: Hardware-Aware DNN Compression for Homogeneous Edg…

200 papers

Neural networks can be drastically shrunk in size by removing redundant parameters. While crucial for the deployment on resource-constraint hardware, oftentimes, compression comes with a severe drop in accuracy and lack of adversarial…

Machine Learning · Computer Science 2024-12-20 Qi Zhao , Christian Wressnegger

Deep Neural Networks (DNNs) have been established as the state-of-the-art algorithm for advanced machine learning applications. Recently proposed by the Google Brain's team, the Capsule Networks (CapsNets) have improved the generalization…

Machine Learning · Computer Science 2021-01-26 Alberto Marchisio , Vojtech Mrazek , Muhammad Abdullah Hanif , Muhammad Shafique

Neural Networks (NN) provide a solid and reliable way of executing different types of applications, ranging from speech recognition to medical diagnosis, speeding up onerous and long workloads. The challenges involved in their…

Hardware Architecture · Computer Science 2023-09-26 Federico Manca , Francesco Ratto

Deep Neural Networks (DNNs), as a subset of Machine Learning (ML) techniques, entail that real-world data can be learned and that decisions can be made in real-time. However, their wide adoption is hindered by a number of software and…

Hardware Architecture · Computer Science 2021-09-10 Kamilya Smagulova , Mohammed E. Fouda , Fadi Kurdahi , Khaled Salama , Ahmed Eltawil

This paper proposes a hardware-oriented dropout algorithm, which is efficient for field programmable gate array (FPGA) implementation. In deep neural networks (DNNs), overfitting occurs when networks are overtrained and adapt too well to…

Machine Learning · Computer Science 2019-11-15 Yoeng Jye Yeoh , Takashi Morie , Hakaru Tamukoh

While Deep Neural Networks (DNNs) push the state-of-the-art in many machine learning applications, they often require millions of expensive floating-point operations for each input classification. This computation overhead limits the…

Neural and Evolutionary Computing · Computer Science 2017-05-12 Hokchhay Tann , Soheil Hashemi , Iris Bahar , Sherief Reda

Edge inference has become more widespread, as its diverse applications range from retail to wearable technology. Clusters of networked resource-constrained edge devices are becoming common, yet no system exists to split a DNN across these…

Networking and Internet Architecture · Computer Science 2022-10-25 Arjun Parthasarathy , Bhaskar Krishnamachari

Deep neural network (DNN) inference is increasingly being executed on mobile and embedded platforms due to low latency and better privacy. However, efficient deployment on these platforms is challenging due to the intensive computation and…

Hardware Architecture · Computer Science 2022-06-08 Lei Xun , Bashir M. Al-Hashimi , Jonathon Hare , Geoff V. Merrett

Spiking Neural Networks (SNNs) are amenable to deployment on edge devices and neuromorphic hardware due to their lower dissipation. Recently, SNN-based transformers have garnered significant interest, incorporating attention mechanisms akin…

Neural and Evolutionary Computing · Computer Science 2024-12-10 Boxun Xu , Yufei Song , Peng Li

Partitioning and distributing deep neural networks (DNNs) across end-devices, edge resources and the cloud has a potential twofold advantage: preserving privacy of the input data, and reducing the ingress bandwidth demand beyond the edge.…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-18 Luke Lockhart , Paul Harvey , Pierre Imai , Peter Willis , Blesson Varghese

Deep learning inference on streaming media data, such as object detection in video or LiDAR feeds and text extraction from audio waves, is now ubiquitous. To achieve high inference accuracy, these applications typically require significant…

Machine Learning · Computer Science 2024-12-13 Kuntai Du , Yuhan Liu , Yitian Hao , Qizheng Zhang , Haodong Wang , Yuyang Huang , Ganesh Ananthanarayanan , Junchen Jiang

Motion sensors embedded in wearable and mobile devices allow for dynamic selection of sensor streams and sampling rates, enabling several applications, such as power management and data-sharing control. While deep neural networks (DNNs)…

Machine Learning · Computer Science 2021-08-13 Mohammad Malekzadeh , Richard G. Clegg , Andrea Cavallaro , Hamed Haddadi

This paper addresses the computational offloading of Deep Neural Networks (DNNs) to nearby devices with similar processing capabilities, to avoid the larger communication delays incurred for cloud offloading. We present a preemption aware…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-24 Jamie Cotter , Ignacio Castineiras , Donna O'Shea , Victor Cionca

This paper presents a solution to address carbon emission mitigation for end-to-end edge computing systems, including the computing at battery-powered edge devices and servers, as well as the communications between them. We design and…

Networking and Internet Architecture · Computer Science 2024-04-29 Hongyu Ke , Wanxin Jin , Haoxin Wang

Deep neural networks (DNNs) have the advantage that they can take into account a large number of parameters, which enables them to solve complex tasks. In computer vision and speech recognition, they have a better accuracy than common…

Machine Learning · Computer Science 2021-04-20 Lukas Baischer , Matthias Wess , Nima TaheriNejad

Convolutional neural networks (CNNs) have recently become the state-of-the-art in a diversity of AI tasks. Despite their popularity, CNN inference still comes at a high computational cost. A growing body of work aims to alleviate this by…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Stefanos Laskaridis , Stylianos I. Venieris , Hyeji Kim , Nicholas D. Lane

With a growing need to enable intelligence in embedded devices in the Internet of Things (IoT) era, secure hardware implementation of Deep Neural Networks (DNNs) has become imperative. We will focus on how to address adversarial robustness…

Machine Learning · Computer Science 2021-09-08 Abhiroop Bhattacharjee , Abhishek Moitra , Priyadarshini Panda

For time-critical IoT applications using deep learning, inference acceleration through distributed computing is a promising approach to meet a stringent deadline. In this paper, we implement a working prototype of a new distributed…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Zhongtian Dong , Nan Li , Alexandros Iosifidis , Qi Zhang

DNN pruning is a popular way to reduce the size of a model, improve the inference latency, and minimize the power consumption on DNN accelerators. However, existing approaches might be too complex, expensive or ineffective to apply to a…

Machine Learning · Computer Science 2023-11-21 Minsik Cho , Saurabh Adya , Devang Naik

Recent advances in Artificial Intelligence (AI) on the Internet of Things (IoT)-enabled network edge has realized edge intelligence in several applications such as smart agriculture, smart hospitals, and smart factories by enabling…

Machine Learning · Computer Science 2024-01-18 Muhammad Zawish , Steven Davy , Lizy Abraham