English
Related papers

Related papers: Efficient Processing of Deep Neural Networks: A Tu…

200 papers

With the rapid development of deep learning, Deep Spiking Neural Networks (DSNNs) have emerged as promising due to their unique spike event processing and asynchronous computation. When deployed on neuromorphic chips, DSNNs offer…

Neural and Evolutionary Computing · Computer Science 2024-07-15 Hui Xie , Ge Yang , Wenjuan Gao

Deep neural network (DNN) partition is a research problem that involves splitting a DNN into multiple parts and offloading them to specific locations. Because of the recent advancement in multi-access edge computing and edge intelligence,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-21 Di Xu , Xiang He , Tonghua Su , Zhongjie Wang

Deep neural networks (DNNs) achieve state-of-the-art performance in many areas, including computer vision, system configuration, and question-answering. However, DNNs are expensive to develop, both in intellectual effort (e.g., devising new…

Software Engineering · Computer Science 2024-04-26 James C. Davis , Purvish Jajal , Wenxin Jiang , Taylor R. Schorlemmer , Nicholas Synovic , George K. Thiruvathukal

The unprecedented performance of deep neural networks (DNNs) has led to large strides in various Artificial Intelligence (AI) inference tasks, such as object and speech recognition. Nevertheless, deploying such AI models across commodity…

Machine Learning · Computer Science 2021-06-30 Stylianos I. Venieris , Ioannis Panopoulos , Ilias Leontiadis , Iakovos S. Venieris

Deep Neural Networks (DNNs), as a subset of Machine Learning (ML) techniques, entail that real-world data can be learned and that decisions can be made in real-time. However, their wide adoption is hindered by a number of software and…

Hardware Architecture · Computer Science 2021-09-10 Kamilya Smagulova , Mohammed E. Fouda , Fadi Kurdahi , Khaled Salama , Ahmed Eltawil

The last decade of machine learning has seen drastic increases in scale and capabilities. Deep neural networks (DNNs) are increasingly being deployed in the real world. However, they are difficult to analyze, raising concerns about using…

Machine Learning · Computer Science 2023-08-22 Tilman Räuker , Anson Ho , Stephen Casper , Dylan Hadfield-Menell

Recent breakthroughs in Deep Learning (DL) applications have made DL models a key component in almost every modern computing system. The increased popularity of DL applications deployed on a wide-spectrum of platforms have resulted in a…

Machine Learning · Computer Science 2018-09-17 Diana Marculescu , Dimitrios Stamoulis , Ermao Cai

This paper describes various design considerations for deep neural networks that enable them to operate efficiently and accurately on processing-in-memory accelerators. We highlight important properties of these accelerators and the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Tien-Ju Yang , Vivienne Sze

Deep neural networks (DNNs) have been increasingly deployed on and integrated with edge devices, such as mobile phones, drones, robots and wearables. To run DNN inference directly on edge devices (a.k.a. edge inference) with a satisfactory…

Machine Learning · Computer Science 2020-09-18 Bingqian Lu , Jianyi Yang , Shaolei Ren

Applying deep neural networks (DNNs) in mobile and safety-critical systems, such as autonomous vehicles, demands a reliable and efficient execution on hardware. Optimized dedicated hardware accelerators are being developed to achieve this.…

Machine Learning · Computer Science 2019-10-01 Christoph Schorn , Thomas Elsken , Sebastian Vogel , Armin Runge , Andre Guntoro , Gerd Ascheid

In recent times, the trend in very large scale integration (VLSI) industry is multi-dimensional, for example, reduction of energy consumption, occupancy of less space, precise result, less power dissipation, faster response. To meet these…

Machine Learning · Computer Science 2021-07-02 Gaurab Bhattacharya

This work presents an in-depth analysis of the majority of the deep neural networks (DNNs) proposed in the state of the art for image recognition. For each DNN multiple performance indices are observed, such as recognition accuracy, model…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Simone Bianco , Remi Cadene , Luigi Celona , Paolo Napoletano

Deep Neural Networks (DNNs) are becoming an important tool in modern computing applications. Accelerating their training is a major challenge and techniques range from distributed algorithms to low-level circuit design. In this survey, we…

Machine Learning · Computer Science 2018-09-18 Tal Ben-Nun , Torsten Hoefler

Lightweight design, as a key approach to mitigate disparity between computational requirements of deep learning models and hardware performance, plays a pivotal role in advancing application of deep learning technologies on mobile and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Hanhua Long , Wenbin Bi , Jian Sun

Deep neural networks have proven to be particularly effective in visual and audio recognition tasks. Existing models tend to be computationally expensive and memory intensive, however, and so methods for hardware-oriented approximation have…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Erwei Wang , James J. Davis , Ruizhe Zhao , Ho-Cheung Ng , Xinyu Niu , Wayne Luk , Peter Y. K. Cheung , George A. Constantinides

Deep neural networks (DNNs) have been widely deployed across diverse domains such as computer vision and natural language processing. However, the impressive accomplishments of DNNs have been realized alongside extensive computational…

Machine Learning · Computer Science 2023-11-28 Chuangtao Chen , Grace Li Zhang , Xunzhao Yin , Cheng Zhuo , Ulf Schlichtmann , Bing Li

The recent success of Deep Neural Networks (DNNs) has drastically improved the state of the art for many application domains. While achieving high accuracy performance, deploying state-of-the-art DNNs is a challenge since they typically…

Neural and Evolutionary Computing · Computer Science 2018-01-24 Hokchhay Tann , Soheil Hashemi , Sherief Reda

As the use of AI-powered applications widens across multiple domains, so do increase the computational demands. Primary driver of AI technology are the deep neural networks (DNNs). When focusing either on cloud-based systems that serve…

Hardware Architecture · Computer Science 2022-05-20 Stylianos I. Venieris , Christos-Savvas Bouganis , Nicholas D. Lane

Deep Neural Networks (DNNs) are everywhere, frequently performing a fairly complex task that used to be unimaginable for machines to carry out. In doing so, they do a lot of decision making which, depending on the application, may be…

Machine Learning · Computer Science 2022-11-17 Avriti Chauhan , Mohammad Afzal , Hrishikesh Karmarkar , Yizhak Elboher , Kumar Madhukar , Guy Katz

Deep neural networks (DNN) have demonstrated effectiveness for various applications such as image processing, video segmentation, and speech recognition. Running state-of-the-art DNNs on current systems mostly relies on either…

Neural and Evolutionary Computing · Computer Science 2019-04-15 Mohsen Imani , Mohammad Samragh , Yeseong Kim , Saransh Gupta , Farinaz Koushanfar , Tajana Rosing