English
Related papers

Related papers: Efficient Network Construction through Structural …

200 papers

Deep Neural Networks (DNNs) are the key to the state-of-the-art machine vision, sensor fusion and audio/video signal processing. Unfortunately, their computation complexity and tight resource constraints on the Edge make them hard to…

Machine Learning · Computer Science 2017-12-05 Ranko Sredojevic , Shaoyi Cheng , Lazar Supic , Rawan Naous , Vladimir Stojanovic

State-of-the-art convolutional neural networks (CNNs) used in vision applications have large models with numerous weights. Training these models is very compute- and memory-resource intensive. Much research has been done on pruning or…

Machine Learning · Computer Science 2019-12-10 Sangkug Lym , Esha Choukse , Siavash Zangeneh , Wei Wen , Sujay Sanghavi , Mattan Erez

The challenge of speeding up deep learning models during the deployment phase has been a large, expensive bottleneck in the modern tech industry. In this paper, we examine the use of both regularization and pruning for reduced computational…

Machine Learning · Computer Science 2020-04-10 Tai Vu , Emily Wen , Roy Nehoran

Overparameterization has been shown to benefit both the optimization and generalization of neural networks, but large networks are resource hungry at both training and test time. Network pruning can reduce test-time resource requirements,…

Machine Learning · Computer Science 2020-08-10 Chaoqi Wang , Guodong Zhang , Roger Grosse

Deep neural networks (DNNs) are nowadays witnessing a major success in solving many pattern recognition tasks including skeleton-based classification. The deployment of DNNs on edge-devices, endowed with limited time and memory resources,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Hichem Sahbi

This paper investigates efficient deep neural networks (DNNs) to replace dense unstructured weight matrices with structured ones that possess desired properties. The challenge arises because the optimal weight matrix structure in popular…

Machine Learning · Computer Science 2024-03-11 Changwoo Lee , Hun-Seok Kim

Structured pruning greatly eases the deployment of large neural networks in resource-constrained environments. However, current methods either involve strong domain expertise, require extra hyperparameter tuning, or are restricted only to a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Qingyuan Li , Bo Zhang , Xiangxiang Chu

Recently there has been a lot of work on pruning filters from deep convolutional neural networks (CNNs) with the intention of reducing computations. The key idea is to rank the filters based on a certain criterion (say, $l_1$-norm, average…

Computer Vision and Pattern Recognition · Computer Science 2018-02-01 Deepak Mittal , Shweta Bhardwaj , Mitesh M. Khapra , Balaraman Ravindran

Deep neural networks (DNNs) have demonstrated remarkable success in various fields. However, the large number of floating-point operations (FLOPs) in DNNs poses challenges for their deployment in resource-constrained applications, e.g.,…

Artificial Intelligence · Computer Science 2024-02-20 Mengnan Jiang , Jingcun Wang , Amro Eldebiky , Xunzhao Yin , Cheng Zhuo , Ing-Chao Lin , Grace Li Zhang

Deep Neural Networks (DNNs) have revolutionized numerous applications, but the demand for ever more performance remains unabated. Scaling DNN computations to larger clusters is generally done by distributing tasks in batch mode using…

Machine Learning · Computer Science 2020-06-23 Tong Geng , Tianqi Wang , Ang Li , Xi Jin , Martin Herbordt

Convolutional Neural Networks (CNNs) have a large number of parameters and take significantly large hardware resources to compute, so edge devices struggle to run high-level networks. This paper proposes a novel method to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Athul Shibu , Abhishek Kumar , Heechul Jung , Dong-Gyu Lee

Weight pruning methods of DNNs have been demonstrated to achieve a good model pruning rate without loss of accuracy, thereby alleviating the significant computation/storage requirements of large-scale DNNs. Structured weight pruning methods…

Neural and Evolutionary Computing · Computer Science 2019-03-28 Tianyun Zhang , Shaokai Ye , Kaiqi Zhang , Xiaolong Ma , Ning Liu , Linfeng Zhang , Jian Tang , Kaisheng Ma , Xue Lin , Makan Fardad , Yanzhi Wang

We show how solution concepts from cooperative game theory can be used to tackle the problem of pruning neural networks. The ever-growing size of deep neural networks (DNNs) increases their performance, but also their computational…

Machine Learning · Computer Science 2023-11-20 Mauricio Diaz-Ortiz , Benjamin Kempinski , Daphne Cornelisse , Yoram Bachrach , Tal Kachman

The training phases of Deep neural network~(DNN) consumes enormous processing time and energy. Compression techniques utilizing the sparsity of DNNs can effectively accelerate the inference phase of DNNs. However, it is hardly used in the…

Machine Learning · Computer Science 2022-03-14 Zhuoran Song , Yihong Xu , Han Li , Naifeng Jing , Xiaoyao Liang , Li Jiang

Convolutional neural network (CNN) pruning has become one of the most successful network compression approaches in recent years. Existing works on network pruning usually focus on removing the least important filters in the network to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Zi Wang , Chengcheng Li , Xiangyang Wang

Unstructured neural network pruning algorithms have achieved impressive compression rates. However, the resulting - typically irregular - sparse matrices hamper efficient hardware implementations, leading to additional memory usage and…

Pruning is a legitimate method for reducing the size of a neural network to fit in low SWaP hardware, but the networks must be trained and pruned offline. We propose an algorithm, Artificial Neurogenesis (ANG), that grows rather than prunes…

Neural and Evolutionary Computing · Computer Science 2020-06-12 John Mixter , Ali Akoglu

The demand for efficient processing of deep neural networks (DNNs) on embedded devices is a significant challenge limiting their deployment. Exploiting sparsity in the network's feature maps is one of the ways to reduce its inference…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Matteo Grimaldi , Darshan C. Ganji , Ivan Lazarevich , Sudhakar Sah

Structured pruning and quantization are fundamental techniques used to reduce the size of deep neural networks (DNNs) and typically are applied independently. Applying these techniques jointly via co-optimization has the potential to…

Machine Learning · Computer Science 2025-02-25 Xiaoyi Qu , David Aponte , Colby Banbury , Daniel P. Robinson , Tianyu Ding , Kazuhito Koishida , Ilya Zharkov , Tianyi Chen

Recently several structured pruning techniques have been introduced for energy-efficient implementation of Deep Neural Networks (DNNs) with lesser number of crossbars. Although, these techniques have claimed to preserve the accuracy of the…

Machine Learning · Computer Science 2022-01-17 Abhiroop Bhattacharjee , Lakshya Bhatnagar , Priyadarshini Panda