中文
相关论文

相关论文: Pruning Deep Convolutional Neural Network Using Co…

200 篇论文

Convolutional Neural Networks (CNNs) suffer from different issues, such as computational complexity and the number of parameters. In recent years pruning techniques are employed to reduce the number of operations and model size in CNNs.…

计算机视觉与模式识别 · 计算机科学 2020-01-14 Morteza Mousa Pasandi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi

Filter level pruning is an effective method to accelerate the inference speed of deep CNN models. Although numerous pruning algorithms have been proposed, there are still two open issues. The first problem is how to prune residual…

计算机视觉与模式识别 · 计算机科学 2020-04-28 Jian-Hao Luo , Jianxin Wu

Convolutional neural networks (CNNs) have demonstrated extraordinarily good performance in many computer vision tasks. The increasing size of CNN models, however, prevents them from being widely deployed to devices with limited…

计算机视觉与模式识别 · 计算机科学 2020-09-22 Guan Li , Junpeng Wang , Han-Wei Shen , Kaixin Chen , Guihua Shan , Zhonghua Lu

A well-trained Convolutional Neural Network can easily be pruned without significant loss of performance. This is because of unnecessary overlap in the features captured by the network's filters. Innovations in network architecture such as…

计算机视觉与模式识别 · 计算机科学 2019-02-26 Aaditya Prakash , James Storer , Dinei Florencio , Cha Zhang

Convolutional neural network (CNN) pruning has become one of the most successful network compression approaches in recent years. Existing works on network pruning usually focus on removing the least important filters in the network to…

计算机视觉与模式识别 · 计算机科学 2021-04-09 Zi Wang , Chengcheng Li , Xiangyang Wang

Determining the optimal size of a neural network is critical, as it directly impacts runtime performance and memory usage. Pruning is a well-established model compression technique that reduces the size of neural networks while…

机器学习 · 计算机科学 2024-09-04 Seungbeom Hu , ChanJun Park , Andrew Ferraiuolo , Sang-Ki Ko , Jinwoo Kim , Haein Song , Jieung Kim

Recently there has been a lot of work on pruning filters from deep convolutional neural networks (CNNs) with the intention of reducing computations.The key idea is to rank the filters based on a certain criterion (say, l1-norm) and retain…

机器学习 · 计算机科学 2018-12-27 Deepak Mittal , Shweta Bhardwaj , Mitesh M. Khapra , Balaraman Ravindran

We propose a new formulation for pruning convolutional kernels in neural networks to enable efficient inference. We interleave greedy criteria-based pruning with fine-tuning by backpropagation - a computationally efficient procedure that…

机器学习 · 计算机科学 2017-06-12 Pavlo Molchanov , Stephen Tyree , Tero Karras , Timo Aila , Jan Kautz

Convolutional neural networks (CNN) have achieved impressive performance on the wide variety of tasks (classification, detection, etc.) across multiple domains at the cost of high computational and memory requirements. Thus, leveraging CNNs…

计算机视觉与模式识别 · 计算机科学 2018-11-21 Pravendra Singh , Vinay Sameer Raja Kadi , Nikhil Verma , Vinay P. Namboodiri

Convolutional neural network (CNN) delivers impressive achievements in computer vision and machine learning field. However, CNN incurs high computational complexity, especially for vision quality applications because of large image…

图像与视频处理 · 电气工程与系统科学 2019-08-07 Wei-Ting Wang , Han-Lin Li , Wei-Shiang Lin , Cheng-Ming Chiang , Yi-Min Tsai

Real time application of deep learning algorithms is often hindered by high computational complexity and frequent memory accesses. Network pruning is a promising technique to solve this problem. However, pruning usually results in irregular…

神经与进化计算 · 计算机科学 2015-12-31 Sajid Anwar , Kyuyeon Hwang , Wonyong Sung

The success of CNNs in various applications is accompanied by a significant increase in the computation and parameter storage costs. Recent efforts toward reducing these overheads involve pruning and compressing the weights of various…

计算机视觉与模式识别 · 计算机科学 2017-03-13 Hao Li , Asim Kadav , Igor Durdanovic , Hanan Samet , Hans Peter Graf

Structured network pruning excels non-structured methods because they can take advantage of the thriving developed parallel computing techniques. In this paper, we propose a new structured pruning method. Firstly, to create more structured…

计算机视觉与模式识别 · 计算机科学 2023-10-11 Bojue Wang , Chunmei Ma , Bin Liu , Nianbo Liu , Jinqi Zhu

Pruning has emerged as the primary approach used to limit the resource requirements of large neural networks (NNs). Since the proposal of the lottery ticket hypothesis, researchers have focused either on pruning at initialization or after…

机器学习 · 计算机科学 2025-02-04 Charles Westphal , Stephen Hailes , Mirco Musolesi

As the need for more accurate and powerful Convolutional Neural Networks (CNNs) increases, so too does the size, execution time, memory footprint, and power consumption. To overcome this, solutions such as pruning have been proposed with…

人工智能 · 计算机科学 2026-02-20 Joseph Bingham , Sam Helmich

The remarkable performance of deep Convolutional neural networks (CNNs) is generally attributed to their deeper and wider architectures, which can come with significant computational costs. Pruning neural networks has thus gained interest…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Yang He , Lingao Xiao

To compress deep convolutional neural networks (CNNs) with large memory footprint and long inference time, this paper proposes a novel pruning criterion using layer-wised Ln-norm of feature maps. Different from existing pruning criteria,…

神经与进化计算 · 计算机科学 2018-12-11 Wei Wang , Liqiang Zhu

The enormous inference cost of deep neural networks can be scaled down by network compression. Pruning is one of the predominant approaches used for deep network compression. However, existing pruning techniques have one or more of the…

机器学习 · 计算机科学 2020-10-13 Sai Aparna Aketi , Sourjya Roy , Anand Raghunathan , Kaushik Roy

In this work, we focus on the problem of image instance retrieval with deep descriptors extracted from pruned Convolutional Neural Networks (CNN). The objective is to heavily prune convolutional edges while maintaining retrieval…

计算机视觉与模式识别 · 计算机科学 2017-07-19 Gaurav Manek , Jie Lin , Vijay Chandrasekhar , Lingyu Duan , Sateesh Giduthuri , Xiaoli Li , Tomaso Poggio

Channel pruning is a promising method for accelerating and compressing convolutional neural networks. However, current pruning algorithms still remain unsolved problems that how to assign layer-wise pruning ratios properly and discard the…

信息论 · 计算机科学 2024-09-04 Yihao Chen , Zefang Wang