English
Related papers

Related papers: ACP: Automatic Channel Pruning via Clustering and …

200 papers

Channel Pruning has been long studied to compress CNNs, which significantly reduces the overall computation. Prior works implement channel pruning in an unexplainable manner, which tends to reduce the final classification errors while…

Computer Vision and Pattern Recognition · Computer Science 2022-01-31 Yuxin Zhang , Mingbao Lin , Chia-Wen Lin , Jie Chen , Feiyue Huang , Yongjian Wu , Yonghong Tian , Rongrong Ji

Convolutional neural networks (CNNs) have succeeded in many practical applications. However, their high computation and storage requirements often make them difficult to deploy on resource-constrained devices. In order to tackle this issue,…

Machine Learning · Computer Science 2022-01-14 Tianzong Yu , Chunyuan Zhang , Yuan Wang , Meng Ma , Qi Song

In this paper, we introduce a new channel pruning method to accelerate very deep convolutional neural networks.Given a trained CNN model, we propose an iterative two-step algorithm to effectively prune each layer, by a LASSO regression…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Yihui He , Xiangyu Zhang , Jian Sun

This paper aims to simultaneously accelerate and compress off-the-shelf CNN models via filter pruning strategy. The importance of each filter is evaluated by the proposed entropy-based method first. Then several unimportant filters are…

Computer Vision and Pattern Recognition · Computer Science 2017-06-20 Jian-Hao Luo , Jianxin Wu

Pruning redundant filters in CNN models has received growing attention. In this paper, we propose an adaptive binary search-first hybrid pyramid- and clustering-based (ABSHPC-based) method for pruning filters automatically. In our method,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Kuo-Liang Chung , Yu-Lun Chang , Bo-Wei Tsai

Channel pruning is widely used to reduce the complexity of deep network models. Recent pruning methods usually identify which parts of the network to discard by proposing a channel importance criterion. However, recent studies have shown…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Yuanzhi Duan , Yue Zhou , Peng He , Qiang Liu , Shukai Duan , Xiaofang Hu

During the last years, algorithms known as Convolutional Neural Networks (CNNs) had become increasingly popular, expanding its application range to several areas. In particular, the image processing field has experienced a remarkable…

Hardware Architecture · Computer Science 2024-08-27 Federico Nicolas Peccia , Luciano Ferreyro , Alejandro Furfaro

We propose ResRep, a novel method for lossless channel pruning (a.k.a. filter pruning), which slims down a CNN by reducing the width (number of output channels) of convolutional layers. Inspired by the neurobiology research about the…

Machine Learning · Computer Science 2021-08-17 Xiaohan Ding , Tianxiang Hao , Jianchao Tan , Ji Liu , Jungong Han , Yuchen Guo , Guiguang Ding

Structural neural network pruning aims to remove the redundant channels in the deep convolutional neural networks (CNNs) by pruning the filters of less importance to the final output accuracy. To reduce the degradation of performance after…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Nanfei Jiang , Xu Zhao , Chaoyang Zhao , Yongqi An , Ming Tang , Jinqiao Wang

Convolutional Neural Networks (CNNs) have demonstrated exceptional performance in recent years. Compressing these models not only reduces storage requirements, making deployment to edge devices feasible, but also accelerates inference,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Boyao Wang , Volodymyr Kindratenko

Convolutional neural networks (CNNs) are reported to be overparametrized. The search for optimal (minimal) and sufficient architecture is an NP-hard problem as the hyperparameter space for possible network configurations is vast. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Tin Barisin , Illia Horenko

Channel pruning is a promising method for accelerating and compressing convolutional neural networks. However, current pruning algorithms still remain unsolved problems that how to assign layer-wise pruning ratios properly and discard the…

Information Theory · Computer Science 2024-09-04 Yihao Chen , Zefang Wang

We present a provable, sampling-based approach for generating compact Convolutional Neural Networks (CNNs) by identifying and removing redundant filters from an over-parameterized network. Our algorithm uses a small batch of input data…

Machine Learning · Computer Science 2020-03-24 Lucas Liebenwein , Cenk Baykal , Harry Lang , Dan Feldman , Daniela Rus

Convolutional Neural Networks (CNNs) are state-of-the-art in numerous computer vision tasks such as object classification and detection. However, the large amount of parameters they contain leads to a high computational complexity and…

Machine Learning · Computer Science 2019-01-01 Ghouthi Boukli Hacene , Vincent Gripon , Matthieu Arzel , Nicolas Farrugia , Yoshua Bengio

Convolution neural networks (CNNs) have shown great success in various applications. However, the computational complexity and memory storage of CNNs is a bottleneck for their deployment on resource-constrained devices. Recent efforts…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Arshdeep Singh , Mark D. Plumbley

Despite recent progress, computational visual aesthetic is still challenging. Image cropping, which refers to the removal of unwanted scene areas, is an important step to improve the aesthetic quality of an image. However, it is challenging…

Computer Vision and Pattern Recognition · Computer Science 2018-01-16 Guanjun Guo , Hanzi Wang , Chunhua Shen , Yan Yan , Hong-Yuan Mark Liao

Soft filter pruning~(SFP) has emerged as an effective pruning technique for allowing pruned filters to update and the opportunity for them to regrow to the network. However, this pruning strategy applies training and pruning in an…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jingyang Xiang , Zhuangzhi Chen , Jianbiao Mei , Siqi Li , Jun Chen , Yong Liu

Structured pruning methods are developed to bridge the gap between the massive scale of neural networks and the limited hardware resources. Most current structured pruning methods rely on training datasets to fine-tune the compressed model,…

Machine Learning · Computer Science 2024-03-14 Siqi Li , Jun Chen , Jingyang Xiang , Chengrui Zhu , Yong Liu

The success of CNNs in various applications is accompanied by a significant increase in the computation and parameter storage costs. Recent efforts toward reducing these overheads involve pruning and compressing the weights of various…

Computer Vision and Pattern Recognition · Computer Science 2017-03-13 Hao Li , Asim Kadav , Igor Durdanovic , Hanan Samet , Hans Peter Graf

This paper describes a channel-selection approach for simplifying deep neural networks. Specifically, we propose a new type of generic network layer, called pruning layer, to seamlessly augment a given pre-trained model for compression.…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Chih-Yao Chiu , Hwann-Tzong Chen , Tyng-Luh Liu
‹ Prev 1 3 4 5 6 7 10 Next ›