中文
相关论文

相关论文: UCP: Uniform Channel Pruning for Deep Convolutiona…

200 篇论文

In this paper, we introduce a new channel pruning method to accelerate very deep convolutional neural networks. Given a trained CNN model, we propose an iterative two-step algorithm to effectively prune each layer, by a LASSO regression…

计算机视觉与模式识别 · 计算机科学 2022-11-16 Yihui He

Channel pruning is widely accepted to accelerate modern convolutional neural networks (CNNs). The resulting pruned model benefits from its immediate deployment on general-purpose software and hardware resources. However, its large pruning…

计算机视觉与模式识别 · 计算机科学 2024-03-11 Mincheol Park , Dongjin Kim , Cheonjun Park , Yuna Park , Gyeong Eun Gong , Won Woo Ro , Suhyun Kim

Nowadays, it is still difficult to adapt Convolutional Neural Network (CNN) based models for deployment on embedded devices. The heavy computation and large memory footprint of CNN models become the main burden in real application. In this…

计算机视觉与模式识别 · 计算机科学 2017-08-09 Xin Li , Changsong Liu

To address the limitations of existing magnitude-based pruning algorithms in cases where model weights or activations are of large and similar magnitude, we propose a novel perspective to discover parameter redundancy among channels and…

机器学习 · 计算机科学 2019-08-08 Yunxiang Zhang , Chenglong Zhao , Bingbing Ni , Jian Zhang , Haoran Deng

The deployment of deep convolutional neural networks (CNNs) in many real world applications is largely hindered by their high computational cost. In this paper, we propose a novel learning scheme for CNNs to simultaneously 1) reduce the…

计算机视觉与模式识别 · 计算机科学 2017-08-23 Zhuang Liu , Jianguo Li , Zhiqiang Shen , Gao Huang , Shoumeng Yan , Changshui Zhang

Deep Convolutional Neural Networks (DCNNs) have shown promising performances in several visual recognition problems which motivated the researchers to propose popular architectures such as LeNet, AlexNet, VGGNet, ResNet, and many more.…

计算机视觉与模式识别 · 计算机科学 2022-05-13 S. H. Shabbeer Basha , Mohammad Farazuddin , Viswanath Pulabaigari , Shiv Ram Dubey , Snehasis Mukherjee

Channel pruning and tensor decomposition have received extensive attention in convolutional neural network compression. However, these two techniques are traditionally deployed in an isolated manner, leading to significant accuracy drop…

计算机视觉与模式识别 · 计算机科学 2021-05-25 Yuchao Li , Shaohui Lin , Jianzhuang Liu , Qixiang Ye , Mengdi Wang , Fei Chao , Fan Yang , Jincheng Ma , Qi Tian , Rongrong Ji

Convolutional Neural Networks (CNN) are becoming a common presence in many applications and services, due to their superior recognition accuracy. They are increasingly being used on mobile devices, many times just by porting large models…

In this paper, we introduce a new channel pruning method to accelerate very deep convolutional neural networks.Given a trained CNN model, we propose an iterative two-step algorithm to effectively prune each layer, by a LASSO regression…

计算机视觉与模式识别 · 计算机科学 2017-08-22 Yihui He , Xiangyu Zhang , Jian Sun

We propose ResRep, a novel method for lossless channel pruning (a.k.a. filter pruning), which slims down a CNN by reducing the width (number of output channels) of convolutional layers. Inspired by the neurobiology research about the…

机器学习 · 计算机科学 2021-08-17 Xiaohan Ding , Tianxiang Hao , Jianchao Tan , Ji Liu , Jungong Han , Yuchen Guo , Guiguang Ding

This paper presents a novel approach to network pruning, targeting block pruning in deep neural networks for edge computing environments. Our method diverges from traditional techniques that utilize proxy metrics, instead employing a direct…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Cheng-En Wu , Azadeh Davoodi , Yu Hen Hu

Structured channel pruning has been shown to significantly accelerate inference time for convolution neural networks (CNNs) on modern hardware, with a relatively minor loss of network accuracy. Recent works permanently zero these channels…

计算机视觉与模式识别 · 计算机科学 2022-11-07 Ryan Humble , Maying Shen , Jorge Albericio Latorre , Eric Darve1 , Jose M. Alvarez

This work presents a probabilistic channel pruning method to accelerate Convolutional Neural Networks (CNNs). Previous pruning methods often zero out unimportant channels in training in a deterministic manner, which reduces CNN's learning…

机器学习 · 计算机科学 2021-05-14 Wenqi Shao , Hang Yu , Zhaoyang Zhang , Hang Xu , Zhenguo Li , Ping Luo

Although convolutional neural network (CNN) has made great progress, large redundant parameters restrict its deployment on embedded devices, especially mobile devices. The recent compression works are focused on real-value convolutional…

计算机视觉与模式识别 · 计算机科学 2019-03-07 Jiasong Wu , Hongshan Ren , Youyong Kong , Chunfeng Yang , Lotfi Senhadji , Huazhong Shu

The learning capability of a neural network improves with increasing depth at higher computational costs. Wider layers with dense kernel connectivity patterns furhter increase this cost and may hinder real-time inference. We propose feature…

机器学习 · 计算机科学 2016-11-01 Sajid Anwar , Wonyong Sung

Deep learning models, especially convolutional neural networks (CNNs), have shown considerable promise for biomedical signals such as EEG-based seizure detection. However, these models come with challenges, primarily due to their size and…

机器学习 · 计算机科学 2025-09-08 Mounvik K , N Harshit

Channel pruning is one of the major compression approaches for deep neural networks. While previous pruning methods have mostly focused on identifying unimportant channels, channel pruning is considered as a special case of neural…

计算机视觉与模式识别 · 计算机科学 2021-09-15 Xiangcheng Liu , Jian Cao , Hongyi Yao , Wenyu Sun , Yuan Zhang

This paper proposed a Soft Filter Pruning (SFP) method to accelerate the inference procedure of deep Convolutional Neural Networks (CNNs). Specifically, the proposed SFP enables the pruned filters to be updated when training the model after…

计算机视觉与模式识别 · 计算机科学 2018-08-22 Yang He , Guoliang Kang , Xuanyi Dong , Yanwei Fu , Yi Yang

Deep learning harnesses massive parallel floating-point processing to train and evaluate large neural networks. Trends indicate that deeper and larger neural networks with an increasing number of parameters achieve higher accuracy than…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Brad Larson , Bishal Upadhyaya , Luke McDermott , Siddha Ganju

Despite the promising results of convolutional neural networks (CNNs), their application on devices with limited resources is still a big challenge; this is mainly due to the huge memory and computation requirements of the CNN. To counter…

机器学习 · 计算机科学 2020-03-04 Csanád Sándor , Szabolcs Pável , Lehel Csató