中文
相关论文

相关论文: Functionality-Oriented Convolutional Filter Prunin…

200 篇论文

Convolutional neural networks (CNNs) are able to attain better visual recognition performance than fully connected neural networks despite having much fewer parameters due to their parameter sharing principle. Modern architectures usually…

计算机视觉与模式识别 · 计算机科学 2022-10-20 Ilke Cugu , Emre Akbas

The goal of filter pruning is to search for unimportant filters to remove in order to make convolutional neural networks (CNNs) efficient without sacrificing the performance in the process. The challenge lies in finding information that can…

计算机视觉与模式识别 · 计算机科学 2022-04-26 Junghun Oh , Heewon Kim , Sungyong Baik , Cheeun Hong , Kyoung Mu Lee

The redundancy is widely recognized in Convolutional Neural Networks (CNNs), which enables to remove unimportant filters from convolutional layers so as to slim the network with acceptable performance drop. Inspired by the linear and…

机器学习 · 计算机科学 2019-04-09 Xiaohan Ding , Guiguang Ding , Yuchen Guo , Jungong Han

A well-trained Convolutional Neural Network can easily be pruned without significant loss of performance. This is because of unnecessary overlap in the features captured by the network's filters. Innovations in network architecture such as…

计算机视觉与模式识别 · 计算机科学 2019-02-26 Aaditya Prakash , James Storer , Dinei Florencio , Cha Zhang

Deep convolutional neural networks (CNNs) have been successful in many tasks in machine vision, however, millions of weights in the form of thousands of convolutional filters in CNNs makes them difficult for human intepretation or…

计算机视觉与模式识别 · 计算机科学 2020-03-26 Reza Abbasi-Asl , Bin Yu

Convolutional Neural Networks (CNNs) are state-of-the-art in numerous computer vision tasks such as object classification and detection. However, the large amount of parameters they contain leads to a high computational complexity and…

机器学习 · 计算机科学 2019-01-01 Ghouthi Boukli Hacene , Vincent Gripon , Matthieu Arzel , Nicolas Farrugia , Yoshua Bengio

Recently there has been a lot of work on pruning filters from deep convolutional neural networks (CNNs) with the intention of reducing computations.The key idea is to rank the filters based on a certain criterion (say, l1-norm) and retain…

机器学习 · 计算机科学 2018-12-27 Deepak Mittal , Shweta Bhardwaj , Mitesh M. Khapra , Balaraman Ravindran

Convolutional neural networks (CNNs) have demonstrated extraordinarily good performance in many computer vision tasks. The increasing size of CNN models, however, prevents them from being widely deployed to devices with limited…

计算机视觉与模式识别 · 计算机科学 2020-09-22 Guan Li , Junpeng Wang , Han-Wei Shen , Kaixin Chen , Guihua Shan , Zhonghua Lu

The deployment of Convolutional Neural Networks (CNNs) on resource constrained platforms such as mobile devices and embedded systems has been greatly hindered by their high implementation cost, and thus motivated a lot research interest in…

计算机视觉与模式识别 · 计算机科学 2019-08-12 Boyu Zhang , Azadeh Davoodi , Yu Hen Hu

Filter pruning is effective to reduce the computational costs of neural networks. Existing methods show that updating the previous pruned filter would enable large model capacity and achieve better performance. However, during the iterative…

计算机视觉与模式识别 · 计算机科学 2022-02-14 Yang He , Ping Liu , Linchao Zhu , Yi Yang

Despite the promising results of convolutional neural networks (CNNs), their application on devices with limited resources is still a big challenge; this is mainly due to the huge memory and computation requirements of the CNN. To counter…

机器学习 · 计算机科学 2020-03-04 Csanád Sándor , Szabolcs Pável , Lehel Csató

Channel pruning is widely accepted to accelerate modern convolutional neural networks (CNNs). The resulting pruned model benefits from its immediate deployment on general-purpose software and hardware resources. However, its large pruning…

计算机视觉与模式识别 · 计算机科学 2024-03-11 Mincheol Park , Dongjin Kim , Cheonjun Park , Yuna Park , Gyeong Eun Gong , Won Woo Ro , Suhyun Kim

Convolutional Neural Network (CNN) has an amount of parameter redundancy, filter pruning aims to remove the redundant filters and provides the possibility for the application of CNN on terminal devices. However, previous works pay more…

计算机视觉与模式识别 · 计算机科学 2021-12-15 Pengkun Liu , Yaru Yue , Yanjun Guo , Xingxiang Tao , Xiaoguang Zhou

Structured network pruning is a practical approach to reduce computation cost directly while retaining the CNNs' generalization performance in real applications. However, identifying redundant filters is a core problem in structured network…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Wenting Tang , Xingxing Wei , Bo Li

We introduce a class of convolutional neural networks (CNNs) that utilize recurrent neural networks (RNNs) as convolution filters. A convolution filter is typically implemented as a linear affine transformation followed by a non-linear…

计算与语言 · 计算机科学 2018-08-29 Yi Yang

This paper considers a convolutional neural network transformation that reduces computation complexity and thus speedups neural network processing. Usage of convolutional neural networks (CNN) is the standard approach to image recognition…

计算机视觉与模式识别 · 计算机科学 2020-02-19 Elena Limonova , Alexander Sheshkus , Dmitry Nikolaev

Real time application of deep learning algorithms is often hindered by high computational complexity and frequent memory accesses. Network pruning is a promising technique to solve this problem. However, pruning usually results in irregular…

神经与进化计算 · 计算机科学 2015-12-31 Sajid Anwar , Kyuyeon Hwang , Wonyong Sung

Most existing channel pruning methods formulate the pruning task from a perspective of inefficiency reduction which iteratively rank and remove the least important filters, or find the set of filters that minimizes some reconstruction…

计算机视觉与模式识别 · 计算机科学 2019-07-17 Chengcheng Li , Zi Wang , Dali Wang , Xiangyang Wang , Hairong Qi

Structural pruning of neural network parameters reduces computation, energy, and memory transfer costs during inference. We propose a novel method that estimates the contribution of a neuron (filter) to the final loss and iteratively…

机器学习 · 计算机科学 2019-06-27 Pavlo Molchanov , Arun Mallya , Stephen Tyree , Iuri Frosio , Jan Kautz

Deep Convolutional Neural Networks (CNNs) are widely employed in modern computer vision algorithms, where the input image is convolved iteratively by many kernels to extract the knowledge behind it. However, with the depth of convolutional…

计算机视觉与模式识别 · 计算机科学 2018-04-11 Chih-Ting Liu , Yi-Heng Wu , Yu-Sheng Lin , Shao-Yi Chien