中文
相关论文

相关论文: Network Implosion: Effective Model Compression for…

200 篇论文

Deep residual networks have recently shown appealing performance on many challenging computer vision tasks. However, the original residual structure still has some defects making it difficult to converge on very deep networks. In this…

计算机视觉与模式识别 · 计算机科学 2016-05-31 Falong Shen , Gang Zeng

A convolutional layer in a Convolutional Neural Network (CNN) consists of many filters which apply convolution operation to the input, capture some special patterns and pass the result to the next layer. If the same patterns also occur at…

计算机视觉与模式识别 · 计算机科学 2019-02-04 Okan Köpüklü , Maryam Babaee , Stefan Hörmann , Gerhard Rigoll

Convolutional neural network (CNN) is a class of artificial neural networks widely used in computer vision tasks. Most CNNs achieve excellent performance by stacking certain types of basic units. In addition to increasing the depth and…

计算机视觉与模式识别 · 计算机科学 2021-02-09 Junyi An , Fengshan Liu , Jian Zhao , Furao Shen

Deeper neural networks are more difficult to train. We present a residual learning framework to ease the training of networks that are substantially deeper than those used previously. We explicitly reformulate the layers as learning…

计算机视觉与模式识别 · 计算机科学 2015-12-11 Kaiming He , Xiangyu Zhang , Shaoqing Ren , Jian Sun

The deployment of deep convolutional neural networks (CNNs) in many real world applications is largely hindered by their high computational cost. In this paper, we propose a novel learning scheme for CNNs to simultaneously 1) reduce the…

计算机视觉与模式识别 · 计算机科学 2017-08-23 Zhuang Liu , Jianguo Li , Zhiqiang Shen , Gao Huang , Shoumeng Yan , Changshui Zhang

Convolutional neural network (CNN) pruning has become one of the most successful network compression approaches in recent years. Existing works on network pruning usually focus on removing the least important filters in the network to…

计算机视觉与模式识别 · 计算机科学 2021-04-09 Zi Wang , Chengcheng Li , Xiangyang Wang

Pruning neural networks has regained interest in recent years as a means to compress state-of-the-art deep neural networks and enable their deployment on resource-constrained devices. In this paper, we propose a robust compressive learning…

机器学习 · 计算机科学 2020-06-05 George Retsinas , Athena Elafrou , Georgios Goumas , Petros Maragos

The paradigm of automated waste classification has recently seen a shift in the domain of interest from conventional image processing techniques to powerful computer vision algorithms known as convolutional neural networks (CNN).…

计算机视觉与模式识别 · 计算机科学 2021-10-25 Mazin Abdulmahmood , Ryan Grammenos

Convolutional neural networks have been proven effective in a variety of image restoration tasks. Most state-of-the-art solutions, however, are trained using images with a single particular degradation level, and their performance…

计算机视觉与模式识别 · 计算机科学 2021-01-12 Yiwen Guo , Ming Lu , Wangmeng Zuo , Changshui Zhang , Yurong Chen

Neuron pruning is an efficient method to compress the network into a slimmer one for reducing the computational cost and storage overhead. Most of state-of-the-art results are obtained in a layer-by-layer optimization mode. It discards the…

计算机视觉与模式识别 · 计算机科学 2018-12-18 Weijie Chen , Yuan Zhang , Di Xie , Shiliang Pu

ResNets (or Residual Networks) are one of the most commonly used models for image classification tasks. In this project, we design and train a modified ResNet model for CIFAR-10 image classification. In particular, we aimed at maximizing…

计算机视觉与模式识别 · 计算机科学 2023-06-22 Aditya Thakur , Harish Chauhan , Nikunj Gupta

A well-trained Convolutional Neural Network can easily be pruned without significant loss of performance. This is because of unnecessary overlap in the features captured by the network's filters. Innovations in network architecture such as…

计算机视觉与模式识别 · 计算机科学 2019-02-26 Aaditya Prakash , James Storer , Dinei Florencio , Cha Zhang

Residual neural networks (ResNets) are a promising class of deep neural networks that have shown excellent performance for a number of learning tasks, e.g., image classification and recognition. Mathematically, ResNet architectures can be…

最优化与控制 · 数学 2019-07-26 S. Günther , L. Ruthotto , J. B. Schroder , E. C. Cyr , N. R. Gauger

Network compression is crucial to making the deep networks to be more efficient, faster, and generalizable to low-end hardware. Current network compression methods have two open problems: first, there lacks a theoretical framework to…

机器学习 · 计算机科学 2022-06-09 Ziqi Zhou , Li Lian , Yilong Yin , Ze Wang

Network pruning is one of the most dominant methods for reducing the heavy inference cost of deep neural networks. Existing methods often iteratively prune networks to attain high compression ratio without incurring significant loss in…

计算机视觉与模式识别 · 计算机科学 2020-08-17 Duong H. Le , Trung-Nhan Vo , Nam Thoai

Channel pruning, which seeks to reduce the model size by removing redundant channels, is a popular solution for deep networks compression. Existing channel pruning methods usually conduct layer-wise channel selection by directly minimizing…

计算机视觉与模式识别 · 计算机科学 2019-05-14 Yiming Hu , Siyang Sun , Jianquan Li , Jiagang Zhu , Xingang Wang , Qingyi Gu

Convolutional neural networks show outstanding results in a variety of computer vision tasks. However, a neural network architecture design usually faces a trade-off between model performance and computational/memory complexity. For some…

计算机视觉与模式识别 · 计算机科学 2020-06-12 Pavel Kaloshin

Convolutional Neural Networks (CNN) increase depth by stacking convolutional layers, and deeper network models perform better in image recognition. Empirical research shows that simply stacking convolutional layers does not make the network…

计算机视觉与模式识别 · 计算机科学 2022-11-16 Rui-Yang Ju , Jen-Shiun Chiang , Chih-Chia Chen , Yu-Shian Lin

This paper shows that it is possible to train large and deep convolutional neural networks (CNN) for JPEG compression artifacts reduction, and that such networks can provide significantly better reconstruction quality compared to previously…

计算机视觉与模式识别 · 计算机科学 2016-05-03 Pavel Svoboda , Michal Hradis , David Barina , Pavel Zemcik

Residual networks (Resnets) have become a prominent architecture in deep learning. However, a comprehensive understanding of Resnets is still a topic of ongoing research. A recent view argues that Resnets perform iterative refinement of…

计算机视觉与模式识别 · 计算机科学 2018-03-09 Stanisław Jastrzębski , Devansh Arpit , Nicolas Ballas , Vikas Verma , Tong Che , Yoshua Bengio