中文
相关论文

相关论文: Blending Pruning Criteria for Convolutional Neural…

200 篇论文

Recently there has been a lot of work on pruning filters from deep convolutional neural networks (CNNs) with the intention of reducing computations.The key idea is to rank the filters based on a certain criterion (say, l1-norm) and retain…

机器学习 · 计算机科学 2018-12-27 Deepak Mittal , Shweta Bhardwaj , Mitesh M. Khapra , Balaraman Ravindran

Resource-efficient convolution neural networks enable not only the intelligence on edge devices but also opportunities in system-level optimization such as scheduling. In this work, we aim to improve the performance of resource-constrained…

计算机视觉与模式识别 · 计算机科学 2018-10-19 Ting-Wu Chin , Cha Zhang , Diana Marculescu

With the general trend of increasing Convolutional Neural Network (CNN) model sizes, model compression and acceleration techniques have become critical for the deployment of these models on edge devices. In this paper, we provide a…

机器学习 · 计算机科学 2020-05-12 Jiayi Liu , Samarth Tripathi , Unmesh Kurup , Mohak Shah

Convolutional Neural Networks (CNNs) suffer from different issues, such as computational complexity and the number of parameters. In recent years pruning techniques are employed to reduce the number of operations and model size in CNNs.…

计算机视觉与模式识别 · 计算机科学 2020-01-14 Morteza Mousa Pasandi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi

Based on filter magnitude ranking (e.g. L1 norm), conventional filter pruning methods for Convolutional Neural Networks (CNNs) have been proved with great effectiveness in computation load reduction. Although effective, these methods are…

计算机视觉与模式识别 · 计算机科学 2018-11-08 Zhuwei Qin , Fuxun Yu , ChenChen Liu , Xiang Chen

Most neural network pruning methods, such as filter-level and layer-level prunings, prune the network model along one dimension (depth, width, or resolution) solely to meet a computational budget. However, such a pruning policy often leads…

计算机视觉与模式识别 · 计算机科学 2021-06-16 Wenxiao Wang , Minghao Chen , Shuai Zhao , Long Chen , Jinming Hu , Haifeng Liu , Deng Cai , Xiaofei He , Wei Liu

Recent advances in pruning of neural networks have made it possible to remove a large number of filters or weights without any perceptible drop in accuracy. The number of parameters and that of FLOPs are usually the reported metrics to…

计算机视觉与模式识别 · 计算机科学 2020-11-10 Sara Elkerdawy , Mostafa Elhoushi , Abhineet Singh , Hong Zhang , Nilanjan Ray

Nowadays, it is still difficult to adapt Convolutional Neural Network (CNN) based models for deployment on embedded devices. The heavy computation and large memory footprint of CNN models become the main burden in real application. In this…

计算机视觉与模式识别 · 计算机科学 2017-08-09 Xin Li , Changsong Liu

Convolutional neural network (CNN) delivers impressive achievements in computer vision and machine learning field. However, CNN incurs high computational complexity, especially for vision quality applications because of large image…

图像与视频处理 · 电气工程与系统科学 2019-08-07 Wei-Ting Wang , Han-Lin Li , Wei-Shiang Lin , Cheng-Ming Chiang , Yi-Min Tsai

The deployment of Convolutional Neural Networks (CNNs) on resource constrained platforms such as mobile devices and embedded systems has been greatly hindered by their high implementation cost, and thus motivated a lot research interest in…

计算机视觉与模式识别 · 计算机科学 2019-08-12 Boyu Zhang , Azadeh Davoodi , Yu Hen Hu

Convolutional neural networks (CNN) play a major role in image processing tasks like image classification, object detection, semantic segmentation. Very often CNN networks have from several to hundred stacked layers with several megabytes…

机器学习 · 计算机科学 2020-02-18 Marcin Pietron , Maciej Wielgosz

In recent years, deep neural networks have known a wide success in various application domains. However, they require important computational and memory resources, which severely hinders their deployment, notably on mobile devices or for…

计算机视觉与模式识别 · 计算机科学 2021-12-16 Nathan Hubens , Matei Mancas , Bernard Gosselin , Marius Preda , Titus Zaharia

Recent network pruning methods focus on pruning models early-on in training. To estimate the impact of removing a parameter, these methods use importance measures that were originally designed to prune trained models. Despite lacking…

机器学习 · 计算机科学 2021-09-24 Ekdeep Singh Lubana , Robert P. Dick

Computer-assisted treatment has emerged as a viable application of medical imaging, owing to the efficacy of deep learning models. Real-time inference speed remains a key requirement for such applications to help medical personnel. Even…

计算机视觉与模式识别 · 计算机科学 2023-06-26 Suman Sapkota , Pranav Poudel , Sudarshan Regmi , Bibek Panthi , Binod Bhattarai

Currently, Deep Convolutional Neural Networks (DCNNs) are used to solve all kinds of problems in the field of machine learning and artificial intelligence due to their learning and adaptation capabilities. However, most successful DCNN…

神经与进化计算 · 计算机科学 2020-12-01 Francisco Erivaldo Fernandes Junior , Gary G. Yen

Convolutional neural networks (CNN) have achieved impressive performance on the wide variety of tasks (classification, detection, etc.) across multiple domains at the cost of high computational and memory requirements. Thus, leveraging CNNs…

计算机视觉与模式识别 · 计算机科学 2018-11-21 Pravendra Singh , Vinay Sameer Raja Kadi , Nikhil Verma , Vinay P. Namboodiri

To compress deep convolutional neural networks (CNNs) with large memory footprint and long inference time, this paper proposes a novel pruning criterion using layer-wised Ln-norm of feature maps. Different from existing pruning criteria,…

神经与进化计算 · 计算机科学 2018-12-11 Wei Wang , Liqiang Zhu

Convolutional Neural Networks (CNN) are widely used to face challenging tasks like speech recognition, natural language processing or computer vision. As CNN architectures get larger and more complex, their computational requirements…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Luis Balderas , Miguel Lastra , José M. Benítez

To solve ever more complex problems, Deep Neural Networks are scaled to billions of parameters, leading to huge computational costs. An effective approach to reduce computational requirements and increase efficiency is to prune unnecessary…

This paper proposed a Soft Filter Pruning (SFP) method to accelerate the inference procedure of deep Convolutional Neural Networks (CNNs). Specifically, the proposed SFP enables the pruned filters to be updated when training the model after…

计算机视觉与模式识别 · 计算机科学 2018-08-22 Yang He , Guoliang Kang , Xuanyi Dong , Yanwei Fu , Yi Yang