中文
相关论文

相关论文: Manipulating Identical Filter Redundancy for Effic…

200 篇论文

Convolutional neural networks (CNN) play a major role in image processing tasks like image classification, object detection, semantic segmentation. Very often CNN networks have from several to hundred stacked layers with several megabytes…

机器学习 · 计算机科学 2020-02-18 Marcin Pietron , Maciej Wielgosz

Filters are the essential elements in convolutional neural networks (CNNs). Filters are corresponded to the feature maps and form the main part of the computational and memory requirement for the CNN processing. In filter pruning methods, a…

计算机视觉与模式识别 · 计算机科学 2020-02-11 Morteza Mousa-Pasandi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi , Shahram Shirani

The deployment of deep convolutional neural networks (CNNs) in many real world applications is largely hindered by their high computational cost. In this paper, we propose a novel learning scheme for CNNs to simultaneously 1) reduce the…

计算机视觉与模式识别 · 计算机科学 2017-08-23 Zhuang Liu , Jianguo Li , Zhiqiang Shen , Gao Huang , Shoumeng Yan , Changshui Zhang

In today's world, a vast amount of data is being generated by edge devices that can be used as valuable training data to improve the performance of machine learning algorithms in terms of the achieved accuracy or to reduce the compute…

计算机视觉与模式识别 · 计算机科学 2020-06-18 Aditya Rajagopal , Christos-Savvas Bouganis

Channel pruning is a promising technique to compress the parameters of deep convolutional neural networks(DCNN) and to speed up the inference. This paper aims to address the long-standing inefficiency of channel pruning. Most channel…

计算机视觉与模式识别 · 计算机科学 2021-09-01 Zhouyang Xie , Yan Fu , Shengzhao Tian , Junlin Zhou , Duanbing Chen

A well-trained Convolutional Neural Network can easily be pruned without significant loss of performance. This is because of unnecessary overlap in the features captured by the network's filters. Innovations in network architecture such as…

计算机视觉与模式识别 · 计算机科学 2019-02-26 Aaditya Prakash , James Storer , Dinei Florencio , Cha Zhang

Recent years have witnessed a substantial increase in the deep learning (DL)architectures proposed for visual recognition tasks like person re-identification,where individuals must be recognized over multiple distributed cameras.…

计算机视觉与模式识别 · 计算机科学 2021-04-15 Hugo Masson , Amran Bhuiyan , Le Thanh Nguyen-Meidine , Mehrsan Javan , Parthipan Siva , Ismail Ben Ayed , Eric Granger

The sophisticated structure of Convolutional Neural Network (CNN) allows for outstanding performance, but at the cost of intensive computation. As significant redundancies inevitably present in such a structure, many works have been…

机器学习 · 计算机科学 2019-09-13 Zhuwei Qin , Fuxun Yu , Chenchen Liu , Xiang Chen

Model pruning has become a useful technique that improves the computational efficiency of deep learning, making it possible to deploy solutions in resource-limited scenarios. A widely-used practice in relevant work assumes that a…

机器学习 · 计算机科学 2018-02-06 Jianbo Ye , Xin Lu , Zhe Lin , James Z. Wang

We propose a new formulation for pruning convolutional kernels in neural networks to enable efficient inference. We interleave greedy criteria-based pruning with fine-tuning by backpropagation - a computationally efficient procedure that…

机器学习 · 计算机科学 2017-06-12 Pavlo Molchanov , Stephen Tyree , Tero Karras , Timo Aila , Jan Kautz

Convolutional neural networks (CNN) have achieved impressive performance on the wide variety of tasks (classification, detection, etc.) across multiple domains at the cost of high computational and memory requirements. Thus, leveraging CNNs…

计算机视觉与模式识别 · 计算机科学 2018-11-21 Pravendra Singh , Vinay Sameer Raja Kadi , Nikhil Verma , Vinay P. Namboodiri

Deep Neural Network (DNN) is powerful but computationally expensive and memory intensive, thus impeding its practical usage on resource-constrained front-end devices. DNN pruning is an approach for deep model compression, which aims at…

机器学习 · 计算机科学 2019-10-28 Xiaohan Ding , Guiguang Ding , Xiangxin Zhou , Yuchen Guo , Jungong Han , Ji Liu

This work aims to enable on-device training of convolutional neural networks (CNNs) by reducing the computation cost at training time. CNN models are usually trained on high-performance computers and only the trained models are deployed to…

机器学习 · 计算机科学 2020-07-08 Yawen Wu , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Many state-of-the-art computer vision algorithms use large scale convolutional neural networks (CNNs) as basic building blocks. These CNNs are known for their huge number of parameters, high redundancy in weights, and tremendous computing…

计算机视觉与模式识别 · 计算机科学 2018-01-24 Qiangui Huang , Kevin Zhou , Suya You , Ulrich Neumann

Filter pruning is widely adopted to compress and accelerate the Convolutional Neural Networks (CNNs), but most previous works ignore the relationship between filters and channels in different layers. Processing each layer independently…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Xiaorui Wang , Jun Wang , Xin Tang , Peng Gao , Rui Fang , Guotong Xie

Deep Convolutional Neural Networks (CNN) has achieved significant success in computer vision field. However, the high computational cost of the deep complex models prevents the deployment on edge devices with limited memory and…

计算机视觉与模式识别 · 计算机科学 2018-06-15 Huiyuan Zhuo , Xuelin Qian , Yanwei Fu , Heng Yang , Xiangyang Xue

Neural network pruning is an essential approach for reducing the computational complexity of deep models so that they can be well deployed on resource-limited devices. Compared with conventional methods, the recently developed dynamic…

计算机视觉与模式识别 · 计算机科学 2021-03-11 Yehui Tang , Yunhe Wang , Yixing Xu , Yiping Deng , Chao Xu , Dacheng Tao , Chang Xu

While Convolutional Neural Networks (CNNs) excel at learning complex latent-space representations, their over-parameterization can lead to overfitting and reduced performance, particularly with limited data. This, alongside their high…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Manish Sharma , Jamison Heard , Eli Saber , Panos P. Markopoulos

Convolutional Neural Networks (CNNs) achieve high performance in image classification tasks but are challenging to deploy on resource-limited hardware due to their large model sizes. To address this issue, we leverage Mutual Information, a…

机器学习 · 计算机科学 2024-11-28 Tien Vu-Van , Dat Du Thanh , Nguyen Ho , Mai Vu

Typical convolutional neural networks (CNNs) have several millions of parameters and require a large amount of annotated data to train them. In medical applications where training data is hard to come by, these sophisticated machine…

计算机视觉与模式识别 · 计算机科学 2016-12-09 Rahul Venkataramani , Sheshadri Thiruvenkadam , Prasad Sudhakar , Hariharan Ravishankar , Vivek Vaidya