中文
相关论文

相关论文: LinDeps: A Fine-tuning Free Post-Pruning Method to…

200 篇论文

Structured pruning is a popular method to reduce the cost of convolutional neural networks, that are the state of the art in many computer vision tasks. However, depending on the architecture, pruning introduces dimensional discrepancies…

神经与进化计算 · 计算机科学 2022-12-13 Hugo Tessier , Vincent Gripon , Mathieu Léonardon , Matthieu Arzel , David Bertrand , Thomas Hannagan

Layer pruning has emerged as a potent approach to remove redundant layers in the pre-trained network on the purpose of reducing network size and improve computational efficiency. However, existing layer pruning methods mostly overlook the…

机器学习 · 计算机科学 2025-11-17 Yuqi Li , Yao Lu , Junhao Dong , Zeyu Dong , Chuanguang Yang , Xin Yin , Yihao Chen , Jianping Gou , Yingli Tian , Tingwen Huang

Traditional channel-wise pruning methods by reducing network channels struggle to effectively prune efficient CNN models with depth-wise convolutional layers and certain efficient modules, such as popular inverted residual blocks. Prior…

计算机视觉与模式识别 · 计算机科学 2024-01-15 Ji Liu , Dehua Tang , Yuanxian Huang , Li Zhang , Xiaocheng Zeng , Dong Li , Mingjie Lu , Jinzhang Peng , Yu Wang , Fan Jiang , Lu Tian , Ashish Sirasao

The enormous inference cost of deep neural networks can be scaled down by network compression. Pruning is one of the predominant approaches used for deep network compression. However, existing pruning techniques have one or more of the…

机器学习 · 计算机科学 2020-10-13 Sai Aparna Aketi , Sourjya Roy , Anand Raghunathan , Kaushik Roy

Recent years have witnessed a substantial increase in the deep learning (DL)architectures proposed for visual recognition tasks like person re-identification,where individuals must be recognized over multiple distributed cameras.…

计算机视觉与模式识别 · 计算机科学 2021-04-15 Hugo Masson , Amran Bhuiyan , Le Thanh Nguyen-Meidine , Mehrsan Javan , Parthipan Siva , Ismail Ben Ayed , Eric Granger

To solve ever more complex problems, Deep Neural Networks are scaled to billions of parameters, leading to huge computational costs. An effective approach to reduce computational requirements and increase efficiency is to prune unnecessary…

In this paper, we propose a novel layer-adaptive weight-pruning approach for Deep Neural Networks (DNNs) that addresses the challenge of optimizing the output distortion minimization while adhering to a target pruning ratio constraint. Our…

计算机视觉与模式识别 · 计算机科学 2023-08-25 Kaixin Xu , Zhe Wang , Xue Geng , Jie Lin , Min Wu , Xiaoli Li , Weisi Lin

Channel pruning is one of the major compression approaches for deep neural networks. While previous pruning methods have mostly focused on identifying unimportant channels, channel pruning is considered as a special case of neural…

计算机视觉与模式识别 · 计算机科学 2021-09-15 Xiangcheng Liu , Jian Cao , Hongyi Yao , Wenyu Sun , Yuan Zhang

Channel Pruning, widely used for accelerating Convolutional Neural Networks, is an NP-hard problem due to the inter-layer dependency of channel redundancy. Existing methods generally ignored the above dependency for computation simplicity.…

机器学习 · 计算机科学 2019-03-28 Yuefu Zhou , Ya Zhang , Yanfeng Wang , Qi Tian

Convolutional Neural Networks(CNNs) are both computation and memory intensive which hindered their deployment in mobile devices. Inspired by the relevant concept in neural science literature, we propose Synaptic Pruning: a data-driven…

机器学习 · 计算机科学 2018-11-07 Chen Lin , Zhao Zhong , Wei Wu , Junjie Yan

Channel pruning, which seeks to reduce the model size by removing redundant channels, is a popular solution for deep networks compression. Existing channel pruning methods usually conduct layer-wise channel selection by directly minimizing…

计算机视觉与模式识别 · 计算机科学 2019-05-14 Yiming Hu , Siyang Sun , Jianquan Li , Jiagang Zhu , Xingang Wang , Qingyi Gu

Nowadays, it is still difficult to adapt Convolutional Neural Network (CNN) based models for deployment on embedded devices. The heavy computation and large memory footprint of CNN models become the main burden in real application. In this…

计算机视觉与模式识别 · 计算机科学 2017-08-09 Xin Li , Changsong Liu

Recent advances in Artificial Intelligence (AI) on the Internet of Things (IoT)-enabled network edge has realized edge intelligence in several applications such as smart agriculture, smart hospitals, and smart factories by enabling…

机器学习 · 计算机科学 2024-01-18 Muhammad Zawish , Steven Davy , Lizy Abraham

Currently, Deep Convolutional Neural Networks (DCNNs) are used to solve all kinds of problems in the field of machine learning and artificial intelligence due to their learning and adaptation capabilities. However, most successful DCNN…

神经与进化计算 · 计算机科学 2020-12-01 Francisco Erivaldo Fernandes Junior , Gary G. Yen

To reduce computational overhead while maintaining model performance, model pruning techniques have been proposed. Among these, structured pruning, which removes entire convolutional channels or layers, significantly enhances computational…

计算机视觉与模式识别 · 计算机科学 2024-11-21 Qingsong Lv , Jiasheng Sun , Sheng Zhou , Xu Zhang , Liangcheng Li , Yun Gao , Sun Qiao , Jie Song , Jiajun Bu

To apply deep CNNs to mobile terminals and portable devices, many scholars have recently worked on the compressing and accelerating deep convolutional neural networks. Based on this, we propose a novel uniform channel pruning (UCP) method…

计算机视觉与模式识别 · 计算机科学 2020-10-06 Jingfei Chang , Yang Lu , Ping Xue , Xing Wei , Zhen Wei

Deep convolutional neural networks (CNNs) are indispensable to state-of-the-art computer vision algorithms. However, they are still rarely deployed on battery-powered mobile devices, such as smartphones and wearable gadgets, where vision…

计算机视觉与模式识别 · 计算机科学 2017-04-20 Tien-Ju Yang , Yu-Hsin Chen , Vivienne Sze

Artificial neural networks (ANNs) especially deep convolutional networks are very popular these days and have been proved to successfully offer quite reliable solutions to many vision problems. However, the use of deep neural networks is…

机器学习 · 计算机科学 2020-07-28 Yangzi Guo , Yiyuan She , Adrian Barbu

As we push the boundaries of performance in various vision tasks, the models grow in size correspondingly. To keep up with this growth, we need very aggressive pruning techniques for efficient inference and deployment on edge devices.…

计算机视觉与模式识别 · 计算机科学 2024-06-19 Xinglong Sun , Barath Lakshmanan , Maying Shen , Shiyi Lan , Jingde Chen , Jose Alvarez

Recently there has been a lot of work on pruning filters from deep convolutional neural networks (CNNs) with the intention of reducing computations.The key idea is to rank the filters based on a certain criterion (say, l1-norm) and retain…

机器学习 · 计算机科学 2018-12-27 Deepak Mittal , Shweta Bhardwaj , Mitesh M. Khapra , Balaraman Ravindran