中文
相关论文

相关论文: Prune the Convolutional Neural Networks with Spars…

200 篇论文

In this work, we propose a simple but effective channel pruning framework called Progressive Channel Pruning (PCP) to accelerate Convolutional Neural Networks (CNNs). In contrast to the existing channel pruning methods that prune channels…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Jinyang Guo , Weichen Zhang , Wanli Ouyang , Dong Xu

While the research on convolutional neural networks (CNNs) is progressing quickly, the real-world deployment of these models is often limited by computing resources and memory constraints. In this paper, we address this issue by proposing a…

计算机视觉与模式识别 · 计算机科学 2018-03-16 Dong Wang , Lei Zhou , Xueni Zhang , Xiao Bai , Jun Zhou

Deep Neural Networks (DNNs) are usually over-parameterized, causing excessive memory and interconnection cost on the hardware platform. Existing pruning approaches remove secondary parameters at the end of training to reduce the model size;…

机器学习 · 计算机科学 2019-11-12 Gokul Krishnan , Xiaocong Du , Yu Cao

Convolutional neural networks (CNN) have achieved impressive performance on the wide variety of tasks (classification, detection, etc.) across multiple domains at the cost of high computational and memory requirements. Thus, leveraging CNNs…

计算机视觉与模式识别 · 计算机科学 2018-11-21 Pravendra Singh , Vinay Sameer Raja Kadi , Nikhil Verma , Vinay P. Namboodiri

Convolution neural networks (CNNs) have shown great success in various applications. However, the computational complexity and memory storage of CNNs is a bottleneck for their deployment on resource-constrained devices. Recent efforts…

计算机视觉与模式识别 · 计算机科学 2022-11-01 Arshdeep Singh , Mark D. Plumbley

Although 3D Convolutional Neural Networks (CNNs) are essential for most learning based applications involving dense 3D data, their applicability is limited due to excessive memory and computational requirements. Compressing such networks by…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Zhiwei Xu , Thalaiyasingam Ajanthan , Vibhav Vineet , Richard Hartley

Deep Convolutional Neural Networks (CNN) has achieved significant success in computer vision field. However, the high computational cost of the deep complex models prevents the deployment on edge devices with limited memory and…

计算机视觉与模式识别 · 计算机科学 2018-06-15 Huiyuan Zhuo , Xuelin Qian , Yanwei Fu , Heng Yang , Xiangyang Xue

Pruning is an efficient model compression technique to remove redundancy in the connectivity of deep neural networks (DNNs). Computations using sparse matrices obtained by pruning parameters, however, exhibit vastly different parallelism…

机器学习 · 计算机科学 2019-05-15 Dongsoo Lee , Se Jung Kwon , Byeongwook Kim , Parichay Kapoor , Gu-Yeon Wei

Even though the Convolutional Neural Networks (CNN) has shown superior results in the field of computer vision, it is still a challenging task to implement computer vision algorithms in real-time at the edge, especially using a low-cost IoT…

计算机视觉与模式识别 · 计算机科学 2020-03-06 Chinthaka Gamanayake , Lahiru Jayasinghe , Benny Ng , Chau Yuen

Resource-efficient convolution neural networks enable not only the intelligence on edge devices but also opportunities in system-level optimization such as scheduling. In this work, we aim to improve the performance of resource-constrained…

计算机视觉与模式识别 · 计算机科学 2018-10-19 Ting-Wu Chin , Cha Zhang , Diana Marculescu

The state-of-the-art performance for several real-world problems is currently reached by convolutional neural networks (CNN). Such learning models exploit recent results in the field of deep learning, typically leading to highly performing,…

机器学习 · 计算机科学 2021-08-31 Giosuè Cataldo Marinò , Alessandro Petrini , Dario Malchiodi , Marco Frasca

Despite enjoying extensive applications in video analysis, three-dimensional convolutional neural networks (3D CNNs)are restricted by their massive computation and storage consumption. To solve this problem, we propose a threedimensional…

机器学习 · 计算机科学 2019-05-21 Yuxin Zhang , Huan Wang , Yang Luo , Lu Yu , Haoji Hu , Hangguan Shan , Tony Q. S. Quek

This work aims to enable on-device training of convolutional neural networks (CNNs) by reducing the computation cost at training time. CNN models are usually trained on high-performance computers and only the trained models are deployed to…

机器学习 · 计算机科学 2020-07-08 Yawen Wu , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Purpose: The aim of this work is to demonstrate that convolutional neural networks (CNN) can be applied to extremely sparse image libraries by subdivision of the original image datasets. Methods: Image datasets from a conventional digital…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Johan P. Boetker

Sparsity helps reduce the computational complexity of deep neural networks by skipping zeros. Taking advantage of sparsity is listed as a high priority in next generation DNN accelerators such as TPU. The structure of sparsity, i.e., the…

机器学习 · 计算机科学 2017-06-06 Huizi Mao , Song Han , Jeff Pool , Wenshuo Li , Xingyu Liu , Yu Wang , William J. Dally

Network-based transfer learning allows the reuse of deep learning features with limited data, but the resulting models can be unnecessarily large. Although network pruning can improve inference efficiency, existing algorithms usually…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Ken C. L. Wong , Satyananda Kashyap , Mehdi Moradi

This paper presents a novel approach to network pruning, targeting block pruning in deep neural networks for edge computing environments. Our method diverges from traditional techniques that utilize proxy metrics, instead employing a direct…

计算机视觉与模式识别 · 计算机科学 2024-01-17 Cheng-En Wu , Azadeh Davoodi , Yu Hen Hu

In this paper, we introduce a new channel pruning method to accelerate very deep convolutional neural networks.Given a trained CNN model, we propose an iterative two-step algorithm to effectively prune each layer, by a LASSO regression…

计算机视觉与模式识别 · 计算机科学 2017-08-22 Yihui He , Xiangyu Zhang , Jian Sun

Modern pattern recognition methods are based on convolutional networks since they are able to learn complex patterns that benefit the classification. However, convolutional networks are computationally expensive and require a considerable…

计算机视觉与模式识别 · 计算机科学 2019-09-20 Artur Jordao , Ricardo Kloss , Fernando Yamada , William Robson Schwartz

In this work, we propose a heuristic genetic algorithm (GA) for pruning convolutional neural networks (CNNs) according to the multi-objective trade-off among error, computation and sparsity. In our experiments, we apply our approach to…

神经与进化计算 · 计算机科学 2019-07-05 Chuanguang Yang , Zhulin An , Chao Li , Boyu Diao , Yongjun Xu