English
Related papers

Related papers: Architecture-aware Network Pruning for Vision Qual…

200 papers

Convolutional Neural Networks (CNNs) achieve high performance in image classification tasks but are challenging to deploy on resource-limited hardware due to their large model sizes. To address this issue, we leverage Mutual Information, a…

Machine Learning · Computer Science 2024-11-28 Tien Vu-Van , Dat Du Thanh , Nguyen Ho , Mai Vu

Though recent advanced convolutional neural networks (CNNs) have been improving the image recognition accuracy, the models are getting more complex and time-consuming. For real-world applications in industrial and commercial scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-05 Kaiming He , Jian Sun

The sophisticated structure of Convolutional Neural Network (CNN) allows for outstanding performance, but at the cost of intensive computation. As significant redundancies inevitably present in such a structure, many works have been…

Machine Learning · Computer Science 2019-09-13 Zhuwei Qin , Fuxun Yu , Chenchen Liu , Xiang Chen

Convolutional Neural Networks (CNNs) have a large number of parameters and take significantly large hardware resources to compute, so edge devices struggle to run high-level networks. This paper proposes a novel method to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Athul Shibu , Abhishek Kumar , Heechul Jung , Dong-Gyu Lee

Recent advances in Artificial Intelligence (AI) on the Internet of Things (IoT)-enabled network edge has realized edge intelligence in several applications such as smart agriculture, smart hospitals, and smart factories by enabling…

Machine Learning · Computer Science 2024-01-18 Muhammad Zawish , Steven Davy , Lizy Abraham

Structured pruning is a popular method to reduce the cost of convolutional neural networks, that are the state of the art in many computer vision tasks. However, depending on the architecture, pruning introduces dimensional discrepancies…

Neural and Evolutionary Computing · Computer Science 2022-12-13 Hugo Tessier , Vincent Gripon , Mathieu Léonardon , Matthieu Arzel , David Bertrand , Thomas Hannagan

Convolutional neural networks (CNN) play a major role in image processing tasks like image classification, object detection, semantic segmentation. Very often CNN networks have from several to hundred stacked layers with several megabytes…

Machine Learning · Computer Science 2020-02-18 Marcin Pietron , Maciej Wielgosz

In recent years, pruning has emerged as a popular technique to reduce the computational complexity and memory footprint of Convolutional Neural Network (CNN) models. Mutual Information (MI) has been widely used as a criterion for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Bogdan Musat , Razvan Andonie

With the increasing popularity of deep learning, Convolutional Neural Networks (CNNs) have been widely applied in various domains, such as image classification and object detection, and achieve stunning success in terms of their high…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Yuke Wang , Boyuan Feng , Xueqiao Peng , Yufei Ding

As the convolutional neural network (CNN) gets deeper and wider in recent years, the requirements for the amount of data and hardware resources have gradually increased. Meanwhile, CNN also reveals salient redundancy in several tasks. The…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Jingfei Chang , Yang Lu , Ping Xue , Yiqun Xu , Zhen Wei

We present a provable, sampling-based approach for generating compact Convolutional Neural Networks (CNNs) by identifying and removing redundant filters from an over-parameterized network. Our algorithm uses a small batch of input data…

Machine Learning · Computer Science 2020-03-24 Lucas Liebenwein , Cenk Baykal , Harry Lang , Dan Feldman , Daniela Rus

CNN model is a popular method for imagery analysis, so it could be utilized to recognize handwritten digits based on MNIST datasets. For higher recognition accuracy, various CNN models with different fully connected layer sizes are…

Computer Vision and Pattern Recognition · Computer Science 2021-01-18 Mengyu Chen

Convolutional Neural Networks (CNNs) have shown strong promise for analyzing scientific data from many domains including particle imaging detectors. However, the challenge of choosing the appropriate network architecture (depth, kernel…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Duc Hoang , Jesse Hamer , Gabriel N. Perdue , Steven R. Young , Jonathan Miller , Anushree Ghosh

Deep learning networks excel at classification, yet identifying minimal architectures that reliably solve a task remains challenging. We present a computational methodology for systematically exploring and analyzing the relationships among…

Machine Learning · Computer Science 2026-01-27 Ziwei Zheng , Huizhi Liang , Vaclav Snasel , Vito Latora , Panos Pardalos , Giuseppe Nicosia , Varun Ojha

With the increase of structure complexity, convolutional neural networks (CNNs) take a fair amount of computation cost. Meanwhile, existing research reveals the salient parameter redundancy in CNNs. The current pruning methods can compress…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Jingfei Chang , Yang Lu , Ping Xue , Yiqun Xu , Zhen Wei

Channel pruning is widely accepted to accelerate modern convolutional neural networks (CNNs). The resulting pruned model benefits from its immediate deployment on general-purpose software and hardware resources. However, its large pruning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Mincheol Park , Dongjin Kim , Cheonjun Park , Yuna Park , Gyeong Eun Gong , Won Woo Ro , Suhyun Kim

In today's world, a vast amount of data is being generated by edge devices that can be used as valuable training data to improve the performance of machine learning algorithms in terms of the achieved accuracy or to reduce the compute…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Aditya Rajagopal , Christos-Savvas Bouganis

Convolutional Neural Networks (CNNs) have achieved remarkable success across a wide range of machine learning tasks by leveraging hierarchical feature learning through deep architectures. However, the large number of layers and millions of…

Machine Learning · Statistics 2025-11-18 Biyi Fang , Truong Vo , Jean Utke , Diego Klabjan

Deep Neural Networks (DNNs) are the key to the state-of-the-art machine vision, sensor fusion and audio/video signal processing. Unfortunately, their computation complexity and tight resource constraints on the Edge make them hard to…

Machine Learning · Computer Science 2017-12-05 Ranko Sredojevic , Shaoyi Cheng , Lazar Supic , Rawan Naous , Vladimir Stojanovic

Convolutional neural network (CNN) has been widely used for vision-based tasks. Due to the high computational complexity and memory storage requirement, it is hard to directly deploy a full-precision CNN on embedded devices. The…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Yixing Li , Fengbo Ren