English
Related papers

Related papers: SqueezerFaceNet: Reducing a Small Face Recognition…

200 papers

Convolutional Neural Networks (CNNs) are state-of-the-art in numerous computer vision tasks such as object classification and detection. However, the large amount of parameters they contain leads to a high computational complexity and…

Machine Learning · Computer Science 2019-01-01 Ghouthi Boukli Hacene , Vincent Gripon , Matthieu Arzel , Nicolas Farrugia , Yoshua Bengio

Deep Learning models have become the dominant approach in several areas due to their high performance. Unfortunately, the size and hence computational requirements of operating such models can be considerably high. Therefore, this…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Abdullah Salama , Oleksiy Ostapenko , Tassilo Klein , Moin Nabi

With the advent of 2-dimensional Convolution Neural Networks (2D CNNs), the face recognition accuracy has reached above 99%. However, face recognition is still a challenge in real world conditions. A video, instead of an image, as an input…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Nayaneesh Kumar Mishra , Satish Kumar Singh

Object detection is a crucial task for autonomous driving. In addition to requiring high accuracy to ensure safety, object detection for autonomous driving also requires real-time inference speed to guarantee prompt vehicle control, as well…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Bichen Wu , Alvin Wan , Forrest Iandola , Peter H. Jin , Kurt Keutzer

Building compact convolutional neural networks (CNNs) with reliable performance is a critical but challenging task, especially when deploying them in real-world applications. As a common approach to reduce the size of CNNs, pruning methods…

Machine Learning · Computer Science 2020-05-26 Hang Li , Chen Ma , Wei Xu , Xue Liu

Convolutional neural network (CNN) delivers impressive achievements in computer vision and machine learning field. However, CNN incurs high computational complexity, especially for vision quality applications because of large image…

Image and Video Processing · Electrical Eng. & Systems 2019-08-07 Wei-Ting Wang , Han-Lin Li , Wei-Shiang Lin , Cheng-Ming Chiang , Yi-Min Tsai

Finding out the computational redundant part of a trained Deep Neural Network (DNN) is the key question that pruning algorithms target on. Many algorithms try to predict model performance of the pruned sub-nets by introducing various…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Bailin Li , Bowen Wu , Jiang Su , Guangrun Wang , Liang Lin

Neural networks grow vastly in size to tackle more sophisticated tasks. In many cases, such large networks are not deployable on particular hardware and need to be reduced in size. Pruning techniques help to shrink deep neural networks to…

Machine Learning · Computer Science 2022-06-01 Udo Schlegel , Samuel Schiegg , Daniel A. Keim

The rapid evolution of digital image manipulation techniques poses significant challenges for content verification, with models such as stable diffusion and mid-journey producing highly realistic, yet synthetic, images that can deceive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Alejandro Marco Montejano , Angela Sanchez Perez , Javier Barrachina , David Ortiz-Perez , Manuel Benavent-Lledo , Jose Garcia-Rodriguez

Pruning is a compression method which aims to improve the efficiency of neural networks by reducing their number of parameters while maintaining a good performance, thus enhancing the performance-to-cost ratio in nontrivial ways. Of…

Neural and Evolutionary Computing · Computer Science 2023-09-25 Hugo Tessier , Ghouti Boukli Hacene , Vincent Gripon

Face recognition is one of the most active tasks in computer vision and has been widely used in the real world. With great advances made in convolutional neural networks (CNN), lots of face recognition algorithms have achieved high accuracy…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Jiehua Zhang , Zhuo Su , Li Liu

Face recognition performance has improved remarkably in the last decade. Much of this success can be attributed to the development of deep learning techniques such as convolutional neural networks (CNNs). While CNNs have pushed the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Sandipan Banerjee , Joel Brogan , Janez Krizaj , Aparna Bharati , Brandon RichardWebster , Vitomir Struc , Patrick Flynn , Walter Scheirer

One of the main barriers for deploying neural networks on embedded systems has been large memory and power consumption of existing neural networks. In this work, we introduce SqueezeNext, a new family of neural network architectures whose…

Neural and Evolutionary Computing · Computer Science 2021-04-21 Amir Gholami , Kiseok Kwon , Bichen Wu , Zizheng Tai , Xiangyu Yue , Peter Jin , Sicheng Zhao , Kurt Keutzer

Modern deep neural networks require a significant amount of computing time and power to train and deploy, which limits their usage on edge devices. Inspired by the iterative weight pruning in the Lottery Ticket Hypothesis, we propose…

Machine Learning · Computer Science 2022-07-15 John Tan Chong Min , Mehul Motani

We present a provable, sampling-based approach for generating compact Convolutional Neural Networks (CNNs) by identifying and removing redundant filters from an over-parameterized network. Our algorithm uses a small batch of input data…

Machine Learning · Computer Science 2020-03-24 Lucas Liebenwein , Cenk Baykal , Harry Lang , Dan Feldman , Daniela Rus

Channel pruning is one of the major compression approaches for deep neural networks. While previous pruning methods have mostly focused on identifying unimportant channels, channel pruning is considered as a special case of neural…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Xiangcheng Liu , Jian Cao , Hongyi Yao , Wenyu Sun , Yuan Zhang

Convolutional Neural Networks (CNNs) have demonstrated exceptional performance in recent years. Compressing these models not only reduces storage requirements, making deployment to edge devices feasible, but also accelerates inference,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Boyao Wang , Volodymyr Kindratenko

While going deeper has been witnessed to improve the performance of convolutional neural networks (CNN), going smaller for CNN has received increasing attention recently due to its attractiveness for mobile/embedded applications. It remains…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Zhe Li , Xiaoyu Wang , Xutao Lv , Tianbao Yang

Various applications in the field of autonomous driving are based on convolutional neural networks (CNNs), especially for processing camera data. The optimization of such CNNs is a major challenge in continuous development. Newly learned…

We present a novel convolutional neural network (CNN) design for facial landmark coordinate regression. We examine the intermediate features of a standard CNN trained for landmark detection and show that features extracted from later, more…

Computer Vision and Pattern Recognition · Computer Science 2016-03-23 Yue Wu , Tal Hassner , KangGeon Kim , Gerard Medioni , Prem Natarajan