English
Related papers

Related papers: Building Efficient Lightweight CNN Models

200 papers

Deep convolutional neural networks (CNNs) are powerful tools for a wide range of vision tasks, but the enormous amount of memory and compute resources required by CNNs pose a challenge in deploying them on constrained devices. Existing…

Machine Learning · Computer Science 2019-10-30 Yiren Zhao , Xitong Gao , Daniel Bates , Robert Mullins , Cheng-Zhong Xu

We propose a generalized convolutional neural network (CNN) architecture that first decomposes the input signal into subbands by an adaptive filter bank structure, and then uses convolutional layers to extract features from each subband…

Image and Video Processing · Electrical Eng. & Systems 2023-06-30 Pavel Sinha , Ioannis Psaromiligkos , Zeljko Zilic

Convolutional neural networks (CNNs) have become the dominant neural network architecture for solving visual processing tasks. One of the major obstacles hindering the ubiquitous use of CNNs for inference is their relatively high memory…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Chaim Baskin , Brian Chmiel , Evgenii Zheltonozhskii , Ron Banner , Alex M. Bronstein , Avi Mendelson

Convolutional neural networks (CNNs) are similar to "ordinary" neural networks in the sense that they are made up of hidden layers consisting of neurons with "learnable" parameters. These neurons receive inputs, performs a dot product, and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Abien Fred Agarap

Convolutional neural networks (CNNs) have achieved state-of-the-art results on many visual recognition tasks. However, current CNN models still exhibit a poor ability to be invariant to spatial transformations of images. Intuitively, with…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Xu Shen , Xinmei Tian , Anfeng He , Shaoyan Sun , Dacheng Tao

Owing to flexible architectures of deep convolutional neural networks (CNNs), CNNs are successfully used for image denoising. However, they suffer from the following drawbacks: (i) deep network architecture is very difficult to train. (ii)…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Chunwei Tian , Yong Xu , Lunke Fei , Junqian Wang , Jie Wen , Nan Luo

Deploying deep convolutional neural networks (CNNs) on resource-constrained devices presents significant challenges due to their high computational demands and rigid, static architectures. To overcome these limitations, this thesis explores…

Machine Learning · Computer Science 2025-05-20 Pooja Mangal , Sudaksh Kalra , Dolly Sapra

Deploying trained convolutional neural networks (CNNs) to mobile devices is a challenging task because of the simultaneous requirements of the deployed model to be fast, lightweight and accurate. Designing and training a CNN architecture…

Machine Learning · Computer Science 2019-12-02 Ramit Pahwa , Manoj Ghuhan Arivazhagan , Ankur Garg , Siddarth Krishnamoorthy , Rohit Saxena , Sunav Choudhary

In recent years, Convolutional Neural Networks (CNNs) have become the standard class of deep neural network for image processing, classification and segmentation tasks. However, the large strides in accuracy obtained by CNNs have been…

Machine Learning · Computer Science 2023-01-18 André Santos , João Dinis Ferreira , Onur Mutlu , Gabriel Falcao

Lightweight architectural designs of Convolutional Neural Networks (CNNs) together with quantization have paved the way for the deployment of demanding computer vision applications on mobile devices. Parallel to this, alternative…

Machine Learning · Computer Science 2020-03-24 Javier Fernandez-Marques , Paul N. Whatmough , Andrew Mundy , Matthew Mattina

Convolutional neural networks (CNN) have achieved impressive performance on the wide variety of tasks (classification, detection, etc.) across multiple domains at the cost of high computational and memory requirements. Thus, leveraging CNNs…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Pravendra Singh , Vinay Sameer Raja Kadi , Nikhil Verma , Vinay P. Namboodiri

Convolutional neural networks (CNNs) have constantly achieved better performance over years by introducing more complex topology, and enlarging the capacity towards deeper and wider CNNs. This makes the manual design of CNNs extremely…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Bin Wang , Bing Xue , Mengjie Zhang

Though recent advanced convolutional neural networks (CNNs) have been improving the image recognition accuracy, the models are getting more complex and time-consuming. For real-world applications in industrial and commercial scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-05 Kaiming He , Jian Sun

Convolutional Networks have dominated the field of computer vision for the last ten years, exhibiting extremely powerful feature extraction capabilities and outstanding classification performance. The main strategy to prolong this trend…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Javier Huertas-Tato , Alejandro Martín , Julián Fierrez , David Camacho

Convolutional neural networks (CNNs) are commonly trained using a fixed spatial image size predetermined for a given model. Although trained on images of aspecific size, it is well established that CNNs can be used to evaluate a wide range…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Elad Hoffer , Berry Weinstein , Itay Hubara , Tal Ben-Nun , Torsten Hoefler , Daniel Soudry

Is it possible to recover an image from its noisy version using convolutional neural networks? This is an interesting problem as convolutional layers are generally used as feature detectors for tasks like classification, segmentation and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Nithish Divakar , R. Venkatesh Babu

Convolutional Neural Networks (CNNs) have shown promising results in efficiency and accuracy in image classification. However, their efficacy often relies on large, labeled datasets, posing challenges for applications with limited data…

Machine Learning · Computer Science 2026-01-08 A. M. A. S. D. Alagiyawanna , Asoka Karunananda , A. Mahasinghe , Thushari Silva

Embedding Convolutional Neural Network (CNN) into edge devices for inference is a very challenging task because such lightweight hardware is not born to handle this heavyweight software, which is the common overhead from the modern…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Ching-Chen Wang , Ching-Te Chiu , Jheng-Yi Chang

Deep Neural Networks (DNNs) have become the de-facto standard in computer vision, as well as in many other pattern recognition tasks. A key drawback of DNNs is that the training phase can be very computationally expensive. Organizations or…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Debesh Jha , Anis Yazidi , Michael A. Riegler , Dag Johansen , Håvard D. Johansen , Pål Halvorsen

While classical convolutional neural networks (CNNs) have revolutionized image classification, the emergence of quantum computing presents new opportunities for enhancing neural network architectures. Quantum CNNs (QCNNs) leverage quantum…

Quantum Physics · Physics 2025-05-16 Peter Röseler , Oliver Schaudt , Helmut Berg , Christian Bauckhage , Matthias Koch