English
Related papers

Related papers: Compression of Deep Neural Networks for Image Inst…

200 papers

Deep neural networks are typically represented by a much larger number of parameters than shallow models, making them prohibitive for small footprint devices. Recent research shows that there is considerable redundancy in the parameter…

Machine Learning · Computer Science 2016-05-17 Ming Tu , Visar Berisha , Yu Cao , Jae-sun Seo

Deep learning models have achieved tremendous success in most of the industries in recent years. The evolution of these models has also led to an increase in the model size and energy requirement, making it difficult to deploy in production…

Machine Learning · Computer Science 2024-07-24 Aayush Saxena , Arit Kumar Bishwas , Ayush Ashok Mishra , Ryan Armstrong

Convolutional neural networks (CNNs) are able to attain better visual recognition performance than fully connected neural networks despite having much fewer parameters due to their parameter sharing principle. Modern architectures usually…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Ilke Cugu , Emre Akbas

Medical imaging deep learning models are often large and complex, requiring specialized hardware to train and evaluate these models. To address such issues, we propose the PocketNet paradigm to reduce the size of deep learning models by…

Image and Video Processing · Electrical Eng. & Systems 2023-11-21 Adrian Celaya , Jonas A. Actor , Rajarajeswari Muthusivarajan , Evan Gates , Caroline Chung , Dawid Schellingerhout , Beatrice Riviere , David Fuentes

Deep convolutional neural networks (CNNs) have brought breakthroughs in processing clinical electrocardiograms (ECGs), speaker-independent speech and complex images. However, typical CNNs require a fixed input size while it is common to…

Machine Learning · Computer Science 2022-10-07 Linpeng Jin

Model compression is a crucial part of deploying neural networks (NNs), especially when the memory and storage of computing devices are limited in many applications. This paper focuses on two model compression techniques: low-rank…

Machine Learning · Computer Science 2024-08-16 Chenyang Li , Jihoon Chung , Mengnan Du , Haimin Wang , Xianlian Zhou , Bo Shen

This paper presents a deep learning approach for the classification of Engineering (CAD) models using Convolutional Neural Networks (CNNs). Owing to the availability of large annotated datasets and also enough computational power in the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Bharadwaj Manda , Pranjal Bhaskare , Ramanathan Muthuganapathy

Recent advancements in machine learning achieved by Deep Neural Networks (DNNs) have been significant. While demonstrating high accuracy, DNNs are associated with a huge number of parameters and computations, which leads to high memory…

Machine Learning · Computer Science 2023-12-20 Babak Rokh , Ali Azarpeyvand , Alireza Khanteymoori

It has been shown that the activations invoked by an image within the top layers of a large convolutional neural network provide a high-level descriptor of the visual content of the image. In this paper, we investigate the use of such…

Computer Vision and Pattern Recognition · Computer Science 2014-07-08 Artem Babenko , Anton Slesarev , Alexandr Chigorin , Victor Lempitsky

Model compression has gained a lot of attention due to its ability to reduce hardware resource requirements significantly while maintaining accuracy of DNNs. Model compression is especially useful for memory-intensive recurrent neural…

Machine Learning · Computer Science 2018-05-30 Dongsoo Lee , Byeongwook Kim

Convolutional Neural Networks (CNNs) have recently emerged as the dominant model in computer vision. If provided with enough training data, they predict almost any visual quantity. In a discrete setting, such as classification, CNNs are not…

Computer Vision and Pattern Recognition · Computer Science 2015-11-25 Deepak Pathak , Philipp Krähenbühl , Stella X. Yu , Trevor Darrell

As state of the art neural networks (NNs) continue to grow in size, their resource-efficient implementation becomes ever more important. In this paper, we introduce a compression scheme that reduces the number of computations required for…

Machine Learning · Computer Science 2025-04-25 Hans Rosenberger , Rodrigo Fischer , Johanna S. Fröhlich , Ali Bereyhi , Ralf R. Müller

Deep Learning models have become the dominant approach in several areas due to their high performance. Unfortunately, the size and hence computational requirements of operating such models can be considerably high. Therefore, this…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Abdullah Salama , Oleksiy Ostapenko , Tassilo Klein , Moin Nabi

In this survey paper, we review recent uses of convolution neural networks (CNNs) to solve inverse problems in imaging. It has recently become feasible to train deep CNNs on large databases of images, and they have shown outstanding…

Image and Video Processing · Electrical Eng. & Systems 2018-09-11 Michael T. McCann , Kyong Hwan Jin , Michael Unser

Computing at the edge offers intriguing possibilities for the development of autonomy and artificial intelligence. The advancements in autonomous technologies and the resurgence of computer vision have led to a rise in demand for fast and…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Martina Lofqvist , José Cano

Model compression is essential in the deployment of large Computer Vision models on embedded devices. However, static optimization techniques (e.g. pruning, quantization, etc.) neglect the fact that different inputs have different…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Fabio Montello , Ronja Güldenring , Simone Scardapane , Lazaros Nalpantidis

The widespread use of mobile devices for all kinds of transactions makes necessary reliable and real-time identity authentication, leading to the adoption of face recognition (FR) via the cameras embedded in such devices. Progress of deep…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Fernando Alonso-Fernandez , Kevin Hernandez-Diaz , Jose Maria Buades Rubio , Prayag Tiwari , Josef Bigun

The search for image compression optimization techniques is a topic of constant interest both in and out of academic circles. One method that shows promise toward future improvements in this field is image colorization since image…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Ian Tassin , Kristen Goebel , Brittany Lasher

Model Compression has drawn much attention within the deep learning community recently. Compressing a dense neural network offers many advantages including lower computation cost, deployability to devices of limited storage and memories,…

Machine Learning · Computer Science 2024-11-04 Diptarka Saha , Zihe Liu , Feng Liang

In recent years, convolutional neural networks (CNNs) took over the field of document analysis and they became the predominant model for word spotting. Especially attribute CNNs, which learn the mapping between a word image and an attribute…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Fabian Wolf , Philipp Oberdiek , Gernot A. Fink