English
Related papers

Related papers: Deep Neural Network Compression for Image Classifi…

200 papers

In this paper, we propose deformable deep convolutional neural networks for generic object detection. This new deep learning object detection framework has innovations in multiple aspects. In the proposed new deep architecture, a new…

Computer Vision and Pattern Recognition · Computer Science 2015-06-03 Wanli Ouyang , Xiaogang Wang , Xingyu Zeng , Shi Qiu , Ping Luo , Yonglong Tian , Hongsheng Li , Shuo Yang , Zhe Wang , Chen-Change Loy , Xiaoou Tang

Deep Neural Networks (DNNs) are applied in a wide range of usecases. There is an increased demand for deploying DNNs on devices that do not have abundant resources such as memory and computation units. Recently, network compression through…

Machine Learning · Computer Science 2020-05-19 Haichuan Yang , Shupeng Gui , Yuhao Zhu , Ji Liu

Compression of convolutional neural network models has recently been dominated by pruning approaches. A class of previous works focuses solely on pruning the unimportant filters to achieve network compression. Another important direction is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Tariq M. Khan , Syed S. Naqvi , Antonio Robles-Kelly , Erik Meijering

The excellent performance of deep neural networks has enabled us to solve several automatization problems, opening an era of autonomous devices. However, current deep net architectures are heavy with millions of parameters and require…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Dat Thanh Tran , Alexandros Iosifidis , Moncef Gabbouj

Deep convolutional neural networks (CNNs) with a large number of parameters require intensive computational resources, and thus are hard to be deployed in resource-constrained platforms. Decomposition-based methods, therefore, have been…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Shaowu Chen , Jiahao Zhou , Weize Sun , Lei Huang

The state-of-the-art deep neural networks (DNNs) have been widely applied for various real-world applications, and achieved significant performance for cognitive problems. However, the increment of DNNs' width and depth in architecture…

Machine Learning · Computer Science 2021-11-15 Xiao Peng Li , Qi Liu , Hing Cheung So

Pruning is one of the major methods to compress deep neural networks. In this paper, we propose an Ising energy model within an optimization framework for pruning convolutional kernels and hidden units. This model is designed to reduce…

Neural and Evolutionary Computing · Computer Science 2021-02-11 Hojjat Salehinejad , Shahrokh Valaee

Image retrieval utilizes image descriptors to retrieve the most similar images to a given query image. Convolutional neural network (CNN) is becoming the dominant approach to extract image descriptors for image retrieval. For low-power…

Artificial Intelligence · Computer Science 2019-05-10 Bin Yang , Lin Yang , Xiaochun Li , Wenhan Zhang , Hua Zhou , Yequn Zhang , Yongxiong Ren , Yinbo Shi

In the recent past, algorithms based on Convolutional Neural Networks (CNNs) have achieved significant milestones in object recognition. With large examples of each object class, standard datasets train well for inter-class variability.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-11 Shrinivasan Sankar , Adrien Bartoli

Overparameterized networks trained to convergence have shown impressive performance in domains such as computer vision and natural language processing. Pushing state of the art on salient tasks within these domains corresponds to these…

Machine Learning · Computer Science 2020-08-04 James O' Neill

Deep neural networks (DNNs) have achieved remarkable success in object detection tasks, but their increasing complexity poses significant challenges for deployment on resource-constrained platforms. While model compression techniques such…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Abhinav Shukla , Nachiket Tapas

Deep neural networks, in particular convolutional neural networks, have become highly effective tools for compressing images and solving inverse problems including denoising, inpainting, and reconstruction from few and noisy measurements.…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Reinhard Heckel , Paul Hand

The success of convolutional neural networks (CNNs) in various applications is accompanied by a significant increase in computation and parameter storage costs. Recent efforts to reduce these overheads involve pruning and compressing the…

Deep neural networks have been applied in many applications exhibiting extraordinary abilities in the field of computer vision. However, complex network architectures challenge efficient real-time deployment and require significant…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Tailin Liang , John Glossner , Lei Wang , Shaobo Shi , Xiaotong Zhang

The large memory requirements of deep neural networks limit their deployment and adoption on many devices. Model compression methods effectively reduce the memory requirements of these models, usually through applying transformations such…

Machine Learning · Computer Science 2017-11-15 Brandon Reagen , Udit Gupta , Robert Adolf , Michael M. Mitzenmacher , Alexander M. Rush , Gu-Yeon Wei , David Brooks

Deep neural networks have been widely used in image denoising during the past few years. Even though they achieve great success on this problem, they are computationally inefficient which makes them inappropriate to be implemented in mobile…

Image and Video Processing · Electrical Eng. & Systems 2021-08-05 Lu Xu , Jiawei Zhang , Xuanye Cheng , Feng Zhang , Xing Wei , Jimmy Ren

With the deployment of neural networks on mobile devices and the necessity of transmitting neural networks over limited or expensive channels, the file size of the trained model was identified as bottleneck. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-21 Thorsten Laude , Yannick Richter , Jörn Ostermann

Deep neural networks have consistently represented the state of the art in most computer vision problems. In these scenarios, larger and more complex models have demonstrated superior performance to smaller architectures, especially when…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Alexandre Lopes , Fernando Pereira dos Santos , Diulhio de Oliveira , Mauricio Schiezaro , Helio Pedrini

There has been much interest in deploying deep learning algorithms on low-powered devices, including smartphones, drones, and medical sensors. However, full-scale deep neural networks are often too resource-intensive in terms of energy and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yoshitomo Matsubara , Ruihan Yang , Marco Levorato , Stephan Mandt

In recent years, deep learning-based image compression, particularly through generative models, has emerged as a pivotal area of research. Despite significant advancements, challenges such as diminished sharpness and quality in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Ryugo Morita , Hitoshi Nishimura , Ko Watanabe , Andreas Dengel , Jinjia Zhou