English
Related papers

Related papers: Convolutional Neural Network Compression through G…

200 papers

This paper shows that it is possible to train large and deep convolutional neural networks (CNN) for JPEG compression artifacts reduction, and that such networks can provide significantly better reconstruction quality compared to previously…

Computer Vision and Pattern Recognition · Computer Science 2016-05-03 Pavel Svoboda , Michal Hradis , David Barina , Pavel Zemcik

Convolutional Neural Networks (CNNs) have achieved significant breakthroughs in various fields. However, these advancements have led to a substantial increase in the complexity and size of these networks. This poses a challenge when…

Machine Learning · Computer Science 2025-09-11 Ahmed Sadaqa , Di Liu

Recurrent neural networks (RNNs) are powerful in the tasks oriented to sequential data, such as natural language processing and video recognition. However, since the modern RNNs, including long-short term memory (LSTM) and gated recurrent…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Dingheng Wang , Bijiao Wu , Guangshe Zhao , Man Yao , Hengnu Chen , Lei Deng , Tianyi Yan , Guoqi Li

Convolutional Neural Networks (CNNs) are state-of-the-art in numerous computer vision tasks such as object classification and detection. However, the large amount of parameters they contain leads to a high computational complexity and…

Machine Learning · Computer Science 2019-01-01 Ghouthi Boukli Hacene , Vincent Gripon , Matthieu Arzel , Nicolas Farrugia , Yoshua Bengio

Convolutional neural networks (CNNs) have shown great capability of solving various artificial intelligence tasks. However, the increasing model size has raised challenges in employing them in resource-limited applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Hongyang Gao , Zhengyang Wang , Shuiwang Ji

Convolutional neural networks (CNNs) have been used in many machine learning fields. In practical applications, the computational cost of convolutional neural networks is often high with the deepening of the network and the growth of data…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Shiqing Fan , Liu Liying , Ye Luo

Although the convolutional neural networks (CNNs) have become popular for various image processing and computer vision task recently, it remains a challenging problem to reduce the storage cost of the parameters for resource-limited…

Machine Learning · Computer Science 2018-11-01 Chao Li , Zhun Sun , Jinshi Yu , Ming Hou , Qibin Zhao

Tensor decomposition is one of the fundamental technique for model compression of deep convolution neural networks owing to its ability to reveal the latent relations among complex structures. However, most existing methods compress the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Bo-Shiuan Chu , Che-Rung Lee

Deep learning using neural networks is an effective technique for generating models of complex data. However, training such models can be expensive when networks have large model capacity resulting from a large number of layers and nodes.…

Machine Learning · Computer Science 2023-01-19 Jarom D. Hogue , Robert M. Kirby , Akil Narayan

Large CNNs have delivered impressive performance in various computer vision applications. But the storage and computation requirements make it problematic for deploying these models on mobile devices. Recently, tensor decompositions have…

Machine Learning · Computer Science 2016-02-16 Cheng Tai , Tong Xiao , Yi Zhang , Xiaogang Wang , Weinan E

Deep neural networks (DNNs) have enabled impressive breakthroughs in various artificial intelligence (AI) applications recently due to its capability of learning high-level features from big data. However, the current demand of DNNs for…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Bijiao Wu , Dingheng Wang , Guangshe Zhao , Lei Deng , Guoqi Li

Deep convolutional neural networks (CNN) has become the most promising method for object recognition, repeatedly demonstrating record breaking results for image classification and object detection in recent years. However, a very deep CNN…

Computer Vision and Pattern Recognition · Computer Science 2014-12-22 Yunchao Gong , Liu Liu , Ming Yang , Lubomir Bourdev

Convolutional neural networks (CNNs) are one of the most widely used neural network architectures, showcasing state-of-the-art performance in computer vision tasks. Although larger CNNs generally exhibit higher accuracy, their size can be…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Sukhbinder Singh , Saeed S. Jahromi , Roman Orus

Deep Convolutional Neural Networks (CNN) have been successfully applied to many real-life problems. However, the huge memory cost of deep CNN models poses a great challenge of deploying them on memory-constrained devices (e.g., mobile…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Weichao Lan , Liang Lan

Model compression and acceleration are attracting increasing attentions due to the demand for embedded devices and mobile applications. Research on efficient convolutional neural networks (CNNs) aims at removing feature redundancy by…

Machine Learning · Computer Science 2020-08-21 Jinhua Liang , Tao Zhang , Guoqing Feng

Recurrent Neural Networks (RNNs) have been widely used in sequence analysis and modeling. However, when processing high-dimensional data, RNNs typically require very large model sizes, thereby bringing a series of deployment challenges.…

Machine Learning · Computer Science 2020-05-12 Miao Yin , Siyu Liao , Xiao-Yang Liu , Xiaodong Wang , Bo Yuan

It is well known that Convolutional Neural Networks (CNNs) have significant redundancy in their filter weights. Various methods have been proposed in the literature to compress trained CNNs. These include techniques like pruning weights,…

Machine Learning · Computer Science 2019-06-12 Muhammad Tayyab , Abhijit Mahalanobis

Compressing convolutional neural networks (CNNs) is essential for transferring the success of CNNs to a wide variety of applications to mobile devices. In contrast to directly recognizing subtle weights or filters as redundant in a given…

Machine Learning · Statistics 2017-07-26 Yunhe Wang , Chang Xu , Jiayan Qiu , Chao Xu , Dacheng Tao

Although the latest high-end smartphone has powerful CPU and GPU, running deeper convolutional neural networks (CNNs) for complex tasks such as ImageNet classification on mobile devices is challenging. To deploy deep CNNs on mobile devices,…

Computer Vision and Pattern Recognition · Computer Science 2016-02-25 Yong-Deok Kim , Eunhyeok Park , Sungjoo Yoo , Taelim Choi , Lu Yang , Dongjun Shin

Deploying trained convolutional neural networks (CNNs) to mobile devices is a challenging task because of the simultaneous requirements of the deployed model to be fast, lightweight and accurate. Designing and training a CNN architecture…

Machine Learning · Computer Science 2019-12-02 Ramit Pahwa , Manoj Ghuhan Arivazhagan , Ankur Garg , Siddarth Krishnamoorthy , Rohit Saxena , Sunav Choudhary