English
Related papers

Related papers: Should You Go Deeper? Optimizing Convolutional Neu…

200 papers

Convolutional neural network (CNN) pruning has become one of the most successful network compression approaches in recent years. Existing works on network pruning usually focus on removing the least important filters in the network to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Zi Wang , Chengcheng Li , Xiangyang Wang

In recent years, the research community has discovered that deep neural networks (DNNs) and convolutional neural networks (CNNs) can yield higher accuracy than all previous solutions to a broad array of machine learning problems. To our…

Computer Vision and Pattern Recognition · Computer Science 2016-12-21 Forrest Iandola

In this era of artificial intelligence, deep neural networks like Convolutional Neural Networks (CNNs) have emerged as front-runners, often surpassing human capabilities. These deep networks are often perceived as the panacea for all…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Neeraj Kumar Singh , Nikhil R. Pal

During the last years, Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance in image classification. Their architectures have largely drawn inspiration by models of the primate visual system. However, while recent…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Georgios Zoumpourlis , Alexandros Doumanoglou , Nicholas Vretos , Petros Daras

The deep Convolutional Neural Network (CNN) is the state-of-the-art solution for large-scale visual recognition. Following basic principles such as increasing the depth and constructing highway connections, researchers have manually…

Computer Vision and Pattern Recognition · Computer Science 2017-03-07 Lingxi Xie , Alan Yuille

Deep neural networks (DNNs), especially deep convolutional neural networks (CNNs), have emerged as the powerful technique in various machine learning applications. However, the large model sizes of DNNs yield high demands on computation…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Siyu Liao , Zhe Li , Liang Zhao , Qinru Qiu , Yanzhi Wang , Bo Yuan

This paper presents an unsupervised method to learn a neural network, namely an explainer, to interpret a pre-trained convolutional neural network (CNN), i.e., explaining knowledge representations hidden in middle conv-layers of the CNN.…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Quanshi Zhang , Yu Yang , Yuchen Liu , Ying Nian Wu , Song-Chun Zhu

Convolutional neural networks for computer vision are fairly intuitive. In a typical CNN used in image classification, the first layers learn edges, and the following layers learn some filters that can identify an object. But CNNs for…

Computation and Language · Computer Science 2018-04-04 Prudhvi Raj Dachapally , Srikanth Ramanam

We describe the class of convexified convolutional neural networks (CCNNs), which capture the parameter sharing of convolutional neural networks in a convex manner. By representing the nonlinear convolutional filters as vectors in a…

Machine Learning · Computer Science 2016-09-06 Yuchen Zhang , Percy Liang , Martin J. Wainwright

This paper presents an unsupervised method to learn a neural network, namely an explainer, to interpret a pre-trained convolutional neural network (CNN), i.e., the explainer uses interpretable visual concepts to explain features in middle…

Machine Learning · Computer Science 2019-01-24 Quanshi Zhang , Yu Yang , Ying Nian Wu

Hyperparameters tuning is a time-consuming approach, particularly when the architecture of the neural network is decided as part of this process. For instance, in convolutional neural networks (CNNs), the selection of the number and the…

Machine Learning · Computer Science 2020-07-31 Roberto L. Castro , Diego Andrade , Basilio Fraguela

One of the most promising ways of improving the performance of deep convolutional neural networks is by increasing the number of convolutional layers. However, adding layers makes training more difficult and computationally expensive. In…

Computer Vision and Pattern Recognition · Computer Science 2015-05-12 Liwei Wang , Chen-Yu Lee , Zhuowen Tu , Svetlana Lazebnik

The excellent performance of deep neural networks has enabled us to solve several automatization problems, opening an era of autonomous devices. However, current deep net architectures are heavy with millions of parameters and require…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Dat Thanh Tran , Alexandros Iosifidis , Moncef Gabbouj

Convolutional neural networks are witnessing wide adoption in computer vision systems with numerous applications across a range of visual recognition tasks. Much of this progress is fueled through advances in convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2018-06-06 Felix Juefei-Xu , Vishnu Naresh Boddeti , Marios Savvides

Encoder-decoder networks using convolutional neural network (CNN) architecture have been extensively used in deep learning literatures thanks to its excellent performance for various inverse problems. However, it is still difficult to…

Machine Learning · Computer Science 2019-05-08 Jong Chul Ye , Woon Kyoung Sung

Convolutional Neural Networks (CNNs) have become indispensable for solving machine learning tasks in speech recognition, computer vision, and other areas that involve high-dimensional data. A CNN filters the input feature using a network…

Machine Learning · Computer Science 2020-02-13 Jonathan Ephrath , Moshe Eliasof , Lars Ruthotto , Eldad Haber , Eran Treister

Convolutional neural networks (CNNs) are a popular choice of model for tasks in computer vision. When CNNs are made with many layers, resulting in a deep neural network, skip connections may be added to create an easier gradient…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Johnny Joyce , Jan Verschelde

Convolutional Neural Networks (CNNs) have proven to be extremely accurate for image recognition, even outperforming human recognition capability. When deployed on battery-powered mobile devices, efficient computer architectures are required…

Hardware Architecture · Computer Science 2020-10-05 Mehdi Ahmadi , Shervin Vakili , J. M. Pierre Langlois

Convolutional Neural Network (CNN) has gained state-of-the-art results in many pattern recognition and computer vision tasks. However, most of the CNN structures are manually designed by experienced researchers. Therefore, auto- matically…

Neural and Evolutionary Computing · Computer Science 2018-10-26 Guoqiang Zhong , Tao Li , Wenxue Liu , Yang Chen

Convolutional neural networks (CNNs) have enabled the state-of-the-art performance in many computer vision tasks. However, little effort has been devoted to establishing convolution in non-linear space. Existing works mainly leverage on the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Chen Wang , Jianfei Yang , Lihua Xie , Junsong Yuan