English
Related papers

Related papers: Understanding and Improving Convolutional Neural N…

200 papers

Convolutional neural network (CNN) pruning has become one of the most successful network compression approaches in recent years. Existing works on network pruning usually focus on removing the least important filters in the network to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Zi Wang , Chengcheng Li , Xiangyang Wang

We propose a convolutional neural network (CNN) architecture for image classification based on subband decomposition of the image using wavelets. The proposed architecture decomposes the input image spectra into multiple critically sampled…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Pavel Sinha , Ioannis Psaromiligkos , Zeljko Zilic

In the context of skeleton-based action recognition, graph convolutional networks (GCNs) have been rapidly developed, whereas convolutional neural networks (CNNs) have received less attention. One reason is that CNNs are considered poor in…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Kailin Xu , Fanfan Ye , Qiaoyong Zhong , Di Xie

Motivated by the growing theoretical understanding of neural networks that employ the Rectified Linear Unit (ReLU) as their activation function, we revisit the use of ReLU activation functions for learning implicit neural representations…

Image and Video Processing · Electrical Eng. & Systems 2024-08-05 Joseph Shenouda , Yamin Zhou , Robert D. Nowak

Convolutional Neural Network (CNN) is the state-of-the-art for image classification task. Here we have briefly discussed different components of CNN. In this paper, We have explained different CNN architectures for image classification.…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Farhana Sultana , A. Sufian , Paramartha Dutta

Rectified activation units (rectifiers) are essential for state-of-the-art neural networks. In this work, we study rectifier neural networks for image classification from two aspects. First, we propose a Parametric Rectified Linear Unit…

Computer Vision and Pattern Recognition · Computer Science 2015-02-09 Kaiming He , Xiangyu Zhang , Shaoqing Ren , Jian Sun

Within the world of machine learning there exists a wide range of different methods with respective advantages and applications. This paper seeks to present and discuss one such method, namely Convolutional Neural Networks (CNNs). CNNs are…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Lars Lien Ankile , Morgan Feet Heggland , Kjartan Krange

Over the long history of machine learning, which dates back several decades, recurrent neural networks (RNNs) have been used mainly for sequential data and time series and generally with 1D information. Even in some rare studies on 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Nguyen Huu Phong , Bernardete Ribeiro

Verifying robustness of neural network classifiers has attracted great interests and attention due to the success of deep neural networks and their unexpected vulnerability to adversarial perturbations. Although finding minimum adversarial…

Machine Learning · Statistics 2018-11-30 Akhilan Boopathy , Tsui-Wei Weng , Pin-Yu Chen , Sijia Liu , Luca Daniel

Convolutional Neural Networks (CNNs) have shown to be powerful classification tools in tasks that range from check reading to medical diagnosis, reaching close to human perception, and in some cases surpassing it. However, the problems to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-08 Jose Marques , Gabriel Falcao , Luís A. Alexandre

Lighter and faster image restoration (IR) models are crucial for the deployment on resource-limited devices. Binary neural network (BNN), one of the most promising model compression methods, can dramatically reduce the computations and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Bin Xia , Yulun Zhang , Yitong Wang , Yapeng Tian , Wenming Yang , Radu Timofte , Luc Van Gool

In this paper, we propose a novel convolutional neural network (CNN) for image denoising, which uses exponential linear unit (ELU) as the activation function. We investigate the suitability by analyzing ELU's connection with trainable…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Tianyang Wang , Zhengrui Qin , Michelle Zhu

Convolutional Networks have dominated the field of computer vision for the last ten years, exhibiting extremely powerful feature extraction capabilities and outstanding classification performance. The main strategy to prolong this trend…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Javier Huertas-Tato , Alejandro Martín , Julián Fierrez , David Camacho

Purpose: Iterative Convolutional Neural Networks (CNNs) which resemble unrolled learned iterative schemes have shown to consistently deliver state-of-the-art results for image reconstruction problems across different imaging modalities.…

Machine Learning · Computer Science 2022-03-07 Andreas Kofler , Markus Haltmeier , Tobias Schaeffter , Christoph Kolbitsch

We investigate filter level sparsity that emerges in convolutional neural networks (CNNs) which employ Batch Normalization and ReLU activation, and are trained with adaptive gradient descent techniques and L2 regularization or weight decay.…

Machine Learning · Computer Science 2019-04-08 Dushyant Mehta , Kwang In Kim , Christian Theobalt

Convolutional Neural Networks (CNNs) are powerful models that achieve impressive results for image classification. In addition, pre-trained CNNs are also useful for other computer vision tasks as generic feature extractors. This paper aims…

Computer Vision and Pattern Recognition · Computer Science 2015-07-10 Ben Athiwaratkun , Keegan Kang

In recent years, several models using Quaternion-Valued Convolutional Neural Networks (QCNNs) for different problems have been proposed. Although the definition of the quaternion convolution layer is the same, there are different…

Machine Learning · Computer Science 2024-09-04 Gerardo Altamirano-Gómez , Carlos Gershenson

Change detection is one of the central problems in earth observation and was extensively investigated over recent decades. In this paper, we propose a novel recurrent convolutional neural network (ReCNN) architecture, which is trained to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Lichao Mou , Lorenzo Bruzzone , Xiao Xiang Zhu

We consider Convolutional Neural Networks (CNNs) with 2D structured features that are symmetric in the spatial dimensions. Such networks arise in modeling pairwise relationships for a sequential recommendation problem, as well as secondary…

Machine Learning · Statistics 2022-03-07 Kehelwala Dewage Gayan Maduranga , Vasily Zadorozhnyy , Qiang Ye

Deep convolutional neural networks (CNNs) have demonstrated impressive performance on visual object classification tasks. In addition, it is a useful model for predication of neuronal responses recorded in visual system. However, there is…

Machine Learning · Statistics 2017-11-15 Qi Yan , Zhaofei Yu , Feng Chen , Jian K. Liu