English
Related papers

Related papers: Cascaded Subpatch Networks for Effective CNNs

200 papers

To read the final version please go to IEEE TGRS on IEEE Xplore. Convolutional neural networks (CNNs) have been attracting increasing attention in hyperspectral (HS) image classification, owing to their ability to capture spatial-spectral…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Danfeng Hong , Lianru Gao , Jing Yao , Bing Zhang , Antonio Plaza , Jocelyn Chanussot

Building large models with parameter sharing accounts for most of the success of deep convolutional neural networks (CNNs). In this paper, we propose doubly convolutional neural networks (DCNNs), which significantly improve the performance…

Machine Learning · Computer Science 2016-11-01 Shuangfei Zhai , Yu Cheng , Weining Lu , Zhongfei Zhang

We propose a novel Convolutional Neural Network (CNN) compression algorithm based on coreset representations of filters. We exploit the redundancies extant in the space of CNN weights and neuronal activations (across samples) in order to…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Abhimanyu Dubey , Moitreya Chatterjee , Narendra Ahuja

We present a novel spatial hashing based data structure to facilitate 3D shape analysis using convolutional neural networks (CNNs). Our method well utilizes the sparse occupancy of 3D shape boundary and builds hierarchical hash tables for…

Graphics · Computer Science 2019-04-19 Tianjia Shao , Yin Yang , Yanlin Weng , Qiming Hou , Kun Zhou

Deep neural networks are representation learning techniques. During training, a deep net is capable of generating a descriptive language of unprecedented size and detail in machine learning. Extracting the descriptive language coded within…

Neural and Evolutionary Computing · Computer Science 2018-01-30 Dario Garcia-Gasulla , Ferran Parés , Armand Vilalta , Jonatan Moreno , Eduard Ayguadé , Jesús Labarta , Ulises Cortés , Toyotaro Suzumura

Here we demonstrate that the feature space of random shallow convolutional neural networks (CNNs) can serve as a surprisingly good model of natural textures. Patches from the same texture are consistently classified as being more similar…

Computer Vision and Pattern Recognition · Computer Science 2016-06-02 Ivan Ustyuzhaninov , Wieland Brendel , Leon A. Gatys , Matthias Bethge

The Convolutional Neural Networks (CNNs), in domains like computer vision, mostly reduced the need for handcrafted features due to its ability to learn the problem-specific features from the raw input data. However, the selection of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 S. H. Shabbeer Basha , Shiv Ram Dubey , Viswanath Pulabaigari , Snehasis Mukherjee

Very deep convolutional neural networks (CNNs) yield state of the art results on a wide variety of visual recognition problems. A number of state of the the art methods for image recognition are based on networks with well over 100 layers…

Computer Vision and Pattern Recognition · Computer Science 2016-07-15 Joel Moniz , Christopher Pal

Convolutional Neural Network (CNN) has an amount of parameter redundancy, filter pruning aims to remove the redundant filters and provides the possibility for the application of CNN on terminal devices. However, previous works pay more…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Pengkun Liu , Yaru Yue , Yanjun Guo , Xingxiang Tao , Xiaoguang Zhou

Recently, convolutional neural network (CNN) techniques have gained popularity as a tool for hyperspectral image classification (HSIC). To improve the feature extraction efficiency of HSIC under the condition of limited samples, the current…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Hongmin Gao , Zhonghao Chen , Chenming Li

One impressive advantage of convolutional neural networks (CNNs) is their ability to automatically learn feature representation from raw pixels, eliminating the need for hand-designed procedures. However, recent methods for single image…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Yifan Wang , Lijun Wang , Hongyu Wang , Peihua Li

We propose a new method for creating computationally efficient and compact convolutional neural networks (CNNs) using a novel sparse connection structure that resembles a tree root. This allows a significant reduction in computational cost…

Neural and Evolutionary Computing · Computer Science 2020-10-13 Yani Ioannou , Duncan Robertson , Roberto Cipolla , Antonio Criminisi

Convolutional Neural Networks (CNN) has been extensively studied for Hyperspectral Image Classification (HSIC) more specifically, 2D and 3D CNN models have proved highly efficient in exploiting the spatial and spectral information of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Muhammad Ahmad , Sidrah Shabbir , Rana Aamir Raza , Manuel Mazzara , Salvatore Distefano , Adil Mehmood Khan

Object detection is a challenging task in visual understanding domain, and even more so if the supervision is to be weak. Recently, few efforts to handle the task without expensive human annotations is established by promising deep neural…

Computer Vision and Pattern Recognition · Computer Science 2016-11-28 Ali Diba , Vivek Sharma , Ali Pazandeh , Hamed Pirsiavash , Luc Van Gool

In convolutional neural networks (CNNs), padding plays a pivotal role in preserving spatial dimensions throughout the layers. Traditional padding techniques do not explicitly distinguish between the actual image content and the padded…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Juho Kim

Normalization techniques have been widely used in the field of deep learning due to their capability of enabling higher learning rates and are less careful in initialization. However, the effectiveness of popular normalization technologies…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Afifa Khaled , Chao Li , Jia Ning , Kun He

Convolutional Neural Networks have provided state-of-the-art results in several computer vision problems. However, due to a large number of parameters in CNNs, they require a large number of training samples which is a limiting factor for…

Computer Vision and Pattern Recognition · Computer Science 2018-04-02 Rohit Keshari , Mayank Vatsa , Richa Singh , Afzel Noore

Shallow supervised 1-hidden layer neural networks have a number of favorable properties that make them easier to interpret, analyze, and optimize than their deep counterparts, but lack their representational power. Here we use 1-hidden…

Machine Learning · Computer Science 2019-04-24 Eugene Belilovsky , Michael Eickenberg , Edouard Oyallon

Convolutional neural networks (CNNs) are commonly trained using a fixed spatial image size predetermined for a given model. Although trained on images of aspecific size, it is well established that CNNs can be used to evaluate a wide range…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Elad Hoffer , Berry Weinstein , Itay Hubara , Tal Ben-Nun , Torsten Hoefler , Daniel Soudry

Convolutional neural networks (CNNs) have been shown to achieve optimal approximation and estimation error rates (in minimax sense) in several function classes. However, previous analyzed optimal CNNs are unrealistically wide and difficult…

Machine Learning · Statistics 2023-08-15 Kenta Oono , Taiji Suzuki