English
Related papers

Related papers: What do CNNs Learn in the First Layer and Why? A L…

200 papers

Convolutional neural networks (CNNs) learn abstract features to perform object classification, but understanding these features remains challenging due to difficult-to-interpret results or high computational costs. We propose an automatic…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Maren H. Wehrheim , Pamela Osuna-Vargas , Matthias Kaschube

Deep learning has established many new state of the art solutions in the last decade in areas such as object, scene and speech recognition. In particular Convolutional Neural Network (CNN) is a category of deep learning which obtains…

Computer Vision and Pattern Recognition · Computer Science 2016-09-26 Vincent Andrearczyk , Paul F. Whelan

This paper is focused on studying the view-manifold structure in the feature spaces implied by the different layers of Convolutional Neural Networks (CNN). There are several questions that this paper aims to answer: Does the learned CNN…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Amr Bakry , Mohamed Elhoseiny , Tarek El-Gaaly , Ahmed Elgammal

Convolutional neural networks (CNNs) are widely used for image recognition and text analysis, and have been suggested for application on one-dimensional data as a way to reduce the need for pre-processing steps. Pre-processing is an…

Machine Learning · Computer Science 2020-05-18 Ine L. Jernelv , Dag Roar Hjelme , Yuji Matsuura , Astrid Aksnes

Many existing interpretation methods of convolutional neural networks (CNNs) mainly analyze in spatial domain, yet model interpretability in frequency domain has been rarely studied. To the best of our knowledge, there is no study on the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Zhongfan Jia , Chenglong Bao , Kaisheng Ma

Compared to earlier multistage frameworks using CNN features, recent end-to-end deep approaches for fine-grained recognition essentially enhance the mid-level learning capability of CNNs. Previous approaches achieve this by introducing an…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Yaming Wang , Vlad I. Morariu , Larry S. Davis

A basic operation in Convolutional Neural Networks (CNNs) is spatial resizing of feature maps. This is done either by strided convolution (donwscaling) or transposed convolution (upscaling). Such operations are limited to a fixed filter…

Machine Learning · Computer Science 2020-06-22 Assaf Shocher , Ben Feinstein , Niv Haim , Michal Irani

This paper presents an unsupervised method to learn a neural network, namely an explainer, to interpret a pre-trained convolutional neural network (CNN), i.e., explaining knowledge representations hidden in middle conv-layers of the CNN.…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Quanshi Zhang , Yu Yang , Yuchen Liu , Ying Nian Wu , Song-Chun Zhu

Scattering networks are a class of designed Convolutional Neural Networks (CNNs) with fixed weights. We argue they can serve as generic representations for modelling images. In particular, by working in scattering space, we achieve…

We describe the class of convexified convolutional neural networks (CCNNs), which capture the parameter sharing of convolutional neural networks in a convex manner. By representing the nonlinear convolutional filters as vectors in a…

Machine Learning · Computer Science 2016-09-06 Yuchen Zhang , Percy Liang , Martin J. Wainwright

Despite the phenomenal success of deep learning in recent years, there remains a gap in understanding the fundamental mechanics of neural nets. More research is focussed on handcrafting complex and larger networks, and the design decisions…

Machine Learning · Computer Science 2019-04-25 Saurav Basu , Koyel Mukherjee , Shrihari Vasudevan

This work investigates how using reduced precision data in Convolutional Neural Networks (CNNs) affects network accuracy during classification. More specifically, this study considers networks where each layer may use different precision…

In this paper we introduce a biologically inspired Convolutional Neural Network (CNN) architecture called LGN-CNN that has a first convolutional layer composed by a single filter that mimics the role of the Lateral Geniculate Nucleus (LGN).…

Neural and Evolutionary Computing · Computer Science 2021-10-29 Federico Bertoni , Giovanna Citti , Alessandro Sarti

We study the interplay between memorization and generalization of overparameterized networks in the extreme case of a single training example and an identity-mapping task. We examine fully-connected and convolutional networks (FCN and CNN),…

Machine Learning · Statistics 2020-01-10 Chiyuan Zhang , Samy Bengio , Moritz Hardt , Michael C. Mozer , Yoram Singer

We introduce a parameter sharing scheme, in which different layers of a convolutional neural network (CNN) are defined by a learned linear combination of parameter tensors from a global bank of templates. Restricting the number of templates…

Machine Learning · Computer Science 2019-03-15 Pedro Savarese , Michael Maire

Convolutional Neural Network (CNN) image classifiers are traditionally designed to have sequential convolutional layers with a single output layer. This is based on the assumption that all target classes should be treated equally and…

Computer Vision and Pattern Recognition · Computer Science 2017-10-06 Xinqi Zhu , Michael Bain

Deep convolutional neural networks (CNNs) have demonstrated impressive performance on visual object classification tasks. In addition, it is a useful model for predication of neuronal responses recorded in visual system. However, there is…

Machine Learning · Statistics 2017-11-15 Qi Yan , Zhaofei Yu , Feng Chen , Jian K. Liu

Convolutional Neural Networks (CNNs) have shown strong promise for analyzing scientific data from many domains including particle imaging detectors. However, the challenge of choosing the appropriate network architecture (depth, kernel…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Duc Hoang , Jesse Hamer , Gabriel N. Perdue , Steven R. Young , Jonathan Miller , Anushree Ghosh

Convolutional Neural Networks have shown promising effectiveness in identifying different types of cancer from radiographs. However, the opaque nature of CNNs makes it difficult to fully understand the way they operate, limiting their…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Michael Okonoda , Eder Martinez , Abhilekha Dalal , Lior Shamir

With the proliferation of deep convolutional neural network (CNN) algorithms for mobile processing, limited precision quantization has become an essential tool for CNN efficiency. Consequently, various works have sought to design fixed…

Machine Learning · Computer Science 2020-12-01 Stone Yun , Alexander Wong