English
Related papers

Related papers: Learning Translation Invariance in CNNs

200 papers

Rotation invariance and translation invariance have great values in image recognition tasks. In this paper, we bring a new architecture in convolutional neural network (CNN) named cyclic convolutional layer to achieve rotation invariance in…

Computer Vision and Pattern Recognition · Computer Science 2017-06-20 Shiyuan Li

Convolutional Neural Networks (CNNs), architectures consisting of convolutional layers, have been the standard choice in vision tasks. Recent studies have shown that Vision Transformers (VTs), architectures based on self-attention modules,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Kishaan Jeeveswaran , Senthilkumar Kathiresan , Arnav Varma , Omar Magdy , Bahram Zonooz , Elahe Arani

Deep convolutional neural networks learn extremely powerful image representations, yet most of that power is hidden in the millions of deep-layer parameters. What exactly do these parameters represent? Recent work has started to analyse CNN…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Xingchao Peng , Baochen Sun , Karim Ali , Kate Saenko

Invariance to spatial transformations such as translations and rotations is a desirable property and a basic design principle for classification neural networks. However, the commonly used convolutional neural networks (CNNs) are actually…

Machine Learning · Computer Science 2023-06-30 Yihan Wang , Lijia Yu , Xiao-Shan Gao

Current research in Computer Vision has shown that Convolutional Neural Networks (CNN) give state-of-the-art performance in many classification tasks and Computer Vision problems. The embedding of CNN, which is the internal representation…

Computer Vision and Pattern Recognition · Computer Science 2015-08-04 Axel Angel

Vision Transformers (VTs) are becoming a valuable alternative to Convolutional Neural Networks (CNNs) when it comes to problems involving high-dimensional and spatially organized inputs such as images. However, their Transfer Learning (TL)…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Vincent Tonkes , Matthia Sabatelli

Han et al. (2020) reported a behavioral experiment that assessed the extent to which the human visual system can identify novel images at unseen retinal locations (what the authors call "intrinsic translation invariance") and developed a…

Neurons and Cognition · Quantitative Biology 2020-12-15 Ryan Blything , Valerio Biscione , Jeffrey Bowers

We develop a model of perceptual similarity judgment based on re-training a deep convolution neural network (DCNN) that learns to associate different views of each 3D object to capture the notion of object persistence and continuity in our…

Computer Vision and Pattern Recognition · Computer Science 2017-04-04 Xingyu Lin , Hao Wang , Zhihao Li , Yimeng Zhang , Alan Yuille , Tai Sing Lee

Convolutional neural networks (CNN's) are powerful and widely used tools. However, their interpretability is far from ideal. One such shortcoming is the difficulty of deducing a network's ability to generalize to unseen data. We use…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Rickard Brüel Gabrielsson , Gunnar Carlsson

This paper presents an unsupervised method to learn a neural network, namely an explainer, to interpret a pre-trained convolutional neural network (CNN), i.e., the explainer uses interpretable visual concepts to explain features in middle…

Machine Learning · Computer Science 2019-01-24 Quanshi Zhang , Yu Yang , Ying Nian Wu

Convolutional Neural Networks (CNNs) are commonly thought to recognise objects by learning increasingly complex representations of object shapes. Some recent studies suggest a more important role of image textures. We here put these…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Robert Geirhos , Patricia Rubisch , Claudio Michaelis , Matthias Bethge , Felix A. Wichmann , Wieland Brendel

Feature extraction with convolutional neural networks (CNNs) is a popular method to represent images for machine learning tasks. These representations seek to capture global image content, and ideally should be independent of geometric…

Machine Learning · Computer Science 2022-03-03 Jake Lee , Junfeng Yang , Zhangyang Wang

Contrasting the previous evidence that neurons in the later layers of a Convolutional Neural Network (CNN) respond to complex object shapes, recent studies have shown that CNNs actually exhibit a `texture bias': given an image with both…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Md Amirul Islam , Matthew Kowal , Patrick Esser , Sen Jia , Bjorn Ommer , Konstantinos G. Derpanis , Neil Bruce

Visual illusions teach us that what we see is not always what it is represented in the physical world. Its special nature make them a fascinating tool to test and validate any new vision model proposed. In general, current vision models are…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Alexander Gomez-Villa , Adrián Martín , Javier Vazquez-Corral , Marcelo Bertalmío

Convolutional Neural Networks (CNNs) for visual tasks are believed to learn both the low-level textures and high-level object attributes, throughout the network depth. This paper further investigates the `texture bias' in CNNs. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Amin Banitalebi-Dehkordi , Yong Zhang

Invariances to translations have imbued convolutional neural networks with powerful generalization properties. However, we often do not know a priori what invariances are present in the data, or to what extent a model should be invariant to…

Machine Learning · Computer Science 2020-12-02 Gregory Benton , Marc Finzi , Pavel Izmailov , Andrew Gordon Wilson

Deep convolutional neural networks (CNNs) have demonstrated impressive performance on many visual tasks. Recently, they became useful models for the visual system in neuroscience. However, it is still not clear what are learned by CNNs in…

Neurons and Cognition · Quantitative Biology 2020-02-19 Qi Yan , Yajing Zheng , Shanshan Jia , Yichen Zhang , Zhaofei Yu , Feng Chen , Yonghong Tian , Tiejun Huang , Jian K. Liu

This paper presents an unsupervised method to learn a neural network, namely an explainer, to interpret a pre-trained convolutional neural network (CNN), i.e., explaining knowledge representations hidden in middle conv-layers of the CNN.…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Quanshi Zhang , Yu Yang , Yuchen Liu , Ying Nian Wu , Song-Chun Zhu

Deep artificial neural networks have made remarkable progress in different tasks in the field of computer vision. However, the empirical analysis of these models and investigation of their failure cases has received attention recently. In…

Computer Vision and Pattern Recognition · Computer Science 2016-02-10 Babak Saleh , Ahmed Elgammal , Jacob Feldman

In contrast to fully connected networks, Convolutional Neural Networks (CNNs) achieve efficiency by learning weights associated with local filters with a finite spatial extent. An implication of this is that a filter may know what it is…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Md Amirul Islam , Sen Jia , Neil D. B. Bruce