English
Related papers

Related papers: Learning Translation Invariance in CNNs

200 papers

Convolutional neural networks have recently shown excellent results in general object detection and many other tasks. Albeit very effective, they involve many user-defined design choices. In this paper we want to better understand these…

Computer Vision and Pattern Recognition · Computer Science 2015-08-19 Bojan Pepik , Rodrigo Benenson , Tobias Ritschel , Bernt Schiele

Convolutional neural networks (CNNs) have been successfully used in a range of tasks. However, CNNs are often viewed as "black-box" and lack of interpretability. One main reason is due to the filter-class entanglement -- an intricate…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Haoyu Liang , Zhihao Ouyang , Yuyuan Zeng , Hang Su , Zihao He , Shu-Tao Xia , Jun Zhu , Bo Zhang

Humans are generally good at learning abstract concepts about objects and scenes (e.g.\ spatial orientation, relative sizes, etc.). Over the last years convolutional neural networks have achieved almost human performance in recognizing…

Computer Vision and Pattern Recognition · Computer Science 2016-08-01 Sebastian Stabinger , Antonio Rodriguez-Sanchez , Justus Piater

This paper reviews recent studies in understanding neural-network representations and learning neural networks with interpretable/disentangled middle-layer representations. Although deep neural networks have exhibited superior performance…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Quanshi Zhang , Song-Chun Zhu

In this paper we propose integrating a priori knowledge into both design and training of convolutional neural networks (CNNs) to learn object representations that are invariant to affine transformations (i.e., translation, scale, rotation).…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Xenju Xu , Guanghui Wang , Alan Sullivan , Ziming Zhang

Recognizing the actions of others from visual stimuli is a crucial aspect of human visual perception that allows individuals to respond to social cues. Humans are able to identify similar behaviors and discriminate between distinct actions…

Neurons and Cognition · Quantitative Biology 2018-02-07 Andrea Tacchetti , Leyla Isik , Tomaso Poggio

Vision transformers (ViTs) are quickly becoming the de-facto architecture for computer vision, yet we understand very little about why they work and what they learn. While existing studies visually analyze the mechanisms of convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Amin Ghiasi , Hamid Kazemi , Eitan Borgnia , Steven Reich , Manli Shu , Micah Goldblum , Andrew Gordon Wilson , Tom Goldstein

This report deals with translation invariance of convolutional neural networks (CNNs) for automatic target recognition (ATR) from synthetic aperture radar (SAR) imagery. In particular, the translation invariance of CNNs for SAR ATR…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Hidetoshi Furukawa

Although Convolutional Neural Networks (CNNs) are widely used, their translation invariance (ability to deal with translated inputs) is still subject to some controversy. We explore this question using translation-sensitivity maps to…

Machine Learning · Computer Science 2021-04-20 Johannes C. Myburgh , Coenraad Mouton , Marelie H. Davel

We attempt to interpret how adversarially trained convolutional neural networks (AT-CNNs) recognize objects. We design systematic approaches to interpret AT-CNNs in both qualitative and quantitative ways and compare them with normally…

Machine Learning · Computer Science 2019-05-24 Tianyuan Zhang , Zhanxing Zhu

Our ability to interact with the world around us relies on being able to infer what actions objects afford -- often referred to as affordances. The neural mechanisms of object-action associations are realized in the visuomotor pathway where…

Neurons and Cognition · Quantitative Biology 2020-02-24 Aria Yuan Wang , Michael J. Tarr

Recent work suggests that changing Convolutional Neural Network (CNN) architecture by introducing a bottleneck in the second layer can yield changes in learned function. To understand this relationship fully requires a way of quantitatively…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Ethan Harris , Daniela Mihai , Jonathon Hare

Recent advances in hardware and big data acquisition have accelerated the development of deep learning techniques. For an extended period of time, increasing the model complexity has led to performance improvements for various tasks.…

Machine Learning · Computer Science 2023-07-24 Damian Owerko , Charilaos I. Kanatsoulis , Jennifer Bondarchuk , Donald J. Bucci , Alejandro Ribeiro

Neural networks have greatly boosted performance in computer vision by learning powerful representations of input data. The drawback of end-to-end training for maximal overall performance are black-box models whose hidden representations…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Patrick Esser , Robin Rombach , Björn Ommer

Translating or rotating an input image should not affect the results of many computer vision tasks. Convolutional neural networks (CNNs) are already translation equivariant: input image translations produce proportionate feature map…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Daniel E. Worrall , Stephan J. Garbin , Daniyar Turmukhambetov , Gabriel J. Brostow

Natural images are generated under many factors, including shape, pose, illumination etc. Most existing ConvNets formulate object recognition from natural images as a single task classification problem, and attempt to learn features useful…

Computer Vision and Pattern Recognition · Computer Science 2017-01-24 Jiaping Zhao , Chin-kai Chang , Laurent Itti

Convolutional Neural Networks (CNN) offer state of the art performance in various computer vision tasks. Many of those tasks require different subtypes of affine invariances (scale, rotational, translational) to image transformations.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Facundo Manuel Quiroga , Franco Ronchetti , Laura Lanzarini , Aurelio Fernandez-Bariviera

The purpose of this short and simple note is to clarify a common misconception about convolutional neural networks (CNNs). CNNs are made up of convolutional layers which are shift equivariant due to weight sharing. However, convolutional…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Nick McGreivy , Ammar Hakim

ConvNets, through their architecture, only enforce invariance to translation. In this paper, we introduce a new class of deep convolutional architectures called Non-Parametric Transformation Networks (NPTNs) which can learn \textit{general}…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Dipan K. Pal , Marios Savvides

In this paper we explore tying together the ideas from Scattering Transforms and Convolutional Neural Networks (CNN) for Image Analysis by proposing a learnable ScatterNet. Previous attempts at tying them together in hybrid networks have…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Fergal Cotter , Nick Kingsbury