English
Related papers

Related papers: Learning Translation Invariance in CNNs

200 papers

At the core of self-supervised learning for vision is the idea of learning invariant or equivariant representations with respect to a set of data transformations. This approach, however, introduces strong inductive biases, which can render…

Machine Learning · Computer Science 2024-05-29 Sharut Gupta , Chenyu Wang , Yifei Wang , Tommi Jaakkola , Stefanie Jegelka

Recent experiments in computer vision demonstrate texture bias as the primary reason for supreme results in models employing Convolutional Neural Networks (CNNs), conflicting with early works claiming that these networks identify objects…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Satyam Mohla , Anshul Nasery , Biplab Banerjee

Transfer learning with models pretrained on ImageNet has become a standard practice in computer vision. Transfer learning refers to fine-tuning pretrained weights of a neural network on a downstream task, typically unrelated to ImageNet.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xander Coetzer , Arné Schreuder , Anna Sergeevna Bosman

The success of recent deep convolutional neural networks (CNNs) depends on learning hidden representations that can summarize the important factors of variation behind the data. However, CNNs often criticized as being black boxes that lack…

Computer Vision and Pattern Recognition · Computer Science 2018-06-27 Bolei Zhou , David Bau , Aude Oliva , Antonio Torralba

In recent years, supervised learning with convolutional networks (CNNs) has seen huge adoption in computer vision applications. Comparatively, unsupervised learning with CNNs has received less attention. In this work we hope to help bridge…

Machine Learning · Computer Science 2016-01-11 Alec Radford , Luke Metz , Soumith Chintala

Learning transformation invariant representations of visual data is an important problem in computer vision. Deep convolutional networks have demonstrated remarkable results for image and video classification tasks. However, they have…

Computer Vision and Pattern Recognition · Computer Science 2017-03-02 Renata Khasanova , Pascal Frossard

Convolutional Neural Networks (ConvNets) have shown excellent results on many visual classification tasks. With the exception of ImageNet, these datasets are carefully crafted such that objects are well-aligned at similar scales. Naturally,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-17 Angjoo Kanazawa , Abhishek Sharma , David Jacobs

Deep Convolutional Neural Networks (CNNs) are empirically known to be invariant to moderate translation but not to rotation in image classification. This paper proposes a deep CNN model, called CyCNN, which exploits polar mapping of input…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Jinpyo Kim , Wooekun Jung , Hyungmo Kim , Jaejin Lee

Image translation with convolutional neural networks has recently been used as an approach to multimodal change detection. Existing approaches train the networks by exploiting supervised information of the change areas, which, however, is…

Convolutional Neural Networks (CNNs) have become the state-of-the-art method to learn from image data. However, recent research shows that they may include a texture and colour bias in their representation, contrary to the intuition that…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Francis Brochu

It is known that humans display "shape bias" when classifying new items, i.e., they prefer to categorize objects based on their shape rather than color. Convolutional Neural Networks (CNNs) are also designed to take into account the spatial…

Computer Vision and Pattern Recognition · Computer Science 2018-03-22 Hossein Hosseini , Baicen Xiao , Mayoore Jaiswal , Radha Poovendran

Scene parsing is an important and challenging prob- lem in computer vision. It requires labeling each pixel in an image with the category it belongs to. Tradition- ally, it has been approached with hand-engineered features from color…

Machine Learning · Statistics 2014-11-18 Rahul Mohan

Even though convolutional neural networks can classify objects in images very accurately, it is well known that the attention of the network may not always be on the semantically important regions of the scene. It has been observed that…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Maliha Arif , Calvin Yong , Abhijit Mahalanobis

Tolerance to image variations (e.g. translation, scale, pose, illumination) is an important desired property of any object recognition system, be it human or machine. Moving towards increasingly bigger datasets has been trending in computer…

Computer Vision and Pattern Recognition · Computer Science 2016-01-27 Ali Borji , Saeed Izadi , Laurent Itti

Neural Representations have recently been shown to effectively reconstruct a wide range of signals from 3D meshes and shapes to images and videos. We show that, when adapted correctly, neural representations can be used to directly…

Machine Learning · Computer Science 2023-04-24 Maor Ashkenazi , Zohar Rimon , Ron Vainshtein , Shir Levi , Elad Richardson , Pinchas Mintz , Eran Treister

To tackle increasingly complex tasks, it has become an essential ability of neural networks to learn abstract representations. These task-specific representations and, particularly, the invariances they capture turn neural networks into…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Robin Rombach , Patrick Esser , Björn Ommer

We address the problem that state-of-the-art Convolution Neural Networks (CNN) classifiers are not invariant to small shifts. The problem can be solved by the removal of sub-sampling operations such as stride and max pooling, but at a cost…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Ganesh Sundaramoorthi , Timothy E. Wang

This article is about the cognitive science of visual art. Artists create physical artifacts (such as sculptures or paintings) which depict people, objects, and events. These depictions are usually stylized rather than photo-realistic. How…

Artificial Intelligence · Computer Science 2019-11-19 Owain Evans

Interpreting how does deep neural networks (DNNs) make predictions is a vital field in artificial intelligence, which hinders wide applications of DNNs. Visualization of learned representations helps we humans understand the vision of DNNs.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Chen Li , Jinzhe Jiang , Xin Zhang , Tonghuan Zhang , Yaqian Zhao , Dongdong Jiang , RenGang Li

Understanding how cities visually differ from each others is interesting for planners, residents, and historians. We investigate the interpretation of deep features learned by convolutional neural networks (CNNs) for city recognition. Given…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Xiangwei Shi , Seyran Khademi , Jan van Gemert