English
Related papers

Related papers: Harmonic Networks: Deep Translation and Rotation E…

200 papers

In this paper, we propose a novel deep convolutional neural network (CNN)-based algorithm for solving ill-posed inverse problems. Regularized iterative algorithms have emerged as the standard approach to ill-posed inverse problems in the…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Kyong Hwan Jin , Michael T. McCann , Emmanuel Froustey , Michael Unser

The translation equivariance of convolutional layers enables convolutional neural networks to generalize well on image problems. While translation equivariance provides a powerful inductive bias for images, we often additionally desire…

Machine Learning · Statistics 2020-09-25 Marc Finzi , Samuel Stanton , Pavel Izmailov , Andrew Gordon Wilson

In this paper we challenge the common assumption that convolutional layers in modern CNNs are translation invariant. We show that CNNs can and will exploit the absolute spatial location by learning filters that respond exclusively to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Osman Semih Kayhan , Jan C. van Gemert

3D Convolutional Neural Networks are sensitive to transformations applied to their input. This is a problem because a voxelized version of a 3D object, and its rotated clone, will look unrelated to each other after passing through to the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Daniel Worrall , Gabriel Brostow

We present a method for learning discriminative filters using a shallow Convolutional Neural Network (CNN). We encode rotation invariance directly in the model by tying the weights of groups of filters to several rotated versions of the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Diego Marcos , Michele Volpi , Devis Tuia

Convolutional networks are successful due to their equivariance/invariance under translations. However, rotatable data such as images, volumes, shapes, or point clouds require processing with equivariance/invariance under rotations in cases…

Machine Learning · Computer Science 2021-11-23 Luca Della Libera , Vladimir Golkov , Yue Zhu , Arman Mielke , Daniel Cremers

The effectiveness of Convolutional Neural Networks (CNNs) has been substantially attributed to their built-in property of translation equivariance. However, CNNs do not have embedded mechanisms to handle other types of transformations. In…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Ivan Sosnovik , Michał Szmaja , Arnold Smeulders

Recently, learning equivariant representations has attracted considerable research attention. Dieleman et al. introduce four operations which can be inserted into convolutional neural network to learn deep representations equivariant to…

Computer Vision and Pattern Recognition · Computer Science 2018-03-01 Junying Li , Zichen Yang , Haifeng Liu , Deng Cai

In this paper, we theoretically address three fundamental problems involving deep convolutional networks regarding invariance, depth and hierarchy. We introduce the paradigm of Transformation Networks (TN) which are a direct generalization…

Computer Vision and Pattern Recognition · Computer Science 2017-02-27 Dipan K. Pal , Marios Savvides

The topic of achieving rotational invariance in convolutional neural networks (CNNs) has gained considerable attention recently, as this invariance is crucial for many computer vision tasks such as image classification and matching. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Hanlin Mo , Guoying Zhao

Spherical convolutional networks have been introduced recently as tools to learn powerful feature representations of 3D shapes. Spherical CNNs are equivariant to 3D rotations making them ideally suited to applications where 3D data may be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Carlos Esteves , Avneesh Sud , Zhengyi Luo , Kostas Daniilidis , Ameesh Makadia

Learning transformation invariant representations of visual data is an important problem in computer vision. Deep convolutional networks have demonstrated remarkable results for image and video classification tasks. However, they have…

Computer Vision and Pattern Recognition · Computer Science 2017-03-02 Renata Khasanova , Pascal Frossard

Feature extraction with convolutional neural networks (CNNs) is a popular method to represent images for machine learning tasks. These representations seek to capture global image content, and ideally should be independent of geometric…

Machine Learning · Computer Science 2022-03-03 Jake Lee , Junfeng Yang , Zhangyang Wang

Learning transformation invariant representations of visual data is an important problem in computer vision. Deep convolutional networks have demonstrated remarkable results for image and video classification tasks. However, they have…

Computer Vision and Pattern Recognition · Computer Science 2018-08-23 Renata Khasanova , Pascal Frossard

A large number of deep learning architectures use spatial transformations of CNN feature maps or filters to better deal with variability in object appearance caused by natural image transformations. In this paper, we prove that spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Ylva Jansson , Maksim Maydanskiy , Lukas Finnveden , Tony Lindeberg

The principle of translation equivariance (if an input image is translated an output image should be translated by the same amount), led to the development of convolutional neural networks that revolutionized machine vision. Other…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Zachary Schlamowitz , Andrew Bennecke , Daniel J. Tward

Convolutional neural networks (CNN) are widely used in computer vision, especially in image classification. However, the way in which information and invariance properties are encoded through in deep CNN architectures is still an open…

Computer Vision and Pattern Recognition · Computer Science 2016-10-26 Michael Blot , Matthieu Cord , Nicolas Thome

Vision Transformers have achieved great success in computer visions, delivering exceptional performance across various tasks. However, their inherent reliance on sequential input enforces the manual partitioning of images into patch…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Changzhen Li , Jie Zhang , Yang Wei , Zhilong Ji , Jinfeng Bai , Shiguang Shan

Image representations, from SIFT and Bag of Visual Words to Convolutional Neural Networks (CNNs), are a crucial component of almost any image understanding system. Nevertheless, our understanding of them remains limited. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2014-12-02 Aravindh Mahendran , Andrea Vedaldi

Many problems across computer vision and the natural sciences require the analysis of spherical data, for which representations may be learned efficiently by encoding equivariance to rotational symmetries. We present a generalized spherical…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Oliver J. Cobb , Christopher G. R. Wallis , Augustine N. Mavor-Parker , Augustin Marignier , Matthew A. Price , Mayeul d'Avezac , Jason D. McEwen