English
Related papers

Related papers: Empowering Networks With Scale and Rotation Equiva…

200 papers

The effectiveness of Convolutional Neural Networks (CNNs) has been substantially attributed to their built-in property of translation equivariance. However, CNNs do not have embedded mechanisms to handle other types of transformations. In…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Ivan Sosnovik , Michał Szmaja , Arnold Smeulders

State-of-the-art deep learning systems often require large amounts of data and computation. For this reason, leveraging known or unknown structure of the data is paramount. Convolutional neural networks (CNNs) are successful examples of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Carlos Esteves

In this work we investigate how to achieve equivariance to input transformations in deep networks, purely from data, without being given a model of those transformations. Convolutional Neural Networks (CNNs), for example, are equivariant to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Jianbo Jiao , João F. Henriques

Convolutional Neural Networks (CNN) offer state of the art performance in various computer vision tasks. Many of those tasks require different subtypes of affine invariances (scale, rotational, translational) to image transformations.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Facundo Manuel Quiroga , Franco Ronchetti , Laura Lanzarini , Aurelio Fernandez-Bariviera

Encoding the scale information explicitly into the representation learned by a convolutional neural network (CNN) is beneficial for many computer vision tasks especially when dealing with multiscale inputs. We study, in this paper, a…

Machine Learning · Computer Science 2022-02-08 Wei Zhu , Qiang Qiu , Robert Calderbank , Guillermo Sapiro , Xiuyuan Cheng

Translating or rotating an input image should not affect the results of many computer vision tasks. Convolutional neural networks (CNNs) are already translation equivariant: input image translations produce proportionate feature map…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Daniel E. Worrall , Stephan J. Garbin , Daniyar Turmukhambetov , Gabriel J. Brostow

Convolutional Neural Networks (CNNs) are extremely efficient, since they exploit the inherent translation-invariance of natural images. However, translation is just one of a myriad of useful spatial transformations. Can the same efficiency…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 João F. Henriques , Andrea Vedaldi

The translation equivariance of convolutions can make convolutional neural networks translation equivariant or invariant. Equivariance to other transformations (e.g. rotations, affine transformations, scalings) may also be desirable as soon…

Signal Processing · Electrical Eng. & Systems 2021-05-05 Mateus Sangalli , Samy Blusseau , Santiago Velasco-Forero , Jesus Angulo

The weight-sharing mechanism of convolutional kernels ensures translation-equivariance of convolution neural networks (CNNs). Recently, rotation-equivariance has been investigated. However, research on scale-equivariance or simultaneous…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Wei-Dong Qiao , Yang Xu , Hui Li

Invariance to spatial transformations such as translations and rotations is a desirable property and a basic design principle for classification neural networks. However, the commonly used convolutional neural networks (CNNs) are actually…

Machine Learning · Computer Science 2023-06-30 Yihan Wang , Lijia Yu , Xiao-Shan Gao

We analyze the role of rotational equivariance in convolutional neural networks (CNNs) applied to spherical images. We compare the performance of the group equivariant networks known as S2CNNs and standard non-equivariant CNNs trained with…

Machine Learning · Computer Science 2022-07-13 Jan E. Gerken , Oscar Carlsson , Hampus Linander , Fredrik Ohlsson , Christoffer Petersson , Daniel Persson

For many years, it has been shown how much exploiting equivariances can be beneficial when solving image analysis tasks. For example, the superiority of convolutional neural networks (CNNs) compared to dense networks mainly comes from an…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Valentin Delchevalerie , Alexandre Mayer , Adrien Bibal , Benoît Frénay

Convolutional Neural Networks (CNNs) traditionally encode translation equivariance via the convolution operation. Generalization to other transformations has recently received attraction to encode the knowledge of the data geometry in group…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Vincent Andrearczyk , Adrien Depeursinge

The principle of equivariance to symmetry transformations enables a theoretically grounded approach to neural network architecture design. Equivariant networks have shown excellent performance and data efficiency on vision and medical…

Machine Learning · Computer Science 2019-05-15 Taco S. Cohen , Maurice Weiler , Berkay Kicanaoglu , Max Welling

The widespread success of convolutional neural networks may largely be attributed to their intrinsic property of translation equivariance. However, convolutions are not equivariant to variations in scale and fail to generalize to objects of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Thomas Altstidl , An Nguyen , Leo Schwinn , Franz Köferl , Christopher Mutschler , Björn Eskofier , Dario Zanca

The ability of convolutional neural networks (CNNs) to recognize objects regardless of their position in the image is due to the translation-equivariance of the convolutional operation. Group-equivariant CNNs transfer this equivariance to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Thomas Wimmer , Vladimir Golkov , Hoai Nam Dang , Moritz Zaiss , Andreas Maier , Daniel Cremers

An important goal in visual recognition is to devise image representations that are invariant to particular transformations. In this paper, we address this goal with a new type of convolutional neural network (CNN) whose invariance is…

Computer Vision and Pattern Recognition · Computer Science 2015-01-08 Julien Mairal , Piotr Koniusz , Zaid Harchaoui , Cordelia Schmid

The translation equivariance of convolutional layers enables convolutional neural networks to generalize well on image problems. While translation equivariance provides a powerful inductive bias for images, we often additionally desire…

Machine Learning · Statistics 2020-09-25 Marc Finzi , Samuel Stanton , Pavel Izmailov , Andrew Gordon Wilson

We introduce Group equivariant Convolutional Neural Networks (G-CNNs), a natural generalization of convolutional neural networks that reduces sample complexity by exploiting symmetries. G-CNNs use G-convolutions, a new type of layer that…

Machine Learning · Computer Science 2016-06-06 Taco S. Cohen , Max Welling

In many machine learning tasks it is desirable that a model's prediction transforms in an equivariant way under transformations of its input. Convolutional neural networks (CNNs) implement translational equivariance by construction; for…

Machine Learning · Computer Science 2018-03-20 Maurice Weiler , Fred A. Hamprecht , Martin Storath
‹ Prev 1 2 3 10 Next ›