English
Related papers

Related papers: Learning Partial Equivariances from Data

200 papers

Translating or rotating an input image should not affect the results of many computer vision tasks. Convolutional neural networks (CNNs) are already translation equivariant: input image translations produce proportionate feature map…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Daniel E. Worrall , Stephan J. Garbin , Daniyar Turmukhambetov , Gabriel J. Brostow

The translational equivariant nature of Convolutional Neural Networks (CNNs) is a reason for its great success in computer vision. However, networks do not enjoy more general equivariance properties such as rotation or scaling, ultimately…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Zikai Sun , Thierry Blu

The translation equivariance of convolutions can make convolutional neural networks translation equivariant or invariant. Equivariance to other transformations (e.g. rotations, affine transformations, scalings) may also be desirable as soon…

Signal Processing · Electrical Eng. & Systems 2021-05-05 Mateus Sangalli , Samy Blusseau , Santiago Velasco-Forero , Jesus Angulo

Quantum Neural Networks (QNNs) are suggested as one of the quantum algorithms which can be efficiently simulated with a low depth on near-term quantum hardware in the presence of noises. However, their performance highly relies on choosing…

Quantum Physics · Physics 2024-03-14 Su Yeon Chang , Michele Grossi , Bertrand Le Saux , Sofia Vallecorsa

3D Convolutional Neural Networks are sensitive to transformations applied to their input. This is a problem because a voxelized version of a 3D object, and its rotated clone, will look unrelated to each other after passing through to the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Daniel Worrall , Gabriel Brostow

Convolutional neural networks (CNNs) have achieved state-of-the-art results on many visual recognition tasks. However, current CNN models still exhibit a poor ability to be invariant to spatial transformations of images. Intuitively, with…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Xu Shen , Xinmei Tian , Anfeng He , Shaoyan Sun , Dacheng Tao

Group equivariant neural networks have been explored in the past few years and are interesting from theoretical and practical standpoints. They leverage concepts from group representation theory, non-commutative harmonic analysis and…

Machine Learning · Computer Science 2020-05-01 Carlos Esteves

Convolutional Neural Networks (CNNs) traditionally encode translation equivariance via the convolution operation. Generalization to other transformations has recently received attraction to encode the knowledge of the data geometry in group…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Vincent Andrearczyk , Adrien Depeursinge

One of the most fundamental problems in machine learning is to compare examples: Given a pair of objects we want to return a value which indicates degree of (dis)similarity. Similarity is often task specific, and pre-defined distances can…

Machine Learning · Statistics 2022-08-31 Shubhendu Trivedi

Many scientific problems require to process data in the form of geometric graphs. Unlike generic graph data, geometric graphs exhibit symmetries of translations, rotations, and/or reflections. Researchers have leveraged such inductive bias…

Machine Learning · Computer Science 2022-02-23 Jiaqi Han , Yu Rong , Tingyang Xu , Wenbing Huang

The ability of convolutional neural networks (CNNs) to recognize objects regardless of their position in the image is due to the translation-equivariance of the convolutional operation. Group-equivariant CNNs transfer this equivariance to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Thomas Wimmer , Vladimir Golkov , Hoai Nam Dang , Moritz Zaiss , Andreas Maier , Daniel Cremers

The weight-sharing mechanism of convolutional kernels ensures translation-equivariance of convolution neural networks (CNNs). Recently, rotation-equivariance has been investigated. However, research on scale-equivariance or simultaneous…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Wei-Dong Qiao , Yang Xu , Hui Li

Convolutional neural networks (CNNs) have rapidly risen in popularity for many machine learning applications, particularly in the field of image recognition. Much of the benefit generated from these networks comes from their ability to…

Quantum Physics · Physics 2019-04-10 Maxwell Henderson , Samriddhi Shakya , Shashindra Pradhan , Tristan Cook

Although group convolutional networks are able to learn powerful representations based on symmetry patterns, they lack explicit means to learn meaningful relationships among them (e.g., relative positions and poses). In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 David W. Romero , Erik J. Bekkers , Jakub M. Tomczak , Mark Hoogendoorn

Graph Convolutional Networks (GCNs) are a class of general models that can learn from graph structured data. Despite being general, GCNs are admittedly inferior to convolutional neural networks (CNNs) when applied to vision tasks, mainly…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Boris Knyazev , Xiao Lin , Mohamed R. Amer , Graham W. Taylor

Regular group convolutional neural networks (G-CNNs) have been shown to increase model performance and improve equivariance to different geometrical symmetries. This work addresses the problem of SE(3), i.e., roto-translation equivariance,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Thijs P. Kuipers , Erik J. Bekkers

We introduce a general method for achieving robust group-invariance in group-equivariant convolutional neural networks ($G$-CNNs), which we call the $G$-triple-correlation ($G$-TC) layer. The approach leverages the theory of the…

Machine Learning · Computer Science 2024-01-29 Sophia Sanborn , Nina Miolane

Group convolutional neural networks (G-CNNs) can be used to improve classical CNNs by equipping them with the geometric structure of groups. Central in the success of G-CNNs is the lifting of feature maps to higher dimensional disentangled…

Machine Learning · Computer Science 2021-03-23 Erik J Bekkers

The Convolutional Neural Network (CNN) has achieved great success in image classification. The classification model can also be utilized at image or patch level for many other applications, such as object detection and segmentation. In this…

Computer Vision and Pattern Recognition · Computer Science 2014-12-23 Jun Yuan , Bingbing Ni , Ashraf A. Kassim

Learning to reason about relations and dynamics over multiple interacting objects is a challenging topic in machine learning. The challenges mainly stem from that the interacting systems are exponentially-compositional, symmetrical, and…

Machine Learning · Computer Science 2022-03-15 Wenbing Huang , Jiaqi Han , Yu Rong , Tingyang Xu , Fuchun Sun , Junzhou Huang