English
Related papers

Related papers: General $E(2)$-Equivariant Steerable CNNs

200 papers

Euclidean deep learning is often inadequate for addressing real-world signals where the representation space is irregular and curved with complex topologies. Interpreting the geometric properties of such feature spaces has become paramount…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Ramzan Basheer , Deepak Mishra

We introduce Group equivariant Convolutional Neural Networks (G-CNNs), a natural generalization of convolutional neural networks that reduces sample complexity by exploiting symmetries. G-CNNs use G-convolutions, a new type of layer that…

Machine Learning · Computer Science 2016-06-06 Taco S. Cohen , Max Welling

We present Clifford-Steerable Convolutional Neural Networks (CS-CNNs), a novel class of $\mathrm{E}(p, q)$-equivariant CNNs. CS-CNNs process multivector fields on pseudo-Euclidean spaces $\mathbb{R}^{p,q}$. They cover, for instance,…

Machine Learning · Computer Science 2024-07-09 Maksim Zhdanov , David Ruhe , Maurice Weiler , Ana Lucic , Johannes Brandstetter , Patrick Forré

Group equivariant and steerable convolutional neural networks (regular and steerable G-CNNs) have recently emerged as a very effective model class for learning from signal data such as 2D and 3D images, video, and other data where…

Machine Learning · Computer Science 2018-04-02 Taco S. Cohen , Mario Geiger , Maurice Weiler

Convolutional neural networks (CNNs) have enabled the state-of-the-art performance in many computer vision tasks. However, little effort has been devoted to establishing convolution in non-linear space. Existing works mainly leverage on the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Chen Wang , Jianfei Yang , Lihua Xie , Junsong Yuan

Group convolutional neural networks (G-CNNs) have been shown to increase parameter efficiency and model accuracy by incorporating geometric inductive biases. In this work, we investigate the properties of representations learned by regular…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 David M. Knigge , David W. Romero , Erik J. Bekkers

Weight sharing in convolutional neural networks (CNNs) ensures that their feature maps will be translation-equivariant. However, although conventional convolutions are equivariant to translation, they are not equivariant to other isometries…

Instrumentation and Methods for Astrophysics · Physics 2021-03-10 Anna M. M. Scaife , Fiona Porter

We present a general theory of Group equivariant Convolutional Neural Networks (G-CNNs) on homogeneous spaces such as Euclidean space and the sphere. Feature maps in these networks represent fields on a homogeneous base space, and layers…

Machine Learning · Computer Science 2020-01-10 Taco Cohen , Mario Geiger , Maurice Weiler

We introduce Steerable Transformers, an extension of the Vision Transformer mechanism that maintains equivariance to the special Euclidean group $\mathrm{SE}(d)$. We propose an equivariant attention mechanism that operates on features…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Soumyabrata Kundu , Risi Kondor

We analyze the role of rotational equivariance in convolutional neural networks (CNNs) applied to spherical images. We compare the performance of the group equivariant networks known as S2CNNs and standard non-equivariant CNNs trained with…

Machine Learning · Computer Science 2022-07-13 Jan E. Gerken , Oscar Carlsson , Hampus Linander , Fredrik Ohlsson , Christoffer Petersson , Daniel Persson

Regular group convolutional neural networks (G-CNNs) have been shown to increase model performance and improve equivariance to different geometrical symmetries. This work addresses the problem of SE(3), i.e., roto-translation equivariance,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Thijs P. Kuipers , Erik J. Bekkers

The principle of equivariance to symmetry transformations enables a theoretically grounded approach to neural network architecture design. Equivariant networks have shown excellent performance and data efficiency on vision and medical…

Machine Learning · Computer Science 2019-05-15 Taco S. Cohen , Maurice Weiler , Berkay Kicanaoglu , Max Welling

With the growth of data from new radio telescope facilities, machine-learning approaches to the morphological classification of radio galaxies are increasingly being utilised. However, while widely employed deep-learning models using…

Instrumentation and Methods for Astrophysics · Physics 2025-06-30 Natalie E. P. Lines , Joan Font-Quer Roset , Anna M. M. Scaife

Group convolutional neural networks (G-CNNs) can be used to improve classical CNNs by equipping them with the geometric structure of groups. Central in the success of G-CNNs is the lifting of feature maps to higher dimensional disentangled…

Machine Learning · Computer Science 2021-03-23 Erik J Bekkers

Convolutional Neural Networks(CNN) are inherently equivariant under translations, however, they do not have an equivalent embedded mechanism to handle other transformations such as rotations and change in scale. Several approaches exist…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Naman Khetan , Tushar Arora , Samee Ur Rehman , Deepak K. Gupta

Convolutional Neural Networks (CNNs) traditionally encode translation equivariance via the convolution operation. Generalization to other transformations has recently received attraction to encode the knowledge of the data geometry in group…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Vincent Andrearczyk , Adrien Depeursinge

The translational equivariant nature of Convolutional Neural Networks (CNNs) is a reason for its great success in computer vision. However, networks do not enjoy more general equivariance properties such as rotation or scaling, ultimately…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Zikai Sun , Thierry Blu

Convolutional Neural Networks (CNNs) are extremely efficient, since they exploit the inherent translation-invariance of natural images. However, translation is just one of a myriad of useful spatial transformations. Can the same efficiency…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 João F. Henriques , Andrea Vedaldi

Motivated by the vast success of deep convolutional networks, there is a great interest in generalizing convolutions to non-Euclidean manifolds. A major complication in comparison to flat spaces is that it is unclear in which alignment a…

Machine Learning · Computer Science 2021-06-14 Maurice Weiler , Patrick Forré , Erik Verlinde , Max Welling

PDE-based Group Convolutional Neural Networks (PDE-G-CNNs) use solvers of evolution PDEs as substitutes for the conventional components in G-CNNs. PDE-G-CNNs can offer several benefits simultaneously: fewer parameters, inherent…

Machine Learning · Computer Science 2024-11-21 Gijs Bellaard , Sei Sakata , Bart M. N. Smets , Remco Duits