English
Related papers

Related papers: Equivalence Between SE(3) Equivariant Networks via…

200 papers

Convolutional Neural Networks(CNN) are inherently equivariant under translations, however, they do not have an equivalent embedded mechanism to handle other transformations such as rotations and change in scale. Several approaches exist…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Naman Khetan , Tushar Arora , Samee Ur Rehman , Deepak K. Gupta

The ability of convolutional neural networks (CNNs) to recognize objects regardless of their position in the image is due to the translation-equivariance of the convolutional operation. Group-equivariant CNNs transfer this equivariance to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Thomas Wimmer , Vladimir Golkov , Hoai Nam Dang , Moritz Zaiss , Andreas Maier , Daniel Cremers

Steerable models can provide very general and flexible equivariance by formulating equivariance requirements in the language of representation theory and feature fields, which has been recognized to be effective for many vision tasks.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Zhengyang Shen , Tao Hong , Qi She , Jinwen Ma , Zhouchen Lin

Convolutional neural networks revolutionized computer vision and natrual language processing. Their efficiency, as compared to fully connected neural networks, has its origin in the architecture, where convolutions reflect the translation…

Machine Learning · Computer Science 2023-01-10 Patrick Krüger , Hanno Gottschalk

Convolutional networks are successful due to their equivariance/invariance under translations. However, rotatable data such as images, volumes, shapes, or point clouds require processing with equivariance/invariance under rotations in cases…

Machine Learning · Computer Science 2021-11-23 Luca Della Libera , Vladimir Golkov , Yue Zhu , Arman Mielke , Daniel Cremers

In recent years the use of convolutional layers to encode an inductive bias (translational equivariance) in neural networks has proven to be a very fruitful idea. The successes of this approach have motivated a line of research into…

Steerable CNN imposes the prior knowledge of transformation invariance or equivariance in the network architecture to enhance the the network robustness on geometry transformation of data and reduce overfitting. It has been an intuitive and…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Bo Li , Qili Wang , Gim Hee Lee

We present an alternative way of solving the steerable kernel constraint that appears in the design of steerable equivariant convolutional neural networks. We find explicit real and complex bases which are ready to use, for different…

Machine Learning · Computer Science 2026-03-16 Alan Garbarz

When manipulating three-dimensional data, it is possible to ensure that rotational and translational symmetries are respected by applying so-called SE(3)-equivariant models. Protein structure prediction is a prominent example of a task…

Machine Learning · Computer Science 2021-03-17 Fabian B. Fuchs , Edward Wagstaff , Justas Dauparas , Ingmar Posner

Symmetry is present in many tasks in computer vision, where the same class of objects can appear transformed, e.g. rotated due to different camera orientations, or scaled due to perspective. The knowledge of such symmetries in data coupled…

Image and Video Processing · Electrical Eng. & Systems 2022-07-25 Mateus Sangalli , Samy Blusseau , Santiago Velasco-Forero , Jesús Angulo

In this work we investigate how to achieve equivariance to input transformations in deep networks, purely from data, without being given a model of those transformations. Convolutional Neural Networks (CNNs), for example, are equivariant to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Jianbo Jiao , João F. Henriques

Steerable convolutional neural networks (CNNs) provide a general framework for building neural networks equivariant to translations and transformations of an origin-preserving group $G$, such as reflections and rotations. They rely on…

Machine Learning · Computer Science 2023-10-30 Maksim Zhdanov , Nico Hoffmann , Gabriele Cesa

Deep learning for predicting the electronic-structure Hamiltonian of quantum systems necessitates satisfying the covariance laws, among which achieving SO(3)-equivariance without sacrificing the non-linear expressive capability of networks…

Computational Physics · Physics 2024-06-25 Shi Yin , Xinyang Pan , Xudong Zhu , Tianyu Gao , Haochong Zhang , Feng Wu , Lixin He

Deploying 3D graph neural networks (GNNs) that are equivariant to 3D rotations (the group SO(3)) on edge devices is challenging due to their high computational cost. This paper addresses the problem by compressing and accelerating an…

Machine Learning · Computer Science 2026-03-04 Haoyu Zhou , Ping Xue , Hao Zhang , Tianfan Fu

Weight sharing in convolutional neural networks (CNNs) ensures that their feature maps will be translation-equivariant. However, although conventional convolutions are equivariant to translation, they are not equivariant to other isometries…

Instrumentation and Methods for Astrophysics · Physics 2021-03-10 Anna M. M. Scaife , Fiona Porter

Rigid motion tracking is paramount in many medical imaging applications where movements need to be detected, corrected, or accounted for. Modern strategies rely on convolutional neural networks (CNN) and pose this problem as rigid…

Image and Video Processing · Electrical Eng. & Systems 2024-06-13 Benjamin Billot , Neel Dey , Daniel Moyer , Malte Hoffmann , Esra Abaci Turk , Borjan Gagoski , Ellen Grant , Polina Golland

The translation equivariance of convolutions can make convolutional neural networks translation equivariant or invariant. Equivariance to other transformations (e.g. rotations, affine transformations, scalings) may also be desirable as soon…

Signal Processing · Electrical Eng. & Systems 2021-05-05 Mateus Sangalli , Samy Blusseau , Santiago Velasco-Forero , Jesus Angulo

This paper develops a rotation-invariant needlet convolution for rotation group SO(3) to distill multiscale information of spherical signals. The spherical needlet transform is generalized from $\mathbb{S}^2$ onto the SO(3) group, which…

Image and Video Processing · Electrical Eng. & Systems 2022-06-22 Kai Yi , Jialin Chen , Yu Guang Wang , Bingxin Zhou , Pietro Liò , Yanan Fan , Jan Hamann

Steerable convolutional neural networks (SCNNs) enhance task performance by modelling geometric symmetries through equivariance constraints on weights. Yet, unknown or varying symmetries can lead to overconstrained weights and decreased…

Machine Learning · Computer Science 2025-05-09 Lars Veefkind , Gabriele Cesa

Symmetry-aware architectures are central to geometric deep learning. We present a systematic approach for constructing continuous rotationally invariant and equivariant functions using symmetric tensor networks. The proposed framework…

Machine Learning · Computer Science 2026-02-03 Meng Zhang , Chao Wang , Hao Zhang , Shaojun Dong , Lixin He