中文
相关论文

相关论文: General $E(2)$-Equivariant Steerable CNNs

200 篇论文

Euclidean deep learning is often inadequate for addressing real-world signals where the representation space is irregular and curved with complex topologies. Interpreting the geometric properties of such feature spaces has become paramount…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Ramzan Basheer , Deepak Mishra

We introduce Group equivariant Convolutional Neural Networks (G-CNNs), a natural generalization of convolutional neural networks that reduces sample complexity by exploiting symmetries. G-CNNs use G-convolutions, a new type of layer that…

机器学习 · 计算机科学 2016-06-06 Taco S. Cohen , Max Welling

We present Clifford-Steerable Convolutional Neural Networks (CS-CNNs), a novel class of $\mathrm{E}(p, q)$-equivariant CNNs. CS-CNNs process multivector fields on pseudo-Euclidean spaces $\mathbb{R}^{p,q}$. They cover, for instance,…

机器学习 · 计算机科学 2024-07-09 Maksim Zhdanov , David Ruhe , Maurice Weiler , Ana Lucic , Johannes Brandstetter , Patrick Forré

Group equivariant and steerable convolutional neural networks (regular and steerable G-CNNs) have recently emerged as a very effective model class for learning from signal data such as 2D and 3D images, video, and other data where…

机器学习 · 计算机科学 2018-04-02 Taco S. Cohen , Mario Geiger , Maurice Weiler

Convolutional neural networks (CNNs) have enabled the state-of-the-art performance in many computer vision tasks. However, little effort has been devoted to establishing convolution in non-linear space. Existing works mainly leverage on the…

计算机视觉与模式识别 · 计算机科学 2020-05-25 Chen Wang , Jianfei Yang , Lihua Xie , Junsong Yuan

Group convolutional neural networks (G-CNNs) have been shown to increase parameter efficiency and model accuracy by incorporating geometric inductive biases. In this work, we investigate the properties of representations learned by regular…

计算机视觉与模式识别 · 计算机科学 2022-04-05 David M. Knigge , David W. Romero , Erik J. Bekkers

Weight sharing in convolutional neural networks (CNNs) ensures that their feature maps will be translation-equivariant. However, although conventional convolutions are equivariant to translation, they are not equivariant to other isometries…

天体物理仪器与方法 · 物理学 2021-03-10 Anna M. M. Scaife , Fiona Porter

We present a general theory of Group equivariant Convolutional Neural Networks (G-CNNs) on homogeneous spaces such as Euclidean space and the sphere. Feature maps in these networks represent fields on a homogeneous base space, and layers…

机器学习 · 计算机科学 2020-01-10 Taco Cohen , Mario Geiger , Maurice Weiler

We introduce Steerable Transformers, an extension of the Vision Transformer mechanism that maintains equivariance to the special Euclidean group $\mathrm{SE}(d)$. We propose an equivariant attention mechanism that operates on features…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Soumyabrata Kundu , Risi Kondor

We analyze the role of rotational equivariance in convolutional neural networks (CNNs) applied to spherical images. We compare the performance of the group equivariant networks known as S2CNNs and standard non-equivariant CNNs trained with…

Regular group convolutional neural networks (G-CNNs) have been shown to increase model performance and improve equivariance to different geometrical symmetries. This work addresses the problem of SE(3), i.e., roto-translation equivariance,…

计算机视觉与模式识别 · 计算机科学 2023-07-21 Thijs P. Kuipers , Erik J. Bekkers

The principle of equivariance to symmetry transformations enables a theoretically grounded approach to neural network architecture design. Equivariant networks have shown excellent performance and data efficiency on vision and medical…

机器学习 · 计算机科学 2019-05-15 Taco S. Cohen , Maurice Weiler , Berkay Kicanaoglu , Max Welling

With the growth of data from new radio telescope facilities, machine-learning approaches to the morphological classification of radio galaxies are increasingly being utilised. However, while widely employed deep-learning models using…

天体物理仪器与方法 · 物理学 2025-06-30 Natalie E. P. Lines , Joan Font-Quer Roset , Anna M. M. Scaife

Group convolutional neural networks (G-CNNs) can be used to improve classical CNNs by equipping them with the geometric structure of groups. Central in the success of G-CNNs is the lifting of feature maps to higher dimensional disentangled…

机器学习 · 计算机科学 2021-03-23 Erik J Bekkers

Convolutional Neural Networks(CNN) are inherently equivariant under translations, however, they do not have an equivalent embedded mechanism to handle other transformations such as rotations and change in scale. Several approaches exist…

计算机视觉与模式识别 · 计算机科学 2021-11-30 Naman Khetan , Tushar Arora , Samee Ur Rehman , Deepak K. Gupta

Convolutional Neural Networks (CNNs) traditionally encode translation equivariance via the convolution operation. Generalization to other transformations has recently received attraction to encode the knowledge of the data geometry in group…

计算机视觉与模式识别 · 计算机科学 2018-10-17 Vincent Andrearczyk , Adrien Depeursinge

The translational equivariant nature of Convolutional Neural Networks (CNNs) is a reason for its great success in computer vision. However, networks do not enjoy more general equivariance properties such as rotation or scaling, ultimately…

计算机视觉与模式识别 · 计算机科学 2023-03-02 Zikai Sun , Thierry Blu

Convolutional Neural Networks (CNNs) are extremely efficient, since they exploit the inherent translation-invariance of natural images. However, translation is just one of a myriad of useful spatial transformations. Can the same efficiency…

计算机视觉与模式识别 · 计算机科学 2021-12-02 João F. Henriques , Andrea Vedaldi

Motivated by the vast success of deep convolutional networks, there is a great interest in generalizing convolutions to non-Euclidean manifolds. A major complication in comparison to flat spaces is that it is unclear in which alignment a…

机器学习 · 计算机科学 2021-06-14 Maurice Weiler , Patrick Forré , Erik Verlinde , Max Welling

PDE-based Group Convolutional Neural Networks (PDE-G-CNNs) use solvers of evolution PDEs as substitutes for the conventional components in G-CNNs. PDE-G-CNNs can offer several benefits simultaneously: fewer parameters, inherent…

机器学习 · 计算机科学 2024-11-21 Gijs Bellaard , Sei Sakata , Bart M. N. Smets , Remco Duits