English
Related papers

Related papers: Moving Frame Net: SE(3)-Equivariant Network for Vo…

200 papers

In recent years, deep learning techniques have shown great success in various tasks related to inverse problems, where a target quantity of interest can only be observed through indirect measurements by a forward operator. Common approaches…

Numerical Analysis · Mathematics 2024-03-18 Matthias Beckmann , Nick Heilenkötter

In many machine learning tasks it is desirable that a model's prediction transforms in an equivariant way under transformations of its input. Convolutional neural networks (CNNs) implement translational equivariance by construction; for…

Machine Learning · Computer Science 2018-03-20 Maurice Weiler , Fred A. Hamprecht , Martin Storath

Invariance and equivariance to the rotation group have been widely discussed in the 3D deep learning community for pointclouds. Yet most proposed methods either use complex mathematical tools that may limit their accessibility, or are tied…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Congyue Deng , Or Litany , Yueqi Duan , Adrien Poulenard , Andrea Tagliasacchi , Leonidas Guibas

Incorporating geometric invariance into neural networks enhances parameter efficiency but typically increases computational costs. This paper introduces new equivariant neural networks that preserve symmetry while maintaining a comparable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Georg Bökman , David Nordström , Fredrik Kahl

Group equivariant neural networks have been explored in the past few years and are interesting from theoretical and practical standpoints. They leverage concepts from group representation theory, non-commutative harmonic analysis and…

Machine Learning · Computer Science 2020-05-01 Carlos Esteves

We present a general framework for symmetrizing an arbitrary neural-network architecture and making it equivariant with respect to a given group. We build upon the proposals of Kim et al. (2023); Kaba et al. (2023) for symmetrization, and…

Machine Learning · Computer Science 2023-11-14 Tien Dat Nguyen , Jinwoo Kim , Hongseok Yang , Seunghoon Hong

The weight-sharing mechanism of convolutional kernels ensures translation-equivariance of convolution neural networks (CNNs). Recently, rotation-equivariance has been investigated. However, research on scale-equivariance or simultaneous…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Wei-Dong Qiao , Yang Xu , Hui Li

We demonstrate an object tracking method for 3D images with fixed computational cost and state-of-the-art performance. Previous methods predicted transformation parameters from convolutional layers. We instead propose an architecture that…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Daniel Moyer , Esra Abaci Turk , P Ellen Grant , William M. Wells , Polina Golland

The crucial role played by the underlying symmetries of high energy physics and lattice field theories calls for the implementation of such symmetries in the neural network architectures that are applied to the physical system under…

High Energy Physics - Lattice · Physics 2022-02-16 Srinath Bulusu , Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

Point cloud normal estimation is a fundamental task in 3D geometry processing. While recent learning-based methods achieve notable advancements in normal prediction, they often overlook the critical aspect of equivariance. This results in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Hanxiao Wang , Mingyang Zhao , Weize Quan , Zhen Chen , Dong-ming Yan , Peter Wonka

Several popular approaches to 3D vision tasks process multiple views of the input independently with deep neural networks pre-trained on natural images, achieving view permutation invariance through a single round of pooling over all views.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Carlos Esteves , Yinshuang Xu , Christine Allen-Blanchette , Kostas Daniilidis

Triangular meshes are widely used to represent three-dimensional objects. As a result, many recent works have address the need for geometric deep learning on 3D mesh. However, we observe that the complexities in many of these architectures…

Machine Learning · Computer Science 2024-02-20 Thuan Trang , Nhat Khang Ngo , Daniel Levy , Thieu N. Vo , Siamak Ravanbakhsh , Truong Son Hy

We analyze the role of rotational equivariance in convolutional neural networks (CNNs) applied to spherical images. We compare the performance of the group equivariant networks known as S2CNNs and standard non-equivariant CNNs trained with…

Machine Learning · Computer Science 2022-07-13 Jan E. Gerken , Oscar Carlsson , Hampus Linander , Fredrik Ohlsson , Christoffer Petersson , Daniel Persson

Equivariant and invariant deep learning models have been developed to exploit intrinsic symmetries in data, demonstrating significant effectiveness in certain scenarios. However, these methods often suffer from limited representation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yulu Bai , Jiahong Fu , Qi Xie , Deyu Meng

Convolutional neural networks revolutionized computer vision and natrual language processing. Their efficiency, as compared to fully connected neural networks, has its origin in the architecture, where convolutions reflect the translation…

Machine Learning · Computer Science 2023-01-10 Patrick Krüger , Hanno Gottschalk

In many computer vision tasks, we expect a particular behavior of the output with respect to rotations of the input image. If this relationship is explicitly encoded, instead of treated as any other variation, the complexity of the problem…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Diego Marcos , Michele Volpi , Nikos Komodakis , Devis Tuia

Representing and reasoning about 3D structures of macromolecules is emerging as a distinct challenge in machine learning. Here, we extend recent work on geometric vector perceptrons and apply equivariant graph neural networks to a wide…

Machine Learning · Computer Science 2021-07-14 Bowen Jing , Stephan Eismann , Pratham N. Soni , Ron O. Dror

In recent years, the use of machine learning has become increasingly popular in the context of lattice field theories. An essential element of such theories is represented by symmetries, whose inclusion in the neural network properties can…

High Energy Physics - Lattice · Physics 2021-12-24 Srinath Bulusu , Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

This paper introduces a new model to learn graph neural networks equivariant to rotations, translations, reflections and permutations called E(n)-Equivariant Graph Neural Networks (EGNNs). In contrast with existing methods, our work does…

Machine Learning · Computer Science 2022-02-17 Victor Garcia Satorras , Emiel Hoogeboom , Max Welling

In this paper we show how Group Equivariant Convolutional Neural Networks use subsampling to learn to break equivariance to their symmetries. We focus on 2D rotations and reflections and investigate the impact of broken equivariance on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Tom Edixhoven , Attila Lengyel , Jan van Gemert