English
Related papers

Related papers: Steerable Transformers for Volumetric Data

200 papers

A wide range of techniques have been proposed in recent years for designing neural networks for 3D data that are equivariant under rotation and translation of the input. Most approaches for equivariance under the Euclidean group…

Computational Geometry · Computer Science 2022-11-30 Adrien Poulenard , Maks Ovsjanikov , Leonidas J. Guibas

We present a convolutional network that is equivariant to rigid body motions. The model uses scalar-, vector-, and tensor fields over 3D Euclidean space to represent data, and equivariant convolutions to map between such representations.…

Machine Learning · Computer Science 2018-10-30 Maurice Weiler , Mario Geiger , Max Welling , Wouter Boomsma , Taco Cohen

The big empirical success of group equivariant networks has led in recent years to the sprouting of a great variety of equivariant network architectures. A particular focus has thereby been on rotation and reflection equivariant CNNs for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Maurice Weiler , Gabriele Cesa

In many machine learning tasks it is desirable that a model's prediction transforms in an equivariant way under transformations of its input. Convolutional neural networks (CNNs) implement translational equivariance by construction; for…

Machine Learning · Computer Science 2018-03-20 Maurice Weiler , Fred A. Hamprecht , Martin Storath

The effectiveness of Convolutional Neural Networks (CNNs) has been substantially attributed to their built-in property of translation equivariance. However, CNNs do not have embedded mechanisms to handle other types of transformations. In…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Ivan Sosnovik , Michał Szmaja , Arnold Smeulders

Pre-trained deep image representations are useful for post-training tasks such as classification through transfer learning, image retrieval, and object detection. Data augmentations are a crucial aspect of pre-training robust…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Sangnie Bhardwaj , Willie McClinton , Tongzhou Wang , Guillaume Lajoie , Chen Sun , Phillip Isola , Dilip Krishnan

We study how group symmetry helps improve data efficiency and generalization for end-to-end differentiable planning algorithms when symmetry appears in decision-making tasks. Motivated by equivariant convolution networks, we treat the path…

Machine Learning · Computer Science 2023-05-02 Linfeng Zhao , Xupeng Zhu , Lingzhi Kong , Robin Walters , Lawson L. S. Wong

Invariance under symmetry is an important problem in machine learning. Our paper looks specifically at equivariant neural networks where transformations of inputs yield homomorphic transformations of outputs. Here, steerable CNNs have…

Machine Learning · Computer Science 2021-09-15 Daniel Franzen , Michael Wand

It has long been recognized that the invariance and equivariance properties of a representation are critically important for success in many vision tasks. In this paper we present Steerable Convolutional Neural Networks, an efficient and…

Machine Learning · Computer Science 2019-04-23 Taco S. Cohen , Max Welling

A nonlinear observer on the Special Euclidean group $\mathrm{SE(3)}$ for full pose estimation, that takes the system outputs on the real projective space directly as inputs, is proposed. The observer derivation is based on a recent advanced…

Optimization and Control · Mathematics 2015-09-11 Minh-Duc Hua , Tarek Hamel , Robert Mahony , Jochen Trumpf

We introduce the SE(3)-Transformer, a variant of the self-attention module for 3D point clouds and graphs, which is equivariant under continuous 3D roto-translations. Equivariance is important to ensure stable and predictable performance in…

Machine Learning · Computer Science 2020-11-26 Fabian B. Fuchs , Daniel E. Worrall , Volker Fischer , Max Welling

Steerable CNN imposes the prior knowledge of transformation invariance or equivariance in the network architecture to enhance the the network robustness on geometry transformation of data and reduce overfitting. It has been an intuitive and…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Bo Li , Qili Wang , Gim Hee Lee

Symmetry is present in many tasks in computer vision, where the same class of objects can appear transformed, e.g. rotated due to different camera orientations, or scaled due to perspective. The knowledge of such symmetries in data coupled…

Image and Video Processing · Electrical Eng. & Systems 2022-07-25 Mateus Sangalli , Samy Blusseau , Santiago Velasco-Forero , Jesús Angulo

Steerable models can provide very general and flexible equivariance by formulating equivariance requirements in the language of representation theory and feature fields, which has been recognized to be effective for many vision tasks.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Zhengyang Shen , Tao Hong , Qi She , Jinwen Ma , Zhouchen Lin

Rotation equivariance is a desirable property in many practical applications such as motion forecasting and 3D perception, where it can offer benefits like sample efficiency, better generalization, and robustness to input perturbations.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-26 Serge Assaad , Carlton Downey , Rami Al-Rfou , Nigamaa Nayakanti , Ben Sapp

Analyzing volumetric data with rotational invariance or equivariance is an active topic in current research. Existing deep-learning approaches utilize either group convolutional networks limited to discrete rotations or steerable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Dmitrii Zhemchuzhnikov , Sergei Grudinin

Euclidean deep learning is often inadequate for addressing real-world signals where the representation space is irregular and curved with complex topologies. Interpreting the geometric properties of such feature spaces has become paramount…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Ramzan Basheer , Deepak Mishra

Convolutional neural networks revolutionized computer vision and natrual language processing. Their efficiency, as compared to fully connected neural networks, has its origin in the architecture, where convolutions reflect the translation…

Machine Learning · Computer Science 2023-01-10 Patrick Krüger , Hanno Gottschalk

Emerging from low-level vision theory, steerable filters found their counterpart in prior work on steerable convolutional neural networks equivariant to rigid transformations. In our work, we propose a steerable feed-forward learning-based…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Pavlo Melnyk , Michael Felsberg , Mårten Wadenbäck

Group equivariant neural networks are used as building blocks of group invariant neural networks, which have been shown to improve generalisation performance and data efficiency through principled parameter sharing. Such works have mostly…

Machine Learning · Computer Science 2021-06-17 Michael Hutchinson , Charline Le Lan , Sheheryar Zaidi , Emilien Dupont , Yee Whye Teh , Hyunjik Kim
‹ Prev 1 2 3 10 Next ›