English
Related papers

Related papers: Learning SO(3) Equivariant Representations with Sp…

200 papers

This paper proposes a set of rules to revise various neural networks for 3D point cloud processing to rotation-equivariant quaternion neural networks (REQNNs). We find that when a neural network uses quaternion features under certain…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Wen Shen , Binbin Zhang , Shikun Huang , Zhihua Wei , Quanshi Zhang

Training a Convolutional Neural Network (CNN) to be robust against rotation has mostly been done with data augmentation. In this paper, another progressive vision of research direction is highlighted to encourage less dependence on data…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Sungwon Hwang , Hyungtae Lim , Hyun Myung

Spherical CNNs generalize CNNs to functions on the sphere, by using spherical convolutions as the main linear operation. The most accurate and efficient way to compute spherical convolutions is in the spectral domain (via the convolution…

Machine Learning · Computer Science 2023-06-09 Carlos Esteves , Jean-Jacques Slotine , Ameesh Makadia

Establishing correspondences between 3D shapes is a fundamental task in 3D Computer Vision, typically addressed by matching local descriptors. Recently, a few attempts at applying the deep learning paradigm to the task have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Riccardo Spezialetti , Samuele Salti , Luigi Di Stefano

Convolutional networks are successful, but they have recently been outperformed by new neural networks that are equivariant under rotations and translations. These new networks work better because they do not struggle with learning each…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Philip Müller , Vladimir Golkov , Valentina Tomassini , Daniel Cremers

Equivariance of neural networks to transformations helps to improve their performance and reduce generalization error in computer vision tasks, as they apply to datasets presenting symmetries (e.g. scalings, rotations, translations). The…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Mateus Sangalli , Samy Blusseau , Santiago Velasco-Forero , Jesus Angulo

This paper investigates the super-resolution (SR) of velocity fields in two-dimensional fluids from the viewpoint of rotational equivariance. SR refers to techniques that estimate high-resolution images from those in low resolution and has…

Fluid Dynamics · Physics 2022-10-26 Yuki Yasuda , Ryo Onishi

Convolutional Neural Networks (CNNs) traditionally encode translation equivariance via the convolution operation. Generalization to other transformations has recently received attraction to encode the knowledge of the data geometry in group…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Vincent Andrearczyk , Adrien Depeursinge

Convolutional Neural Networks (CNN) have been regarded as a powerful class of models for image recognition problems. Nevertheless, it is not trivial when utilizing a CNN for learning spatio-temporal video representation. A few studies have…

Computer Vision and Pattern Recognition · Computer Science 2017-11-29 Zhaofan Qiu , Ting Yao , Tao Mei

Rotational symmetry plays a central role in physics, providing an elegant framework to describe how the properties of 3D objects -- from atoms to the macroscopic scale -- transform under the action of rigid rotations. Equivariant models of…

Chemical Physics · Physics 2025-10-28 Michelangelo Domina , Filippo Bigi , Paolo Pegolo , Michele Ceriotti

Convolutional Neural Networks (CNNs) perform very well in image classification and object detection in recent years, but even the most advanced models have limited rotation invariance. Known solutions include the enhancement of training…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Zongbo Hao , Tao Zhang , Mingwang Chen , Kaixu Zhou

Discrete Fourier transforms provide a significant speedup in the computation of convolutions in deep learning. In this work, we demonstrate that, beyond its advantages for efficient computation, the spectral domain also provides a powerful…

Machine Learning · Statistics 2015-06-12 Oren Rippel , Jasper Snoek , Ryan P. Adams

Steerable models can provide very general and flexible equivariance by formulating equivariance requirements in the language of representation theory and feature fields, which has been recognized to be effective for many vision tasks.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Zhengyang Shen , Tao Hong , Qi She , Jinwen Ma , Zhouchen Lin

Designing a convolution for a spherical neural network requires a delicate tradeoff between efficiency and rotation equivariance. DeepSphere, a method based on a graph representation of the sampled sphere, strikes a controllable balance…

Machine Learning · Computer Science 2021-01-01 Michaël Defferrard , Martino Milani , Frédérick Gusset , Nathanaël Perraudin

In many computer vision tasks, we expect a particular behavior of the output with respect to rotations of the input image. If this relationship is explicitly encoded, instead of treated as any other variation, the complexity of the problem…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Diego Marcos , Michele Volpi , Nikos Komodakis , Devis Tuia

Convolutional Neural Networks (CNNs) have become the method of choice for learning problems involving 2D planar images. However, a number of problems of recent interest have created a demand for models that can analyze spherical images.…

Machine Learning · Computer Science 2019-04-23 Taco S. Cohen , Mario Geiger , Jonas Koehler , Max Welling

State-of-the-art 2D image compression schemes rely on the power of convolutional neural networks (CNNs). Although CNNs offer promising perspectives for 2D image compression, extending such models to omnidirectional images is not…

Image and Video Processing · Electrical Eng. & Systems 2022-09-21 Navid Mahmoudian Bidgoli , Roberto G. de A. Azevedo , Thomas Maugey , Aline Roumy , Pascal Frossard

Processing information on 3D objects requires methods stable to rigid-body transformations, in particular rotations, of the input data. In image processing tasks, convolutional neural networks achieve this property using…

Quantitative Methods · Quantitative Biology 2021-01-07 Ilia Igashov , Nikita Pavlichenko , Sergei Grudinin

The usage of 3D vision algorithms, such as shape reconstruction, remains limited because they require inputs to be at a fixed canonical rotation. Recently, a simple equivariant network, Vector Neuron (VN) has been proposed that can be…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Dongwon Son , Jaehyung Kim , Sanghyeon Son , Beomjoon Kim

In remote sensing images, the absolute orientation of objects is arbitrary. Depending on an object's orientation and on a sensor's flight path, objects of the same semantic class can be observed in different orientations in the same image.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Diego Marcos , Michele Volpi , Benjamin Kellenberger , Devis Tuia