English
Related papers

Related papers: Learning SO(3) Equivariant Representations with Sp…

200 papers

Omnidirectional images and spherical representations of $3D$ shapes cannot be processed with conventional 2D convolutional neural networks (CNNs) as the unwrapping leads to large distortion. Using fast implementations of spherical and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Suhas Lohit , Shubhendu Trivedi

Analyzing scalar and vector fields on the sphere, such as temperature or wind speed and direction on Earth, is a difficult task. Models should respect both the rotational symmetries of the sphere and the inherent symmetries of the vector…

Machine Learning · Computer Science 2026-04-01 Francesco Ballerin , Nello Blaser , Erlend Grong

Learning equivariant representations is a promising way to reduce sample and model complexity and improve the generalization performance of deep neural networks. The spherical CNNs are successful examples, producing SO(3)-equivariant…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Carlos Esteves , Ameesh Makadia , Kostas Daniilidis

Convolutional neural networks (CNNs) allow for parameter sharing and translational equivariance by using convolutional kernels in their linear layers. By restricting these kernels to be SO(3)-steerable, CNNs can further improve parameter…

Image and Video Processing · Electrical Eng. & Systems 2024-05-20 Ivan Diaz , Mario Geiger , Richard Iain McKinley

We analyze the role of rotational equivariance in convolutional neural networks (CNNs) applied to spherical images. We compare the performance of the group equivariant networks known as S2CNNs and standard non-equivariant CNNs trained with…

Machine Learning · Computer Science 2022-07-13 Jan E. Gerken , Oscar Carlsson , Hampus Linander , Fredrik Ohlsson , Christoffer Petersson , Daniel Persson

Spherical convolutional networks have been introduced recently as tools to learn powerful feature representations of 3D shapes. Spherical CNNs are equivariant to 3D rotations making them ideally suited to applications where 3D data may be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Carlos Esteves , Avneesh Sud , Zhengyi Luo , Kostas Daniilidis , Ameesh Makadia

State-of-the-art deep learning systems often require large amounts of data and computation. For this reason, leveraging known or unknown structure of the data is paramount. Convolutional neural networks (CNNs) are successful examples of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Carlos Esteves

Convolutional neural networks (CNNs) constructed natively on the sphere have been developed recently and shown to be highly effective for the analysis of spherical data. While an efficient framework has been formulated, spherical CNNs are…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Jason D. McEwen , Christopher G. R. Wallis , Augustine N. Mavor-Parker

We introduce tensor field neural networks, which are locally equivariant to 3D rotations, translations, and permutations of points at every layer. 3D rotation equivariance removes the need for data augmentation to identify features in…

Machine Learning · Computer Science 2018-05-22 Nathaniel Thomas , Tess Smidt , Steven Kearnes , Lusann Yang , Li Li , Kai Kohlhoff , Patrick Riley

Extending the translation equivariance property of convolutional neural networks to larger symmetry groups has been shown to reduce sample complexity and enable more discriminative feature learning. Further, exploiting additional symmetries…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Lisa Weijler , Pedro Hermosilla

Spherical convolutional neural networks (Spherical CNNs) learn nonlinear representations from 3D data by exploiting the data structure and have shown promising performance in shape analysis, object classification, and planning among others.…

Machine Learning · Computer Science 2021-04-06 Zhan Gao , Fernando Gama , Alejandro Ribeiro

Learning 3D representations that generalize well to arbitrarily oriented inputs is a challenge of practical importance in applications varying from computer vision to physics and chemistry. We propose a novel multi-resolution convolutional…

Machine Learning · Computer Science 2021-03-22 James Fox , Bo Zhao , Sivasankaran Rajamanickam , Rampi Ramprasad , Le Song

The success of convolutional networks in learning problems involving planar signals such as images is due to their ability to exploit the translation symmetry of the data distribution through weight sharing. Many areas of science and…

Machine Learning · Computer Science 2019-04-23 Taco Cohen , Mario Geiger , Jonas Köhler , Max Welling

Many problems across computer vision and the natural sciences require the analysis of spherical data, for which representations may be learned efficiently by encoding equivariance to rotational symmetries. We present a generalized spherical…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Oliver J. Cobb , Christopher G. R. Wallis , Augustine N. Mavor-Parker , Augustin Marignier , Matthew A. Price , Mayeul d'Avezac , Jason D. McEwen

Spherical data is found in many applications. By modeling the discretized sphere as a graph, we can accommodate non-uniformly distributed, partial, and changing samplings. Moreover, graph convolutions are computationally more efficient than…

Machine Learning · Computer Science 2019-04-11 Michaël Defferrard , Nathanaël Perraudin , Tomasz Kacprzak , Raphael Sgier

Group equivariant neural networks have been explored in the past few years and are interesting from theoretical and practical standpoints. They leverage concepts from group representation theory, non-commutative harmonic analysis and…

Machine Learning · Computer Science 2020-05-01 Carlos Esteves

Convolutional Neural Networks (CNN) offer state of the art performance in various computer vision tasks. Many of those tasks require different subtypes of affine invariances (scale, rotational, translational) to image transformations.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Facundo Manuel Quiroga , Franco Ronchetti , Laura Lanzarini , Aurelio Fernandez-Bariviera

Graph neural networks that model 3D data, such as point clouds or atoms, are typically desired to be $SO(3)$ equivariant, i.e., equivariant to 3D rotations. Unfortunately equivariant convolutions, which are a fundamental operation for…

Machine Learning · Computer Science 2023-06-16 Saro Passaro , C. Lawrence Zitnick

Determining the 3D orientations of an object in an image, known as single-image pose estimation, is a crucial task in 3D vision applications. Existing methods typically learn 3D rotations parametrized in the spatial domain using Euler…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Jongmin Lee , Minsu Cho

This paper is concerned with a fundamental problem in geometric deep learning that arises in the construction of convolutional neural networks on surfaces. Due to curvature, the transport of filter kernels on surfaces results in a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Ruben Wiersma , Elmar Eisemann , Klaus Hildebrandt
‹ Prev 1 2 3 10 Next ›