English
Related papers

Related papers: Efficient Generalized Spherical CNNs

200 papers

State-of-the-art 2D image compression schemes rely on the power of convolutional neural networks (CNNs). Although CNNs offer promising perspectives for 2D image compression, extending such models to omnidirectional images is not…

Image and Video Processing · Electrical Eng. & Systems 2022-09-21 Navid Mahmoudian Bidgoli , Roberto G. de A. Azevedo , Thomas Maugey , Aline Roumy , Pascal Frossard

Group equivariant neural networks have been explored in the past few years and are interesting from theoretical and practical standpoints. They leverage concepts from group representation theory, non-commutative harmonic analysis and…

Machine Learning · Computer Science 2020-05-01 Carlos Esteves

Omnidirectional images and spherical representations of $3D$ shapes cannot be processed with conventional 2D convolutional neural networks (CNNs) as the unwrapping leads to large distortion. Using fast implementations of spherical and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Suhas Lohit , Shubhendu Trivedi

Spherical equivariant graph neural networks (EGNNs) provide a principled framework for learning on three-dimensional molecular and biomolecular systems, where predictions must respect the rotational symmetries inherent in physics. These…

Machine Learning · Computer Science 2025-12-17 Sophia Tang

Designing a convolution for a spherical neural network requires a delicate tradeoff between efficiency and rotation equivariance. DeepSphere, a method based on a graph representation of the sampled sphere, strikes a controllable balance…

Machine Learning · Computer Science 2021-01-01 Michaël Defferrard , Martino Milani , Frédérick Gusset , Nathanaël Perraudin

We introduce Group equivariant Convolutional Neural Networks (G-CNNs), a natural generalization of convolutional neural networks that reduces sample complexity by exploiting symmetries. G-CNNs use G-convolutions, a new type of layer that…

Machine Learning · Computer Science 2016-06-06 Taco S. Cohen , Max Welling

Modeling the energy and forces of atomic systems is a fundamental problem in computational chemistry with the potential to help address many of the world's most pressing problems, including those related to energy scarcity and climate…

Translating or rotating an input image should not affect the results of many computer vision tasks. Convolutional neural networks (CNNs) are already translation equivariant: input image translations produce proportionate feature map…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Daniel E. Worrall , Stephan J. Garbin , Daniyar Turmukhambetov , Gabriel J. Brostow

Convolutional neural networks are ubiquitous in Machine Learning applications for solving a variety of problems. They however can not be used in their native form when the domain of the data is commonly encountered manifolds such as the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Rudrasis Chakraborty , Monami Banerjee , Baba C. Vemuri

Analyzing scalar and vector fields on the sphere, such as temperature or wind speed and direction on Earth, is a difficult task. Models should respect both the rotational symmetries of the sphere and the inherent symmetries of the vector…

Machine Learning · Computer Science 2026-04-01 Francesco Ballerin , Nello Blaser , Erlend Grong

Euclidean deep learning is often inadequate for addressing real-world signals where the representation space is irregular and curved with complex topologies. Interpreting the geometric properties of such feature spaces has become paramount…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Ramzan Basheer , Deepak Mishra

Encoding the scale information explicitly into the representation learned by a convolutional neural network (CNN) is beneficial for many computer vision tasks especially when dealing with multiscale inputs. We study, in this paper, a…

Machine Learning · Computer Science 2022-02-08 Wei Zhu , Qiang Qiu , Robert Calderbank , Guillermo Sapiro , Xiuyuan Cheng

While 360{\deg} cameras offer tremendous new possibilities in vision, graphics, and augmented reality, the spherical images they produce make core feature extraction non-trivial. Convolutional neural networks (CNNs) trained on images from…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Yu-Chuan Su , Kristen Grauman

Scattering networks are a class of designed Convolutional Neural Networks (CNNs) with fixed weights. We argue they can serve as generic representations for modelling images. In particular, by working in scattering space, we achieve…

We propose a semantic segmentation model that exploits rotation and reflection symmetries. We demonstrate significant gains in sample efficiency due to increased weight sharing, as well as improvements in robustness to symmetry…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Jasper Linmans , Jim Winkens , Bastiaan S. Veeling , Taco S. Cohen , Max Welling

Invariance under symmetry is an important problem in machine learning. Our paper looks specifically at equivariant neural networks where transformations of inputs yield homomorphic transformations of outputs. Here, steerable CNNs have…

Machine Learning · Computer Science 2021-09-15 Daniel Franzen , Michael Wand

Despite the importance of image representations such as histograms of oriented gradients and deep Convolutional Neural Networks (CNN), our theoretical understanding of them remains limited. Aiming at filling this gap, we investigate three…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Karel Lenc , Andrea Vedaldi

This paper demonstrates spherical convolutional neural networks (S-CNN) offer distinct advantages over conventional fully-connected networks (FCN) at estimating scalar parameters of tissue microstructure from diffusion MRI (dMRI). Such…

Image and Video Processing · Electrical Eng. & Systems 2022-08-17 Tobias Goodwin-Allcock , Jason McEwen , Robert Gray , Parashkev Nachev , Hui Zhang

Omni-directional cameras have many advantages overconventional cameras in that they have a much wider field-of-view (FOV). Accordingly, several approaches have beenproposed recently to apply convolutional neural networks(CNNs) to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yeonkun Lee , Jaeseok Jeong , Jongseob Yun , Wonjune Cho , Kuk-Jin Yoon

The convolutional layers of standard convolutional neural networks (CNNs) are equivariant to translation. However, the convolution and fully-connected layers are not equivariant or invariant to other affine geometric transformations.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Jaspreet Singh , Chandan Singh