English
Related papers

Related papers: Spin-Weighted Spherical CNNs

200 papers

We present an efficient convolution kernel for Convolutional Neural Networks (CNNs) on unstructured grids using parameterized differential operators while focusing on spherical signals such as panorama images or planetary signals. To this…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Chiyu "Max" Jiang , Jingwei Huang , Karthik Kashinath , Prabhat , Philip Marcus , Matthias Niessner

Convolutional Neural Networks (CNNs) have become the method of choice for learning problems involving 2D planar images. However, a number of problems of recent interest have created a demand for models that can analyze spherical images.…

Machine Learning · Computer Science 2019-04-23 Taco S. Cohen , Mario Geiger , Jonas Koehler , Max Welling

Graph neural networks that model 3D data, such as point clouds or atoms, are typically desired to be $SO(3)$ equivariant, i.e., equivariant to 3D rotations. Unfortunately equivariant convolutions, which are a fundamental operation for…

Machine Learning · Computer Science 2023-06-16 Saro Passaro , C. Lawrence Zitnick

Convolutional Neural Networks (CNNs) have been providing the state-of-the-art performance for learning-related problems involving 2D/3D images in Euclidean space. However, unlike in the Euclidean space, the shapes of many structures in…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Fenqiang Zhao , Shunren Xia , Zhengwang Wu , Dingna Duan , Li Wang , Weili Lin , John H Gilmore , Dinggang Shen , Gang Li

Spherical signals exist in many applications, e.g., planetary data, LiDAR scans and digitalization of 3D objects, calling for models that can process spherical data effectively. It does not perform well when simply projecting spherical data…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Zhengyang Shen , Tiancheng Shen , Zhouchen Lin , Jinwen Ma

The success of convolutional networks in learning problems involving planar signals such as images is due to their ability to exploit the translation symmetry of the data distribution through weight sharing. Many areas of science and…

Machine Learning · Computer Science 2019-04-23 Taco Cohen , Mario Geiger , Jonas Köhler , Max Welling

In many machine learning tasks it is desirable that a model's prediction transforms in an equivariant way under transformations of its input. Convolutional neural networks (CNNs) implement translational equivariance by construction; for…

Machine Learning · Computer Science 2018-03-20 Maurice Weiler , Fred A. Hamprecht , Martin Storath

Filter-decomposition-based group equivariant convolutional neural networks (CNNs) have shown promising stability and data efficiency for 3D image feature extraction. However, these networks, which rely on parameter sharing and discrete…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Wenzhao Zhao , Steffen Albert , Barbara D. Wichtmann , Angelika Maurer , Ulrike Attenberger , Frank G. Zöllner , Jürgen Hesser

We present a method for learning discriminative filters using a shallow Convolutional Neural Network (CNN). We encode rotation invariance directly in the model by tying the weights of groups of filters to several rotated versions of the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Diego Marcos , Michele Volpi , Devis Tuia

We address semantic segmentation on omnidirectional images, to leverage a holistic understanding of the surrounding scene for applications like autonomous driving systems. For the spherical domain, several methods recently adopt an…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Chao Zhang , Stephan Liwicki , William Smith , Roberto Cipolla

State-of-the-art 2D image compression schemes rely on the power of convolutional neural networks (CNNs). Although CNNs offer promising perspectives for 2D image compression, extending such models to omnidirectional images is not…

Image and Video Processing · Electrical Eng. & Systems 2022-09-21 Navid Mahmoudian Bidgoli , Roberto G. de A. Azevedo , Thomas Maugey , Aline Roumy , Pascal Frossard

Processing information on 3D objects requires methods stable to rigid-body transformations, in particular rotations, of the input data. In image processing tasks, convolutional neural networks achieve this property using…

Quantitative Methods · Quantitative Biology 2021-01-07 Ilia Igashov , Nikita Pavlichenko , Sergei Grudinin

In this paper we introduce a novel method for segmentation that can benefit from general semantics of Convolutional Neural Network (CNN). Our segmentation proposes visually and semantically coherent image segments. We use binary encoding of…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Mahdyar Ravanbakhsh , Hossein Mousavi , Moin Nabi , Lucio Marcenaro , Carlo Regazzoni

We propose a framework for rotation and translation covariant deep learning using $SE(2)$ group convolutions. The group product of the special Euclidean motion group $SE(2)$ describes how a concatenation of two roto-translations results in…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Erik J Bekkers , Maxime W Lafarge , Mitko Veta , Koen AJ Eppenhof , Josien PW Pluim , Remco Duits

Spherical equivariant graph neural networks (EGNNs) provide a principled framework for learning on three-dimensional molecular and biomolecular systems, where predictions must respect the rotational symmetries inherent in physics. These…

Machine Learning · Computer Science 2025-12-17 Sophia Tang

This paper demonstrates spherical convolutional neural networks (S-CNN) offer distinct advantages over conventional fully-connected networks (FCN) at estimating scalar parameters of tissue microstructure from diffusion MRI (dMRI). Such…

Image and Video Processing · Electrical Eng. & Systems 2022-08-17 Tobias Goodwin-Allcock , Jason McEwen , Robert Gray , Parashkev Nachev , Hui Zhang

Convolutional Neural Networks have revolutionized vision applications. There are image domains and representations, however, that cannot be handled by standard CNNs (e.g., spherical images, superpixels). Such data are usually processed…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 David Hart , Michael Whitney , Bryan Morse

It is well known that Convolutional Neural Networks (CNNs) have significant redundancy in their filter weights. Various methods have been proposed in the literature to compress trained CNNs. These include techniques like pruning weights,…

Machine Learning · Computer Science 2019-06-12 Muhammad Tayyab , Abhijit Mahalanobis

Modeling the energy and forces of atomic systems is a fundamental problem in computational chemistry with the potential to help address many of the world's most pressing problems, including those related to energy scarcity and climate…

Convolutional neural networks (CNNs) have been shown to both extract more information than the traditional two-point statistics from cosmological fields, and marginalise over astrophysical effects extremely well. However, CNNs require large…

Instrumentation and Methods for Astrophysics · Physics 2023-07-28 Christian Pedersen , Michael Eickenberg , Shirley Ho