English
Related papers

Related papers: Efficient Generalized Spherical CNNs

200 papers

Spherical CNNs generalize CNNs to functions on the sphere, by using spherical convolutions as the main linear operation. The most accurate and efficient way to compute spherical convolutions is in the spectral domain (via the convolution…

Machine Learning · Computer Science 2023-06-09 Carlos Esteves , Jean-Jacques Slotine , Ameesh Makadia

Convolutional neural networks (CNNs) constructed natively on the sphere have been developed recently and shown to be highly effective for the analysis of spherical data. While an efficient framework has been formulated, spherical CNNs are…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Jason D. McEwen , Christopher G. R. Wallis , Augustine N. Mavor-Parker

Learning equivariant representations is a promising way to reduce sample and model complexity and improve the generalization performance of deep neural networks. The spherical CNNs are successful examples, producing SO(3)-equivariant…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Carlos Esteves , Ameesh Makadia , Kostas Daniilidis

No existing spherical convolutional neural network (CNN) framework is both computationally scalable and rotationally equivariant. Continuous approaches capture rotational equivariance but are often prohibitively computationally demanding.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Jeremy Ocampo , Matthew A. Price , Jason D. McEwen

We analyze the role of rotational equivariance in convolutional neural networks (CNNs) applied to spherical images. We compare the performance of the group equivariant networks known as S2CNNs and standard non-equivariant CNNs trained with…

Machine Learning · Computer Science 2022-07-13 Jan E. Gerken , Oscar Carlsson , Hampus Linander , Fredrik Ohlsson , Christoffer Petersson , Daniel Persson

State-of-the-art deep learning systems often require large amounts of data and computation. For this reason, leveraging known or unknown structure of the data is paramount. Convolutional neural networks (CNNs) are successful examples of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Carlos Esteves

Convolutional Neural Networks (CNNs) have become the method of choice for learning problems involving 2D planar images. However, a number of problems of recent interest have created a demand for models that can analyze spherical images.…

Machine Learning · Computer Science 2019-04-23 Taco S. Cohen , Mario Geiger , Jonas Koehler , Max Welling

We address the problem of 3D rotation equivariance in convolutional neural networks. 3D rotations have been a challenging nuisance in 3D classification tasks requiring higher capacity and extended data augmentation in order to tackle it. We…

Computer Vision and Pattern Recognition · Computer Science 2018-10-01 Carlos Esteves , Christine Allen-Blanchette , Ameesh Makadia , Kostas Daniilidis

We present an efficient convolution kernel for Convolutional Neural Networks (CNNs) on unstructured grids using parameterized differential operators while focusing on spherical signals such as panorama images or planetary signals. To this…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Chiyu "Max" Jiang , Jingwei Huang , Karthik Kashinath , Prabhat , Philip Marcus , Matthias Niessner

The principle of equivariance to symmetry transformations enables a theoretically grounded approach to neural network architecture design. Equivariant networks have shown excellent performance and data efficiency on vision and medical…

Machine Learning · Computer Science 2019-05-15 Taco S. Cohen , Maurice Weiler , Berkay Kicanaoglu , Max Welling

Spherical signals exist in many applications, e.g., planetary data, LiDAR scans and digitalization of 3D objects, calling for models that can process spherical data effectively. It does not perform well when simply projecting spherical data…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Zhengyang Shen , Tiancheng Shen , Zhouchen Lin , Jinwen Ma

In this paper we introduce a novel method for segmentation that can benefit from general semantics of Convolutional Neural Network (CNN). Our segmentation proposes visually and semantically coherent image segments. We use binary encoding of…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Mahdyar Ravanbakhsh , Hossein Mousavi , Moin Nabi , Lucio Marcenaro , Carlo Regazzoni

This work investigates use of equivariant neural networks as efficient and high-performance frameworks for image reconstruction and denoising in nuclear medicine. Our work aims to tackle limitations of conventional Convolutional Neural…

Image and Video Processing · Electrical Eng. & Systems 2025-02-03 Amirreza Hashemi , Yuemeng Feng , Arman Rahmim , Hamid Sabet

Spherical data is found in many applications. By modeling the discretized sphere as a graph, we can accommodate non-uniformly distributed, partial, and changing samplings. Moreover, graph convolutions are computationally more efficient than…

Machine Learning · Computer Science 2019-04-11 Michaël Defferrard , Nathanaël Perraudin , Tomasz Kacprzak , Raphael Sgier

Spherical convolutional neural networks (Spherical CNNs) learn nonlinear representations from 3D data by exploiting the data structure and have shown promising performance in shape analysis, object classification, and planning among others.…

Machine Learning · Computer Science 2021-04-06 Zhan Gao , Fernando Gama , Alejandro Ribeiro

We address semantic segmentation on omnidirectional images, to leverage a holistic understanding of the surrounding scene for applications like autonomous driving systems. For the spherical domain, several methods recently adopt an…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Chao Zhang , Stephan Liwicki , William Smith , Roberto Cipolla

Convolutional neural networks (CNNs) allow for parameter sharing and translational equivariance by using convolutional kernels in their linear layers. By restricting these kernels to be SO(3)-steerable, CNNs can further improve parameter…

Image and Video Processing · Electrical Eng. & Systems 2024-05-20 Ivan Diaz , Mario Geiger , Richard Iain McKinley

Convolutional Neural Networks (CNNs) are a cornerstone of the Deep Learning toolbox and have led to many breakthroughs in Artificial Intelligence. These networks have mostly been developed for regular Euclidean domains such as those…

Cosmology and Nongalactic Astrophysics · Physics 2021-01-05 Nathanaël Perraudin , Michaël Defferrard , Tomasz Kacprzak , Raphael Sgier

Convolutional neural networks (CNNs) have been widely used in various vision tasks, e.g. image classification, semantic segmentation, etc. Unfortunately, standard 2D CNNs are not well suited for spherical signals such as panorama images or…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Yuqi Liu , Yin Wang , Haikuan Du , Shen Cai

Spherical convolutional networks have been introduced recently as tools to learn powerful feature representations of 3D shapes. Spherical CNNs are equivariant to 3D rotations making them ideally suited to applications where 3D data may be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Carlos Esteves , Avneesh Sud , Zhengyi Luo , Kostas Daniilidis , Ameesh Makadia
‹ Prev 1 2 3 10 Next ›