English
Related papers

Related papers: M\"obius Convolutions for Spherical CNNs

200 papers

Convolutional neural networks (CNNs) have been widely used in various vision tasks, e.g. image classification, semantic segmentation, etc. Unfortunately, standard 2D CNNs are not well suited for spherical signals such as panorama images or…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Yuqi Liu , Yin Wang , Haikuan Du , Shen Cai

Spherical convolutional networks have been introduced recently as tools to learn powerful feature representations of 3D shapes. Spherical CNNs are equivariant to 3D rotations making them ideally suited to applications where 3D data may be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Carlos Esteves , Avneesh Sud , Zhengyi Luo , Kostas Daniilidis , Ameesh Makadia

Processing information on 3D objects requires methods stable to rigid-body transformations, in particular rotations, of the input data. In image processing tasks, convolutional neural networks achieve this property using…

Quantitative Methods · Quantitative Biology 2021-01-07 Ilia Igashov , Nikita Pavlichenko , Sergei Grudinin

We analyze the role of rotational equivariance in convolutional neural networks (CNNs) applied to spherical images. We compare the performance of the group equivariant networks known as S2CNNs and standard non-equivariant CNNs trained with…

Machine Learning · Computer Science 2022-07-13 Jan E. Gerken , Oscar Carlsson , Hampus Linander , Fredrik Ohlsson , Christoffer Petersson , Daniel Persson

State-of-the-art deep learning systems often require large amounts of data and computation. For this reason, leveraging known or unknown structure of the data is paramount. Convolutional neural networks (CNNs) are successful examples of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Carlos Esteves

Identifying when different images are of the same object despite changes caused by imaging technologies, or processes such as growth, has many applications in fields such as computer vision and biological image analysis. One approach to…

Computer Vision and Pattern Recognition · Computer Science 2016-08-12 Stephen Marsland , Robert McLachlan

Convolutional Neural Networks (CNNs) have been providing the state-of-the-art performance for learning-related problems involving 2D/3D images in Euclidean space. However, unlike in the Euclidean space, the shapes of many structures in…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Fenqiang Zhao , Shunren Xia , Zhengwang Wu , Dingna Duan , Li Wang , Weili Lin , John H Gilmore , Dinggang Shen , Gang Li

Many problems across computer vision and the natural sciences require the analysis of spherical data, for which representations may be learned efficiently by encoding equivariance to rotational symmetries. We present a generalized spherical…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Oliver J. Cobb , Christopher G. R. Wallis , Augustine N. Mavor-Parker , Augustin Marignier , Matthew A. Price , Mayeul d'Avezac , Jason D. McEwen

3D human pose estimation is fundamental to understanding human behavior. Recently, promising results have been achieved by graph convolutional networks (GCNs), which achieve state-of-the-art performance and provide rather light-weight…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Niloofar Azizi , Horst Possegger , Emanuele Rodolà , Horst Bischof

Spherical CNNs generalize CNNs to functions on the sphere, by using spherical convolutions as the main linear operation. The most accurate and efficient way to compute spherical convolutions is in the spectral domain (via the convolution…

Machine Learning · Computer Science 2023-06-09 Carlos Esteves , Jean-Jacques Slotine , Ameesh Makadia

This work investigates use of equivariant neural networks as efficient and high-performance frameworks for image reconstruction and denoising in nuclear medicine. Our work aims to tackle limitations of conventional Convolutional Neural…

Image and Video Processing · Electrical Eng. & Systems 2025-02-03 Amirreza Hashemi , Yuemeng Feng , Arman Rahmim , Hamid Sabet

We present a novel surface convolution operator acting on vector fields that is based on a simple observation: instead of combining neighboring features with respect to a single coordinate parameterization defined at a given point, we have…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Thomas W. Mitchel , Vladimir G. Kim , Michael Kazhdan

Learning equivariant representations is a promising way to reduce sample and model complexity and improve the generalization performance of deep neural networks. The spherical CNNs are successful examples, producing SO(3)-equivariant…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Carlos Esteves , Ameesh Makadia , Kostas Daniilidis

Omnidirectional images and spherical representations of $3D$ shapes cannot be processed with conventional 2D convolutional neural networks (CNNs) as the unwrapping leads to large distortion. Using fast implementations of spherical and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Suhas Lohit , Shubhendu Trivedi

One of the key challenges in machine learning is to find interpretable representations of learned functions. The M\"obius transform is essential for this purpose, as its coefficients correspond to unique importance scores for sets of input…

Machine Learning · Computer Science 2024-06-18 Justin S. Kang , Yigit E. Erginbas , Landon Butler , Ramtin Pedarsani , Kannan Ramchandran

Defining and reliably finding a canonical orientation for 3D surfaces is key to many Computer Vision and Robotics applications. This task is commonly addressed by handcrafted algorithms exploiting geometric cues deemed as distinctive and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-16 Riccardo Spezialetti , Federico Stella , Marlon Marcon , Luciano Silva , Samuele Salti , Luigi Di Stefano

We address semantic segmentation on omnidirectional images, to leverage a holistic understanding of the surrounding scene for applications like autonomous driving systems. For the spherical domain, several methods recently adopt an…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Chao Zhang , Stephan Liwicki , William Smith , Roberto Cipolla

Convolutional Neural Networks (CNNs) have become the method of choice for learning problems involving 2D planar images. However, a number of problems of recent interest have created a demand for models that can analyze spherical images.…

Machine Learning · Computer Science 2019-04-23 Taco S. Cohen , Mario Geiger , Jonas Koehler , Max Welling

The ability of convolutional neural networks (CNNs) to recognize objects regardless of their position in the image is due to the translation-equivariance of the convolutional operation. Group-equivariant CNNs transfer this equivariance to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Thomas Wimmer , Vladimir Golkov , Hoai Nam Dang , Moritz Zaiss , Andreas Maier , Daniel Cremers

We present an efficient convolution kernel for Convolutional Neural Networks (CNNs) on unstructured grids using parameterized differential operators while focusing on spherical signals such as panorama images or planetary signals. To this…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Chiyu "Max" Jiang , Jingwei Huang , Karthik Kashinath , Prabhat , Philip Marcus , Matthias Niessner
‹ Prev 1 2 3 10 Next ›