English
Related papers

Related papers: Scalable and Equivariant Spherical CNNs by Discret…

200 papers

While 360{\deg} cameras offer tremendous new possibilities in vision, graphics, and augmented reality, the spherical images they produce make core feature extraction non-trivial. Convolutional neural networks (CNNs) trained on images from…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Yu-Chuan Su , Kristen Grauman

Histology images are inherently symmetric under rotation, where each orientation is equally as likely to appear. However, this rotational symmetry is not widely utilised as prior knowledge in modern Convolutional Neural Networks (CNNs),…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Simon Graham , David Epstein , Nasir Rajpoot

Graph neural networks that model 3D data, such as point clouds or atoms, are typically desired to be $SO(3)$ equivariant, i.e., equivariant to 3D rotations. Unfortunately equivariant convolutions, which are a fundamental operation for…

Machine Learning · Computer Science 2023-06-16 Saro Passaro , C. Lawrence Zitnick

We address semantic segmentation on omnidirectional images, to leverage a holistic understanding of the surrounding scene for applications like autonomous driving systems. For the spherical domain, several methods recently adopt an…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Chao Zhang , Stephan Liwicki , William Smith , Roberto Cipolla

We present an efficient convolution kernel for Convolutional Neural Networks (CNNs) on unstructured grids using parameterized differential operators while focusing on spherical signals such as panorama images or planetary signals. To this…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Chiyu "Max" Jiang , Jingwei Huang , Karthik Kashinath , Prabhat , Philip Marcus , Matthias Niessner

Image convolution with complex kernels is a fundamental operation in photography, scientific imaging, and animation effects, yet direct dense convolution is computationally prohibitive on resource-limited devices. Existing approximations,…

Graphics · Computer Science 2026-05-20 Zhizhen Wu , Zhe Cao , Yuchi Huo

State-of-the-art 2D image compression schemes rely on the power of convolutional neural networks (CNNs). Although CNNs offer promising perspectives for 2D image compression, extending such models to omnidirectional images is not…

Image and Video Processing · Electrical Eng. & Systems 2022-09-21 Navid Mahmoudian Bidgoli , Roberto G. de A. Azevedo , Thomas Maugey , Aline Roumy , Pascal Frossard

Encoding the scale information explicitly into the representation learned by a convolutional neural network (CNN) is beneficial for many computer vision tasks especially when dealing with multiscale inputs. We study, in this paper, a…

Machine Learning · Computer Science 2022-02-08 Wei Zhu , Qiang Qiu , Robert Calderbank , Guillermo Sapiro , Xiuyuan Cheng

This paper develops a rotation-invariant needlet convolution for rotation group SO(3) to distill multiscale information of spherical signals. The spherical needlet transform is generalized from $\mathbb{S}^2$ onto the SO(3) group, which…

Image and Video Processing · Electrical Eng. & Systems 2022-06-22 Kai Yi , Jialin Chen , Yu Guang Wang , Bingxin Zhou , Pietro Liò , Yanan Fan , Jan Hamann

Steerable models can provide very general and flexible equivariance by formulating equivariance requirements in the language of representation theory and feature fields, which has been recognized to be effective for many vision tasks.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Zhengyang Shen , Tao Hong , Qi She , Jinwen Ma , Zhouchen Lin

The ability of convolutional neural networks (CNNs) to recognize objects regardless of their position in the image is due to the translation-equivariance of the convolutional operation. Group-equivariant CNNs transfer this equivariance to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Thomas Wimmer , Vladimir Golkov , Hoai Nam Dang , Moritz Zaiss , Andreas Maier , Daniel Cremers

Group equivariant neural networks have been explored in the past few years and are interesting from theoretical and practical standpoints. They leverage concepts from group representation theory, non-commutative harmonic analysis and…

Machine Learning · Computer Science 2020-05-01 Carlos Esteves

Extending the translation equivariance property of convolutional neural networks to larger symmetry groups has been shown to reduce sample complexity and enable more discriminative feature learning. Further, exploiting additional symmetries…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Lisa Weijler , Pedro Hermosilla

The translational equivariant nature of Convolutional Neural Networks (CNNs) is a reason for its great success in computer vision. However, networks do not enjoy more general equivariance properties such as rotation or scaling, ultimately…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Zikai Sun , Thierry Blu

This paper proposes a convolution structure for learning SE(3)-equivariant features from 3D point clouds. It can be viewed as an equivariant version of kernel point convolutions (KPConv), a widely used convolution form to process point…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Minghan Zhu , Maani Ghaffari , William A. Clark , Huei Peng

In this paper, we utilize hyperspheres and regular $n$-simplexes and propose an approach to learning deep features equivariant under the transformations of $n$D reflections and rotations, encompassed by the powerful group of O$(n)$. Namely,…

Machine Learning · Computer Science 2024-05-31 Pavlo Melnyk , Michael Felsberg , Mårten Wadenbäck , Andreas Robinson , Cuong Le

As the key advancement of the convolutional neural networks (CNNs), depthwise separable convolutions (DSCs) are becoming one of the most popular techniques to reduce the computations and parameters size of CNNs meanwhile maintaining the…

Machine Learning · Computer Science 2021-01-05 Yuke Wang , Boyuan Feng , Yufei Ding

Recent research has shown that incorporating equivariance into neural network architectures is very helpful, and there have been some works investigating the equivariance of networks under group actions. However, as digital images and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Zhengyang Shen , Lingshen He , Zhouchen Lin , Jinwen Ma

Rotation-invariance is a desired property of machine-learning models for medical image analysis and in particular for computational pathology applications. We propose a framework to encode the geometric structure of the special Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Maxime W. Lafarge , Erik J. Bekkers , Josien P. W. Pluim , Remco Duits , Mitko Veta

Spherical convolutional networks have been introduced recently as tools to learn powerful feature representations of 3D shapes. Spherical CNNs are equivariant to 3D rotations making them ideally suited to applications where 3D data may be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Carlos Esteves , Avneesh Sud , Zhengyi Luo , Kostas Daniilidis , Ameesh Makadia