English
Related papers

Related papers: M\"obius Convolutions for Spherical CNNs

200 papers

While 360{\deg} cameras offer tremendous new possibilities in vision, graphics, and augmented reality, the spherical images they produce make core feature extraction non-trivial. Convolutional neural networks (CNNs) trained on images from…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Yu-Chuan Su , Kristen Grauman

Convolutional Neural Networks (CNNs) traditionally encode translation equivariance via the convolution operation. Generalization to other transformations has recently received attraction to encode the knowledge of the data geometry in group…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Vincent Andrearczyk , Adrien Depeursinge

The principle of equivariance to symmetry transformations enables a theoretically grounded approach to neural network architecture design. Equivariant networks have shown excellent performance and data efficiency on vision and medical…

Machine Learning · Computer Science 2019-05-15 Taco S. Cohen , Maurice Weiler , Berkay Kicanaoglu , Max Welling

State-of-the-art 2D image compression schemes rely on the power of convolutional neural networks (CNNs). Although CNNs offer promising perspectives for 2D image compression, extending such models to omnidirectional images is not…

Image and Video Processing · Electrical Eng. & Systems 2022-09-21 Navid Mahmoudian Bidgoli , Roberto G. de A. Azevedo , Thomas Maugey , Aline Roumy , Pascal Frossard

Omni-directional cameras have many advantages overconventional cameras in that they have a much wider field-of-view (FOV). Accordingly, several approaches have beenproposed recently to apply convolutional neural networks(CNNs) to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yeonkun Lee , Jaeseok Jeong , Jongseob Yun , Wonjune Cho , Kuk-Jin Yoon

We propose M\"obius transformations as the natural rotation and scaling tools for editing spherical images. As an application we produce spherical Droste images. We obtain other self-similar visual effects using rational functions, elliptic…

Graphics · Computer Science 2016-05-05 Saul Schleimer , Henry Segerman

Spherical signals exist in many applications, e.g., planetary data, LiDAR scans and digitalization of 3D objects, calling for models that can process spherical data effectively. It does not perform well when simply projecting spherical data…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Zhengyang Shen , Tiancheng Shen , Zhouchen Lin , Jinwen Ma

We present a new approach using differential invariants to detect projective equivalences and symmetries between two rational parametric $3D$ curves properly parametrized. In order to do this, we introduce two differential invariants that…

Algebraic Geometry · Mathematics 2022-07-01 Uğur Gözütok , Hüsnü Anıl Çoban , Yasemin Sağıroğlu , Juan Gerardo Alcázar

No existing spherical convolutional neural network (CNN) framework is both computationally scalable and rotationally equivariant. Continuous approaches capture rotational equivariance but are often prohibitively computationally demanding.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Jeremy Ocampo , Matthew A. Price , Jason D. McEwen

This paper develops a rotation-invariant needlet convolution for rotation group SO(3) to distill multiscale information of spherical signals. The spherical needlet transform is generalized from $\mathbb{S}^2$ onto the SO(3) group, which…

Image and Video Processing · Electrical Eng. & Systems 2022-06-22 Kai Yi , Jialin Chen , Yu Guang Wang , Bingxin Zhou , Pietro Liò , Yanan Fan , Jan Hamann

Wide-angle images gained a huge popularity in the last years due to the development of computational photography and imaging technological advances. They present the information of a scene in a way which is more natural for the human eye…

Graphics · Computer Science 2015-04-20 Luis Peñaranda , Luiz Velho , Leonardo Sacht

We present a versatile formulation of the convolution operation that we term a "mapped convolution." The standard convolution operation implicitly samples the pixel grid and computes a weighted sum. Our mapped convolution decouples these…

Computer Vision and Pattern Recognition · Computer Science 2019-06-27 Marc Eder , True Price , Thanh Vu , Akash Bapat , Jan-Michael Frahm

This paper is concerned with a fundamental problem in geometric deep learning that arises in the construction of convolutional neural networks on surfaces. Due to curvature, the transport of filter kernels on surfaces results in a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Ruben Wiersma , Elmar Eisemann , Klaus Hildebrandt

Convolutional Neural Networks (CNNs) are extremely efficient, since they exploit the inherent translation-invariance of natural images. However, translation is just one of a myriad of useful spatial transformations. Can the same efficiency…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 João F. Henriques , Andrea Vedaldi

The translation equivariance of convolutions can make convolutional neural networks translation equivariant or invariant. Equivariance to other transformations (e.g. rotations, affine transformations, scalings) may also be desirable as soon…

Signal Processing · Electrical Eng. & Systems 2021-05-05 Mateus Sangalli , Samy Blusseau , Santiago Velasco-Forero , Jesus Angulo

Encoding the scale information explicitly into the representation learned by a convolutional neural network (CNN) is beneficial for many computer vision tasks especially when dealing with multiscale inputs. We study, in this paper, a…

Machine Learning · Computer Science 2022-02-08 Wei Zhu , Qiang Qiu , Robert Calderbank , Guillermo Sapiro , Xiuyuan Cheng

While scale-invariant modeling has substantially boosted the performance of visual recognition tasks, it remains largely under-explored in deep networks based image restoration. Naively applying those scale-invariant techniques (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Yuchen Fan , Jiahui Yu , Ding Liu , Thomas S. Huang

Analyzing scalar and vector fields on the sphere, such as temperature or wind speed and direction on Earth, is a difficult task. Models should respect both the rotational symmetries of the sphere and the inherent symmetries of the vector…

Machine Learning · Computer Science 2026-04-01 Francesco Ballerin , Nello Blaser , Erlend Grong

In many machine learning tasks it is desirable that a model's prediction transforms in an equivariant way under transformations of its input. Convolutional neural networks (CNNs) implement translational equivariance by construction; for…

Machine Learning · Computer Science 2018-03-20 Maurice Weiler , Fred A. Hamprecht , Martin Storath

Spherical convolutional neural networks (Spherical CNNs) learn nonlinear representations from 3D data by exploiting the data structure and have shown promising performance in shape analysis, object classification, and planning among others.…

Machine Learning · Computer Science 2021-04-06 Zhan Gao , Fernando Gama , Alejandro Ribeiro