English

Scattering Networks on the Sphere for Scalable and Rotationally Equivariant Spherical CNNs

Computer Vision and Pattern Recognition 2022-01-25 v4 Instrumentation and Methods for Astrophysics Machine Learning Image and Video Processing

Abstract

Convolutional neural networks (CNNs) constructed natively on the sphere have been developed recently and shown to be highly effective for the analysis of spherical data. While an efficient framework has been formulated, spherical CNNs are nevertheless highly computationally demanding; typically they cannot scale beyond spherical signals of thousands of pixels. We develop scattering networks constructed natively on the sphere that provide a powerful representational space for spherical data. Spherical scattering networks are computationally scalable and exhibit rotational equivariance, while their representational space is invariant to isometries and provides efficient and stable signal representations. By integrating scattering networks as an additional type of layer in the generalized spherical CNN framework, we show how they can be leveraged to scale spherical CNNs to the high-resolution data typical of many practical applications, with spherical signals of many tens of megapixels and beyond.

Keywords

Cite

@article{arxiv.2102.02828,
  title  = {Scattering Networks on the Sphere for Scalable and Rotationally Equivariant Spherical CNNs},
  author = {Jason D. McEwen and Christopher G. R. Wallis and Augustine N. Mavor-Parker},
  journal= {arXiv preprint arXiv:2102.02828},
  year   = {2022}
}

Comments

18 pages, 6 figures, accepted by ICLR, code at https://www.kagenova.com/products/fourpiAI/