English
Related papers

Related papers: Convolutions on Spherical Images

200 papers

In this work, we propose "tangent images," a spherical image representation that facilitates transferable and scalable $360^\circ$ computer vision. Inspired by techniques in cartography and computer graphics, we render a spherical image to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Marc Eder , Mykhailo Shvets , John Lim , Jan-Michael Frahm

We present a versatile formulation of the convolution operation that we term a "mapped convolution." The standard convolution operation implicitly samples the pixel grid and computes a weighted sum. Our mapped convolution decouples these…

Computer Vision and Pattern Recognition · Computer Science 2019-06-27 Marc Eder , True Price , Thanh Vu , Akash Bapat , Jan-Michael Frahm

Omnidirectional images and spherical representations of $3D$ shapes cannot be processed with conventional 2D convolutional neural networks (CNNs) as the unwrapping leads to large distortion. Using fast implementations of spherical and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Suhas Lohit , Shubhendu Trivedi

Spherical convolutional networks have been introduced recently as tools to learn powerful feature representations of 3D shapes. Spherical CNNs are equivariant to 3D rotations making them ideally suited to applications where 3D data may be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Carlos Esteves , Avneesh Sud , Zhengyi Luo , Kostas Daniilidis , Ameesh Makadia

Convolutional neural networks (CNNs) have been widely used in various vision tasks, e.g. image classification, semantic segmentation, etc. Unfortunately, standard 2D CNNs are not well suited for spherical signals such as panorama images or…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Yuqi Liu , Yin Wang , Haikuan Du , Shen Cai

The success of convolutional networks in learning problems involving planar signals such as images is due to their ability to exploit the translation symmetry of the data distribution through weight sharing. Many areas of science and…

Machine Learning · Computer Science 2019-04-23 Taco Cohen , Mario Geiger , Jonas Köhler , Max Welling

Although equirectangular projection (ERP) is a convenient form to store omnidirectional images (also known as 360-degree images), it is neither equal-area nor conformal, thus not friendly to subsequent visual communication. In the context…

Image and Video Processing · Electrical Eng. & Systems 2021-12-28 Mu Li , Kede Ma , Jinxing Li , David Zhang

Convolutional neural networks (CNNs) constructed natively on the sphere have been developed recently and shown to be highly effective for the analysis of spherical data. While an efficient framework has been formulated, spherical CNNs are…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Jason D. McEwen , Christopher G. R. Wallis , Augustine N. Mavor-Parker

Using convolutional neural networks for 360images can induce sub-optimal performance due to distortions entailed by a planar projection. The distortion gets deteriorated when a rotation is applied to the 360image. Thus, many researches…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Sungmin Cho , Raehyuk Jung , Junseok Kwon

Omni-directional cameras have many advantages overconventional cameras in that they have a much wider field-of-view (FOV). Accordingly, several approaches have beenproposed recently to apply convolutional neural networks(CNNs) to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yeonkun Lee , Jaeseok Jeong , Jongseob Yun , Wonjune Cho , Kuk-Jin Yoon

We address semantic segmentation on omnidirectional images, to leverage a holistic understanding of the surrounding scene for applications like autonomous driving systems. For the spherical domain, several methods recently adopt an…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Chao Zhang , Stephan Liwicki , William Smith , Roberto Cipolla

We present a new and general framework for convolutional neural network operations on spherical (or omnidirectional) images. Our approach represents the surface as a graph of connected points that doesn't rely on a particular sampling…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 David Hart , Michael Whitney , Bryan Morse

Spherical regression, in which both covariates and responses lie on the sphere, arises in many scientific applications and has attracted considerable methodological attention in recent years. Despite this progress, constructing flexible and…

Methodology · Statistics 2026-05-19 Tin Lok James Ng , Kwok-Kun Kwong , Jiakun Liu , Andrew Zammit-Mangion

State-of-the-art 2D image compression schemes rely on the power of convolutional neural networks (CNNs). Although CNNs offer promising perspectives for 2D image compression, extending such models to omnidirectional images is not…

Image and Video Processing · Electrical Eng. & Systems 2022-09-21 Navid Mahmoudian Bidgoli , Roberto G. de A. Azevedo , Thomas Maugey , Aline Roumy , Pascal Frossard

Convolutional Neural Networks (CNNs) have been providing the state-of-the-art performance for learning-related problems involving 2D/3D images in Euclidean space. However, unlike in the Euclidean space, the shapes of many structures in…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Fenqiang Zhao , Shunren Xia , Zhengwang Wu , Dingna Duan , Li Wang , Weili Lin , John H Gilmore , Dinggang Shen , Gang Li

Spherical image processing has been widely applied in many important fields, such as omnidirectional vision for autonomous cars, global climate modelling, and medical imaging. It is non-trivial to extend an algorithm developed for flat…

Image and Video Processing · Electrical Eng. & Systems 2022-09-30 Jianfei Li , Chaoyan Huang , Raymond Chan , Han Feng , Micheal Ng , Tieyong Zeng

The principle of equivariance to symmetry transformations enables a theoretically grounded approach to neural network architecture design. Equivariant networks have shown excellent performance and data efficiency on vision and medical…

Machine Learning · Computer Science 2019-05-15 Taco S. Cohen , Maurice Weiler , Berkay Kicanaoglu , Max Welling

Deep learning based on deep neural networks of various structures and architectures has been powerful in many practical applications, but it lacks enough theoretical verifications. In this paper, we consider a family of deep convolutional…

Machine Learning · Computer Science 2020-07-29 Zhiying Fang , Han Feng , Shuo Huang , Ding-Xuan Zhou

Semantic segmentation for spherical data is a challenging problem in machine learning since conventional planar approaches require projecting the spherical image to the Euclidean plane. Representing the signal on a fundamentally different…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Thomas Walker , Varun Anand , Pavlos Andreadis

Processing information on 3D objects requires methods stable to rigid-body transformations, in particular rotations, of the input data. In image processing tasks, convolutional neural networks achieve this property using…

Quantitative Methods · Quantitative Biology 2021-01-07 Ilia Igashov , Nikita Pavlichenko , Sergei Grudinin
‹ Prev 1 2 3 10 Next ›