English
Related papers

Related papers: 360SD-Net: 360{\deg} Stereo Depth Estimation with …

200 papers

We propose a novel approach to compute high-resolution (2048x1024 and higher) depths for panoramas that is significantly faster and qualitatively and qualitatively more accurate than the current state-of-the-art method (360MonoDepth). As…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Chi-Han Peng , Jiayao Zhang

Recent work on depth estimation up to now has only focused on projective images ignoring 360 content which is now increasingly and more easily produced. We show that monocular depth estimation models trained on traditional images produce…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Nikolaos Zioulis , Antonis Karakottas , Dimitrios Zarpalas , Petros Daras

Depth estimation, as a necessary clue to convert 2D images into the 3D space, has been applied in many machine vision areas. However, to achieve an entire surrounding 360-degree geometric sensing, traditional stereo matching algorithms for…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Keyang Zhou , Kailun Yang , Kaiwei Wang

For a monocular 360 image, depth estimation is a challenging because the distortion increases along the latitude. To perceive the distortion, existing methods devote to designing a deep and complex network architecture. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Zhijie Shen , Chunyu Lin , Lang Nie , Kang Liao , Yao Zhao

We propose a method for estimating high-definition spatially-varying lighting, reflectance, and geometry of a scene from 360$^{\circ}$ stereo images. Our model takes advantage of the 360$^{\circ}$ input to observe the entire scene with…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Junxuan Li , Hongdong Li , Yasuyuki Matsushita

This paper presents a stereo object matching method that exploits both 2D contextual information from images as well as 3D object-level information. Unlike existing stereo matching methods that exclusively focus on the pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Jaesung Choe , Kyungdon Joo , Francois Rameau , In So Kweon

360{\deg} cameras can capture complete environments in a single shot, which makes 360{\deg} imagery alluring in many computer vision tasks. However, monocular depth estimation remains a challenge for 360{\deg} data, particularly for high…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Manuel Rey-Area , Mingze Yuan , Christian Richardt

Due to difficulties in acquiring ground truth depth of equirectangular (360) images, the quality and quantity of equirectangular depth data today is insufficient to represent the various scenes in the world. Therefore, 360 depth estimation…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Ilwi Yun , Hyuk-Jae Lee , Chae Eun Rhee

Disconnectivity and distortion are the two problems which must be coped with when processing 360 degrees equirectangular images. In this paper, we propose a method of estimating the depth of monocular panoramic image with a teacher-student…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jingguo Liu , Yijun Xu , Shigang Li , Jianfeng Li

Modern neural network-based algorithms are able to produce highly accurate depth estimates from stereo image pairs, nearly matching the reliability of measurements from more expensive depth sensors. However, this accuracy comes with a…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Kyle Yee , Ayan Chakrabarti

Depth estimation is a cornerstone of a vast number of applications requiring 3D assessment of the environment, such as robotics, augmented reality, and autonomous driving to name a few. One prominent technique for depth estimation is stereo…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Amit Bracha , Noam Rotstein , David Bensaïd , Ron Slossberg , Ron Kimmel

360$^{\circ}$ panoramas are a rich medium, yet notoriously difficult to visualize in the 2D image plane. We explore how intelligent rotations of a spherical image may enable content-aware projection with fewer perceptible distortions.…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Bo Xiong , Kristen Grauman

We introduce a method to convert stereo 360{\deg} (omnidirectional stereo) imagery into a layered, multi-sphere image representation for six degree-of-freedom (6DoF) rendering. Stereo 360{\deg} imagery can be captured from multi-camera…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Benjamin Attal , Selena Ling , Aaron Gokaslan , Christian Richardt , James Tompkin

Multiview stereo aims to reconstruct scene depth from images acquired by a camera under arbitrary motion. Recent methods address this problem through deep learning, which can utilize semantic cues to deal with challenges such as textureless…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Sunghoon Im , Hae-Gon Jeon , Stephen Lin , In So Kweon

Deep learning has shown to be effective for depth inference in multi-view stereo (MVS). However, the scalability and accuracy still remain an open problem in this domain. This can be attributed to the memory-consuming cost volume…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Qingshan Xu , Wenbing Tao

Spherical cameras capture scenes in a holistic manner and have been used for room layout estimation. Recently, with the availability of appropriate datasets, there has also been progress in depth estimation from a single omnidirectional…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Nikolaos Zioulis , Federico Alvarez , Dimitrios Zarpalas , Petros Daras

Stereo depth estimation relies on optimal correspondence matching between pixels on epipolar lines in the left and right images to infer depth. In this work, we revisit the problem from a sequence-to-sequence correspondence perspective to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Zhaoshuo Li , Xingtong Liu , Nathan Drenkow , Andy Ding , Francis X. Creighton , Russell H. Taylor , Mathias Unberath

A main challenge for tasks on panorama lies in the distortion of objects among images. In this work, we propose a Distortion-Aware Monocular Omnidirectional (DAMO) dense depth estimation network to address this challenge on indoor panoramas…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Hong-Xiang Chen , Kunhong Li , Zhiheng Fu , Mengyi Liu , Zonghao Chen , Yulan Guo

Recently, horizontal representation-based panoramic semantic segmentation approaches outperform projection-based solutions, because the distortions can be effectively removed by compressing the spherical data in the vertical direction.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Zishuo Zheng , Chunyu Lin , Lang Nie , Kang Liao , Zhijie Shen , Yao Zhao

Accurately estimating depth in 360-degree imagery is crucial for virtual reality, autonomous navigation, and immersive media applications. Existing depth estimation methods designed for perspective-view imagery fail when applied to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Ning-Hsu Wang , Yu-Lun Liu