English
Related papers

Related papers: Learning to Fuse Monocular and Multi-view Cues for…

200 papers

Monocular depth estimation (MDE) is a critical task to guide autonomous medical robots. However, obtaining absolute (metric) depth from an endoscopy camera in surgical scenes is difficult, which limits supervised learning of depth on real…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Hao Li , Daiwei Lu , Jesse d'Almeida , Dilara Isik , Ehsan Khodapanah Aghdam , Nick DiSanto , Ayberk Acar , Susheela Sharma , Jie Ying Wu , Robert J. Webster , Ipek Oguz

The task of 3D semantic scene completion using monocular cameras is gaining significant attention in the field of autonomous driving. This task aims to predict the occupancy status and semantic labels of each voxel in a 3D scene from…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jiawei Yao , Jusheng Zhang , Xiaochao Pan , Tong Wu , Canran Xiao

The success of monocular depth estimation relies on large and diverse training sets. Due to the challenges associated with acquiring dense ground-truth depth across different environments at scale, a number of datasets with distinct…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 René Ranftl , Katrin Lasinger , David Hafner , Konrad Schindler , Vladlen Koltun

High-fidelity 3D scene reconstruction from monocular videos continues to be challenging, especially for complete and fine-grained geometry reconstruction. The previous 3D reconstruction approaches with neural implicit representations have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Zi-Xin Zou , Shi-Sheng Huang , Yan-Pei Cao , Tai-Jiang Mu , Ying Shan , Hongbo Fu

Depth estimation is usually ill-posed and ambiguous for monocular camera-based 3D multi-person pose estimation. Since LiDAR can capture accurate depth information in long-range scenes, it can benefit both the global localization of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Peishan Cong , Yiteng Xu , Yiming Ren , Juze Zhang , Lan Xu , Jingya Wang , Jingyi Yu , Yuexin Ma

Depth estimation is essential for various important real-world applications such as autonomous driving. However, it suffers from severe performance degradation in high-velocity scenario since traditional cameras can only capture blurred…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Jianing Li , Jiaming Liu , Xiaobao Wei , Jiyuan Zhang , Ming Lu , Lei Ma , Li Du , Tiejun Huang , Shanghang Zhang

Monocular depth foundation models generalize well across scenes, yet they are typically optimized with uniform pixel-wise objectives that do not distinguish user-specified or task-relevant target regions from the surrounding context. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yuxin Du , Tao Lin , Zile Zhong , Runting Li , Xiyao Chen , Jiting Liu , Chenglin Liu , Ying-Cong Chen , Yuqian Fu , Bo Zhao

We present the first approach to volumetric performance capture and novel-view rendering at real-time speed from monocular video, eliminating the need for expensive multi-view systems or cumbersome pre-acquisition of a personalized template…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Ruilong Li , Yuliang Xiu , Shunsuke Saito , Zeng Huang , Kyle Olszewski , Hao Li

A single color image can contain many cues informative towards different aspects of local geometric structure. We approach the problem of monocular depth estimation by using a neural network to produce a mid-level representation that…

Computer Vision and Pattern Recognition · Computer Science 2016-09-08 Ayan Chakrabarti , Jingyu Shao , Gregory Shakhnarovich

Monocular depth inference is a fundamental problem for scene perception of robots. Specific robots may be equipped with a camera plus an optional depth sensor of any type and located in various scenes of different scales, whereas recent…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Haotian Wang , Meng Yang , Nanning Zheng

Camouflaged object detection (COD) aims to identify the objects that conceal themselves in natural scenes. Accurate COD suffers from a number of challenges associated with low boundary contrast and the large variation of object appearances,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Geng Chen , Si-Jie Liu , Yu-Jia Sun , Ge-Peng Ji , Ya-Feng Wu , Tao Zhou

Monocular depth estimation plays a crucial role in 3D recognition and understanding. One key limitation of existing approaches lies in their lack of structural information exploitation, which leads to inaccurate spatial layout,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Tian Chen , Shijie An , Yuan Zhang , Chongyang Ma , Huayan Wang , Xiaoyan Guo , Wen Zheng

Monocular depth estimation, enabled by self-supervised learning, is a key technique for 3D perception in computer vision. However, it faces significant challenges in real-world scenarios, which encompass adverse weather variations, motion…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Runze Chen , Haiyong Luo , Fang Zhao , Jingze Yu , Yupeng Jia , Juan Wang , Xuepeng Ma

Multi-view depth estimation has achieved impressive performance over various benchmarks. However, almost all current multi-view systems rely on given ideal camera poses, which are unavailable in many real-world scenarios, such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 JunDa Cheng , Wei Yin , Kaixuan Wang , Xiaozhi Chen , Shijie Wang , Xin Yang

Perceiving 3D objects from monocular inputs is crucial for robotic systems, given its economy compared to multi-sensor settings. It is notably difficult as a single image can not provide any clues for predicting absolute depth values.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Tai Wang , Jiangmiao Pang , Dahua Lin

We present a novel deep learning architecture for fusing static multi-exposure images. Current multi-exposure fusion (MEF) approaches use hand-crafted features to fuse input sequence. However, the weak hand-crafted representations are not…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 K. Ram Prabhakar , V. Sai Srikar , R. Venkatesh Babu

Self-supervised learning for depth estimation uses geometry in image sequences for supervision and shows promising results. Like many computer vision tasks, depth network performance is determined by the capability to learn accurate spatial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Hang Zhou , David Greenwood , Sarah Taylor

We introduce MGNet, a multi-task framework for monocular geometric scene understanding. We define monocular geometric scene understanding as the combination of two known tasks: Panoptic segmentation and self-supervised monocular depth…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Markus Schön , Michael Buchholz , Klaus Dietmayer

Understanding the geometric and semantic properties of the scene is crucial in autonomous navigation and particularly challenging in the case of Unmanned Aerial Vehicle (UAV) navigation. Such information may be by obtained by estimating…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yara AlaaEldin , Francesca Odone

Self-supervised monocular depth estimation has seen significant progress in recent years, especially in outdoor environments. However, depth prediction results are not satisfying in indoor scenes where most of the existing data are captured…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Runze Li , Pan Ji , Yi Xu , Bir Bhanu