English
Related papers

Related papers: Self-supervised Learning with Geometric Constraint…

200 papers

Monocular depth estimation in endoscopy videos can enable assistive and robotic surgery to obtain better coverage of the organ and detection of various health issues. Despite promising progress on mainstream, natural image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Akshay Paruchuri , Samuel Ehrenstein , Shuxian Wang , Inbar Fried , Stephen M. Pizer , Marc Niethammer , Roni Sengupta

Self-supervised learning (especially contrastive learning) methods on heterogeneous graphs can effectively get rid of the dependence on supervisory data. Meanwhile, most existing representation learning methods embed the heterogeneous…

Machine Learning · Computer Science 2022-06-28 Shichao Zhu , Chuan Zhou , Anfeng Cheng , Shirui Pan , Shuaiqiang Wang , Dawei Yin , Bin Wang

Multi-frame methods improve monocular depth estimation over single-frame approaches by aggregating spatial-temporal information via feature matching. However, the spatial-temporal feature leads to accuracy degradation in dynamic scenes. To…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jiquan Zhong , Xiaolin Huang , Xiao Yu

Accurate surround-view depth estimation provides a competitive alternative to laser-based sensors and is essential for 3D scene understanding in autonomous driving. While empirical studies have proposed various approaches that primarily…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Weimin Liu , Wenjun Wang , Joshua H. Meng

In recent years, self-supervised methods for monocular depth estimation has rapidly become an significant branch of depth estimation task, especially for autonomous driving applications. Despite the high overall precision achieved, current…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Feng Xue , Guirong Zhuo , Ziyuan Huang , Wufei Fu , Zhuoyue Wu , Marcelo H. Ang

Detecting and localizing objects in the real 3D space, which plays a crucial role in scene understanding, is particularly challenging given only a monocular image due to the geometric information loss during imagery projection. We propose…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Zengyi Qin , Jinglu Wang , Yan Lu

Monocular depth estimation has drawn widespread attention from the vision community due to its broad applications. In this paper, we propose a novel physics (geometry)-driven deep learning framework for monocular depth estimation by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Shuwei Shao , Zhongcai Pei , Weihai Chen , Xingming Wu , Zhengguo Li

Self-supervised monocular depth estimation (SSMDE) aims to predict the dense depth map of a monocular image, by learning depth from RGB image sequences, eliminating the need for ground-truth depth labels. Although this approach simplifies…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Wonhyeok Choi , Kyumin Hwang , Wei Peng , Minwoo Choi , Sunghoon Im

Camera calibration is integral to robotics and computer vision algorithms that seek to infer geometric properties of the scene from visual input streams. In practice, calibration is a laborious procedure requiring specialized data…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Jiading Fang , Igor Vasiljevic , Vitor Guizilini , Rares Ambrus , Greg Shakhnarovich , Adrien Gaidon , Matthew R. Walter

Deep learning-based, single-view depth estimation methods have recently shown highly promising results. However, such methods ignore one of the most important features for determining depth in the human vision system, which is motion. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Rui Wang , Stephen M. Pizer , Jan-Michael Frahm

Supervised learning depth estimation methods can achieve good performance when trained on high-quality ground-truth, like LiDAR data. However, LiDAR can only generate sparse 3D maps which causes losing information. Obtaining high-quality…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Hao Xing , Yifan Cao , Maximilian Biber , Mingchuan Zhou , Darius Burschka

Recent visual odometry (VO) methods incorporating geometric algorithm into deep-learning architecture have shown outstanding performance on the challenging monocular VO task. Despite encouraging results are shown, previous methods ignore…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Yijun Cao , Xianshi Zhang , Fuya Luo , Peng Peng , Yongjie Li

Monocular visual odometry (VO) suffers severely from error accumulation during frame-to-frame pose estimation. In this paper, we present a self-supervised learning method for VO with special consideration for consistency over longer…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Yuliang Zou , Pan Ji , Quoc-Huy Tran , Jia-Bin Huang , Manmohan Chandraker

Unsupervised deep learning methods have shown promising performance for single-image depth estimation. Since most of these methods use binocular stereo pairs for self-supervision, the depth range is generally limited. Small-baseline stereo…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Saad Imran , Muhammad Umar Karim Khan , Sikander Bin Mukarram , Chong-Min Kyung

In video compression, most of the existing deep learning approaches concentrate on the visual quality of a single frame, while ignoring the useful priors as well as the temporal information of adjacent frames. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-01-16 Xiandong Meng , Xuan Deng , Shuyuan Zhu , Shuaicheng Liu , Chuan Wang , Chen Chen , Bing Zeng

Estimating depth from single RGB images and videos is of widespread interest due to its applications in many areas, including autonomous driving, 3D reconstruction, digital entertainment, and robotics. More than 500 deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Uchitha Rajapaksha , Ferdous Sohel , Hamid Laga , Dean Diepeveen , Mohammed Bennamoun

A thermal camera can robustly capture thermal radiation images under harsh light conditions such as night scenes, tunnels, and disaster scenarios. However, despite this advantage, neither depth nor ego-motion estimation research for the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Ukcheol Shin , Kyunghyun Lee , Seokju Lee , In So Kweon

We introduce InverseFaceNet, a deep convolutional inverse rendering framework for faces that jointly estimates facial pose, shape, expression, reflectance and illumination from a single input image. By estimating all parameters from just a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Hyeongwoo Kim , Michael Zollhöfer , Ayush Tewari , Justus Thies , Christian Richardt , Christian Theobalt

Nighttime self-supervised monocular depth estimation has received increasing attention in recent years. However, using night images for self-supervision is unreliable because the photometric consistency assumption is usually violated in the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Haolin Yang , Chaoqiang Zhao , Lu Sheng , Yang Tang

Learning to estimate 3D geometry in a single image by watching unlabeled videos via deep convolutional network has made significant process recently. Current state-of-the-art (SOTA) methods, are based on the learning framework of rigid…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Zhenheng Yang , Peng Wang , Yang Wang , Wei Xu , Ram Nevatia