English
Related papers

Related papers: Attention meets Geometry: Geometry Guided Spatial-…

200 papers

Self-supervised monocular depth estimation (SSMDE) aims to predict the dense depth map of a monocular image, by learning depth from RGB image sequences, eliminating the need for ground-truth depth labels. Although this approach simplifies…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Wonhyeok Choi , Kyumin Hwang , Wei Peng , Minwoo Choi , Sunghoon Im

In monocular videos that capture dynamic scenes, estimating the 3D geometry of video contents has been a fundamental challenge in computer vision. Specifically, the task is significantly challenged by the object motion, where existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Seong Hyeon Park , Jinwoo Shin

Monocular depth estimation is known as an ill-posed task in which objects in a 2D image usually do not contain sufficient information to predict their depth. Thus, it acts differently from other tasks (e.g., classification and segmentation)…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Wencheng Han , Junbo Yin , Jianbing Shen

Self-supervised monocular depth estimation has gathered notable interest since it can liberate training from dependency on depth annotations. In monocular video training case, recent methods only conduct view synthesis between existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Jinfeng Liu , Lingtong Kong , Bo Li , Zerong Wang , Hong Gu , Jinwei Chen

Estimating 3D geometry from monocular colonoscopy images is challenging due to non-Lambertian surfaces, moving light sources, and large textureless regions. While recent 3D geometric foundation models eliminate the need for multi-stage…

Image and Video Processing · Electrical Eng. & Systems 2025-12-01 Zhiyi Jiang , Yifu Wang , Xuelian Cheng , Zongyuan Ge

Dense depth estimation is essential to scene-understanding for autonomous driving. However, recent self-supervised approaches on monocular videos suffer from scale-inconsistency across long sequences. Utilizing data from the ubiquitously…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Hemang Chawla , Arnav Varma , Elahe Arani , Bahram Zonooz

Self-supervised monocular depth estimation has been widely investigated to estimate depth images and relative poses from RGB images. This framework is attractive for researchers because the depth and pose networks can be trained from just…

Computer Vision and Pattern Recognition · Computer Science 2022-02-21 Noriaki Hirose , Kosuke Tahara

Self-supervised monocular depth estimation presents a powerful method to obtain 3D scene information from single camera images, which is trainable on arbitrary image sequences without requiring depth labels, e.g., from a LiDAR sensor. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Marvin Klingner , Jan-Aike Termöhlen , Jonas Mikolajczyk , Tim Fingscheidt

We propose a method for self-supervised image representation learning under the guidance of 3D geometric consistency. Our intuition is that 3D geometric consistency priors such as smooth regions and surface discontinuities may imply…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Nenglun Chen , Lei Chu , Hao Pan , Yan Lu , Wenping Wang

Low-cost autonomous agents including autonomous driving vehicles chiefly adopt monocular 3D object detection to perceive surrounding environment. This paper studies 3D intermediate representation methods which generate intermediate 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Qian Ye , Ling Jiang , Wang Zhen , Yuyang Du

Self-supervised monocular depth estimation has been widely studied, owing to its practical importance and recent promising improvements. However, most works suffer from limited supervision of photometric consistency, especially in weak…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Hyunyoung Jung , Eunhyeok Park , Sungjoo Yoo

Monocular 3D object detection aims to predict the object location, dimension and orientation in 3D space alongside the object category given only a monocular image. It poses a great challenge due to its ill-posed property which is…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Zheyuan Zhou , Liang Du , Xiaoqing Ye , Zhikang Zou , Xiao Tan , Li Zhang , Xiangyang Xue , Jianfeng Feng

Supervised depth estimation has achieved high accuracy due to the advanced deep network architectures. Since the groundtruth depth labels are hard to obtain, recent methods try to learn depth estimation networks in an unsupervised way by…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Shanshan Zhao , Huan Fu , Mingming Gong , Dacheng Tao

We present a novel framework for enhancing the visual fidelity and consistency of text-guided 3D Gaussian Splatting (3DGS) editing. Existing editing approaches face two critical challenges: inconsistent geometric reconstructions across…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Xuanqi Zhang , Jieun Lee , Chris Joslin , Wonsook Lee

This paper reports a new continuous 3D loss function for learning depth from monocular images. The dense depth prediction from a monocular image is supervised using sparse LIDAR points, which enables us to leverage available open source…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Minghan Zhu , Maani Ghaffari , Yuanxin Zhong , Pingping Lu , Zhong Cao , Ryan M. Eustice , Huei Peng

Deep metric learning aims to learn features relying on the consistency or divergence of class labels. However, in monocular depth estimation, the absence of a natural definition of class poses challenges in the leveraging of deep metric…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Chunpu Liu , Guanglei Yang , Wangmeng Zuo , Tianyi Zan

We present a novel algorithm for self-supervised monocular depth completion. Our approach is based on training a neural network that requires only sparse depth measurements and corresponding monocular video sequences without dense depth…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Jaehoon Choi , Dongki Jung , Yonghan Lee , Deokhwa Kim , Dinesh Manocha , Donghwan Lee

As transformers are equivariant to the permutation of input tokens, encoding the positional information of tokens is necessary for many tasks. However, since existing positional encoding schemes have been initially designed for NLP tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Takeru Miyato , Bernhard Jaeger , Max Welling , Andreas Geiger

Accurate real depth annotations are difficult to acquire, needing the use of special devices such as a LiDAR sensor. Self-supervised methods try to overcome this problem by processing video or stereo sequences, which may not always be…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Adrian Lopez-Rodriguez , Krystian Mikolajczyk

While monocular depth estimation (MDE) is an important problem in computer vision, it is difficult due to the ambiguity that results from the compression of a 3D scene into only 2 dimensions. It is common practice in the field to treat it…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Dylan Auty , Krystian Mikolajczyk