English
Related papers

Related papers: Repurposing Diffusion-Based Image Generators for M…

200 papers

Learning depth from a single image, as an important issue in scene understanding, has attracted a lot of attention in the past decade. The accuracy of the depth estimation has been improved from conditional Markov random fields,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Lei He , Guanghui Wang , Zhanyi Hu

Traditional monocular depth estimation suffers from inherent ambiguity and visual nuisances. We demonstrate that language can enhance monocular depth estimation by providing an additional condition (rather than images alone) aligned with…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ziyao Zeng , Jingcheng Ni , Daniel Wang , Patrick Rim , Younjoon Chung , Fengyu Yang , Byung-Woo Hong , Alex Wong

Diffusion models have shown remarkable flexibility for solving inverse problems without task-specific retraining. However, existing approaches such as Manifold Preserving Guided Diffusion (MPGD) apply only a single gradient update per…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Aditya Chakravarty

This paper reports a new continuous 3D loss function for learning depth from monocular images. The dense depth prediction from a monocular image is supervised using sparse LIDAR points, which enables us to leverage available open source…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Minghan Zhu , Maani Ghaffari , Yuanxin Zhong , Pingping Lu , Zhong Cao , Ryan M. Eustice , Huei Peng

Recovering the scene depth from a single image is an ill-posed problem that requires additional priors, often referred to as monocular depth cues, to disambiguate different 3D interpretations. In recent works, those priors have been learned…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Lam Huynh , Phong Nguyen-Ha , Jiri Matas , Esa Rahtu , Janne Heikkila

Monocular Depth Estimation (MDE) is a fundamental 3D vision problem with numerous applications such as 3D scene reconstruction, autonomous navigation, and AI content creation. However, robust and generalizable MDE remains challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Yunpeng Bai , Qixing Huang

We present an algorithm for reconstructing dense, geometrically consistent depth for all pixels in a monocular video. We leverage a conventional structure-from-motion reconstruction to establish geometric constraints on pixels in the video.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Xuan Luo , Jia-Bin Huang , Richard Szeliski , Kevin Matzen , Johannes Kopf

Monocular depth estimation can play an important role in addressing the issue of deriving scene geometry from 2D images. It has been used in a variety of industries, including robots, self-driving cars, scene comprehension, 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Ruilin Ma , Shiyao Chen , Qin Zhang

Monocular depth estimation can benefit from autoregressive (AR) generation, but direct AR modeling is hindered by the modality gap between RGB and depth, inefficient pixel-wise generation, and instability in continuous depth prediction. We…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jinchang Zhang , Xinrou Kang , Guoyu Lu

Monocular depth estimation within the diffusion-denoising paradigm demonstrates impressive generalization ability but suffers from low inference speed. Recent methods adopt a single-step deterministic paradigm to improve inference…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Ziyang Song , Zerong Wang , Bo Li , Hao Zhang , Ruijie Zhu , Li Liu , Peng-Tao Jiang , Tianzhu Zhang

We present an algorithm for estimating consistent dense depth maps and camera poses from a monocular video. We integrate a learning-based depth prior, in the form of a convolutional neural network trained for single-image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Johannes Kopf , Xuejian Rong , Jia-Bin Huang

Monocular cameras are extensively employed in indoor robotics, but their performance is limited in visual odometry, depth estimation, and related applications due to the absence of scale information.Depth estimation refers to the process of…

Robotics · Computer Science 2023-09-15 Yehao Liu , Ruoyan Xia , Xiaosu Xu , Zijian Wang , Yiqing Ya , Mingze Fan

We introduce Marigold-SSD, a single-step, late-fusion depth completion framework that leverages strong diffusion priors while eliminating the costly test-time optimization typically associated with diffusion-based methods. By shifting…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jakub Gregorek , Paraskevas Pegios , Nando Metzger , Konrad Schindler , Theodora Kontogianni , Lazaros Nalpantidis

Despite significant progress in monocular depth estimation in the wild, recent state-of-the-art methods cannot be used to recover accurate 3D scene shape due to an unknown depth shift induced by shift-invariant reconstruction losses used in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Wei Yin , Jianming Zhang , Oliver Wang , Simon Niklaus , Long Mai , Simon Chen , Chunhua Shen

Diffusion-based approaches have recently demonstrated strong performance for single-image novel view synthesis by conditioning generative models on geometry inferred from monocular depth estimation. However, in practice, the quality and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Amirhosein Javadi , Chi-Shiang Gau , Konstantinos D. Polyzos , Tara Javidi

Monocular depth estimation is the base task in computer vision. It has a tremendous development in the decade with the development of deep learning. But the boundary blur of the depth map is still a serious problem. Research finds the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Xin Yang , Qingling Chang , Xinlin Liu , Yan Cui

We introduce a novel framework for metric depth estimation that enhances pretrained diffusion-based monocular depth estimation (DB-MDE) models with stereo vision guidance. While existing DB-MDE methods excel at predicting relative depth,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Tuan Pham , Thanh-Tung Le , Xiaohui Xie , Stephan Mandt

Monocular depth estimation is a challenging task in complex compositions depicting multiple objects of diverse scales. Albeit the recent great progress thanks to the deep convolutional neural networks (CNNs), the state-of-the-art monocular…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Bo Li , Yuchao Dai , Mingyi He

Depth information is the foundation of perception, essential for autonomous driving, robotics, and other source-constrained applications. Promptly obtaining accurate and efficient depth information allows for a rapid response in dynamic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Xin Zhang , Rabab Abdelfattah , Yuqi Song , Samuel A. Dauchert , Xiaofeng wang

Monocular depth estimation aims to recover the depth information of 3D scenes from 2D images. Recent work has made significant progress, but its reliance on large-scale datasets and complex decoders has limited its efficiency and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Zeyu Ren , Zeyu Zhang , Wukai Li , Qingxiang Liu , Hao Tang