English
Related papers

Related papers: From None to All: Self-Supervised 3D Reconstructio…

200 papers

We propose a robust and accurate non-parametric method for single-view 3D face reconstruction (SVFR). While tremendous efforts have been devoted to parametric SVFR, a visible gap still lies between the result 3D shape and the ground truth.…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Longwei Guo , Hao Zhu , Yuanxun Lu , Menghua Wu , Xun Cao

Solving depth estimation with monocular cameras enables the possibility of widespread use of cameras as low-cost depth estimation sensors in applications such as autonomous driving and robotics. However, learning such a scalable depth…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Bin Cheng , Inderjot Singh Saggu , Raunak Shah , Gaurav Bansal , Dinesh Bharadia

In this work, we introduce UniGS, a novel 3D Gaussian reconstruction and novel view synthesis model that predicts a high-fidelity representation of 3D Gaussians from arbitrary number of posed sparse-view images. Previous methods often…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Jiamin Wu , Kenkun Liu , Yukai Shi , Xiaoke Jiang , Yuan Yao , Lei Zhang

Accurate 3D reconstruction of vehicles is vital for applications such as vehicle inspection, predictive maintenance, and urban planning. Existing methods like Neural Radiance Fields and Gaussian Splatting have shown impressive results but…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Davide Di Nucci , Matteo Tomei , Guido Borghi , Luca Ciuffreda , Roberto Vezzani , Rita Cucchiara

A key goal of computer vision is to recover the underlying 3D structure from 2D observations of the world. In this paper we learn strong deep generative models of 3D structures, and recover these structures from 3D and 2D images via…

Computer Vision and Pattern Recognition · Computer Science 2018-06-20 Danilo Jimenez Rezende , S. M. Ali Eslami , Shakir Mohamed , Peter Battaglia , Max Jaderberg , Nicolas Heess

Recent advancements in 3D robotic manipulation have improved grasping of everyday objects, but transparent and specular materials remain challenging due to depth sensing limitations. While several 3D reconstruction and depth completion…

Robotics · Computer Science 2025-06-23 Mingxu Zhang , Xiaoqi Li , Jiahui Xu , Kaichen Zhou , Hojin Bae , Yan Shen , Chuyan Xiong , Hao Dong

From a single image, humans are able to perceive the full 3D shape of an object by exploiting learned shape priors from everyday life. Contemporary single-image 3D reconstruction algorithms aim to solve this task in a similar fashion, but…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Xiuming Zhang , Zhoutong Zhang , Chengkai Zhang , Joshua B. Tenenbaum , William T. Freeman , Jiajun Wu

Zero-shot novel view synthesis (NVS) from a single image is an essential problem in 3D object understanding. While recent approaches that leverage pre-trained generative models can synthesize high-quality novel views from in-the-wild…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Jianglong Ye , Peng Wang , Kejie Li , Yichun Shi , Heng Wang

Object-centric scene understanding is a fundamental challenge in computer vision. Existing approaches often rely on multi-stage pipelines that first apply pre-trained segmentors to extract individual objects, followed by per-object 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Yi Du , Yang You , Xiang Wan , Leonidas Guibas

3D geometry is a very informative cue when interacting with and navigating an environment. This writing proposes a new approach to 3D reconstruction and scene understanding, which implicitly learns 3D geometry from depth maps pairing a deep…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Dario Rethage , Federico Tombari , Felix Achilles , Nassir Navab

Sparse-view 3D reconstruction is a major challenge in computer vision, aiming to create complete three-dimensional models from limited viewing angles. Key obstacles include: 1) a small number of input images with inconsistent information;…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Bi'an Du , Lingbei Meng , Wei Hu

The growing demand for Embodied AI and VR applications has highlighted the need for synthesizing high-quality 3D indoor scenes from sparse inputs. However, existing approaches struggle to infer massive amounts of missing geometry in large…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Dehui Wang , Congsheng Xu , Rong Wei , Yue Shi , Shoufa Chen , Dingxiang Luo , Tianshuo Yang , Xiaokang Yang , Wei Sui , Yusen Qin , Rui Tang , Yao Mu

Novel view synthesis from a sparse set of input images is a challenging problem of great practical interest, especially when camera poses are absent or inaccurate. Direct optimization of camera poses and usage of estimated depths in neural…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Kaiwen Jiang , Yang Fu , Mukund Varma T , Yash Belhe , Xiaolong Wang , Hao Su , Ravi Ramamoorthi

We present FLARE, a feed-forward model designed to infer high-quality camera poses and 3D geometry from uncalibrated sparse-view images (i.e., as few as 2-8 inputs), which is a challenging yet practical setting in real-world applications.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Shangzhan Zhang , Jianyuan Wang , Yinghao Xu , Nan Xue , Christian Rupprecht , Xiaowei Zhou , Yujun Shen , Gordon Wetzstein

We present SS3D, a web-scale SfM-based self-supervision pretraining pipeline for feed-forward 3D estimation from monocular video. Our model jointly predicts depth, ego-motion, and intrinsics in a single forward pass and is trained/evaluated…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Marwane Hariat , Gianni Franchi , David Filliat , Antoine Manzanera

Recovering 3D information from scenes via multi-view stereo reconstruction (MVS) and novel view synthesis (NVS) is inherently challenging, particularly in scenarios involving sparse-view setups. The advent of 3D Gaussian Splatting (3DGS)…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Shubhendu Jena , Shishir Reddy Vutukur , Adnane Boukhayma

The performance of existing single-view 3D reconstruction methods heavily relies on large-scale 3D annotations. However, such annotations are tedious and expensive to collect. Semi-supervised learning serves as an alternative way to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Zhen Xing , Hengduo Li , Zuxuan Wu , Yu-Gang Jiang

Our work learns a unified model for single-view 3D reconstruction of objects from hundreds of semantic categories. As a scalable alternative to direct 3D supervision, our work relies on segmented image collections for learning 3D of generic…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Kalyan Vasudev Alwala , Abhinav Gupta , Shubham Tulsiani

Panoramic imagery offers a full 360{\deg} field of view and is increasingly common in consumer devices. However, it introduces non-pinhole distortions that challenge joint pose estimation and 3D reconstruction. Existing feed-forward models,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yijing Guo , Mengjun Chao , Luo Wang , Tianyang Zhao , Haizhao Dai , Yingliang Zhang , Jingyi Yu , Yujiao Shi

Synthesis and reconstruction of 3D human head has gained increasing interests in computer vision and computer graphics recently. Existing state-of-the-art 3D generative adversarial networks (GANs) for 3D human head synthesis are either…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Sizhe An , Hongyi Xu , Yichun Shi , Guoxian Song , Umit Ogras , Linjie Luo