English
Related papers

Related papers: From None to All: Self-Supervised 3D Reconstructio…

200 papers

Realtime 4D reconstruction for dynamic scenes remains a crucial challenge for autonomous driving perception. Most existing methods rely on depth estimation through self-supervision or multi-modality sensor fusion. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xin Fei , Wenzhao Zheng , Yueqi Duan , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Jiwen Lu

DUSt3R-based end-to-end scene reconstruction has recently shown promising results in dense visual SLAM. However, most existing methods only use image pairs to estimate pointmaps, overlooking spatial memory and global consistency.To this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Guole Shen , Tianchen Deng , Yanbo Wang , Yongtao Chen , Yilin Shen , Jiuming Liu , Jingchuan Wang

We present Edit3r, a feed-forward framework that reconstructs and edits 3D scenes in a single pass from unposed, view-inconsistent, instruction-edited images. Unlike prior methods requiring per-scene optimization, Edit3r directly predicts…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Jiageng Liu , Weijie Lyu , Xueting Li , Yejie Guo , Ming-Hsuan Yang

Multi-camera 3D object detection for autonomous driving is a challenging problem that has garnered notable attention from both academia and industry. An obstacle encountered in vision-based techniques involves the precise extraction of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Linyan Huang , Huijie Wang , Jia Zeng , Shengchuan Zhang , Liujuan Cao , Junchi Yan , Hongyang Li

2D-to-3D reconstruction is an ill-posed problem, yet humans are good at solving this problem due to their prior knowledge of the 3D world developed over years. Driven by this observation, we propose NeRDi, a single-view NeRF synthesis…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Congyue Deng , Chiyu "Max'' Jiang , Charles R. Qi , Xinchen Yan , Yin Zhou , Leonidas Guibas , Dragomir Anguelov

This paper tackles the problem of generalizable 3D-aware generation from monocular datasets, e.g., ImageNet. The key challenge of this task is learning a robust 3D-aware representation without multi-view or dynamic data, while ensuring…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yuxin Wang , Qianyi Wu , Dan Xu

DUSt3R introduced a novel paradigm in geometric computer vision by proposing a model that can provide dense and unconstrained Stereo 3D Reconstruction of arbitrary image collections with no prior information about camera calibration nor…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yohann Cabon , Lucas Stoffl , Leonid Antsfeld , Gabriela Csurka , Boris Chidlovskii , Jerome Revaud , Vincent Leroy

Recovering the 3D structure of an object from a single image is a challenging task due to its ill-posed nature. One approach is to utilize the plentiful photos of the same object category to learn a strong 3D shape prior for the object.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Long-Nhat Ho , Anh Tuan Tran , Quynh Phung , Minh Hoai

Modern Recurrent Neural Networks have become a competitive architecture for 3D reconstruction due to their linear-time complexity. However, their performance degrades significantly when applied beyond the training context length, revealing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Xingyu Chen , Yue Chen , Yuliang Xiu , Andreas Geiger , Anpei Chen

The default strategy for training single-view Large Reconstruction Models (LRMs) follows the fully supervised route using large-scale datasets of synthetic 3D assets or multi-view captures. Although these resources simplify the training…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Hanwen Jiang , Qixing Huang , Georgios Pavlakos

Intraoral 3D reconstruction is fundamental to digital orthodontics, yet conventional methods like intraoral scanning are inaccessible for remote tele-orthodontics, which typically relies on sparse smartphone imagery. While 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Yiyi Miao , Taoyu Wu , Tong Chen , Ji Jiang , Zhe Tang , Zhengyong Jiang , Angelos Stefanidis , Limin Yu , Jionglong Su

Self-supervised learning has made substantial strides in image processing, while visual pre-training for autonomous driving is still in its infancy. Existing methods often focus on learning geometric scene information while neglecting…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Shaoqing Xu , Fang Li , Shengyin Jiang , Ziying Song , Li Liu , Zhi-xin Yang

We introduce S2C-3D, a novel sparse-view 3D reconstruction framework for high-fidelity and complete scene reconstruction from as few as six to eight images. Our framework features three components: a specialized diffusion model for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Yiyang Shen , Yin Yang , Kun Zhou , Tianjia Shao

Recently, multi-view diffusion-based 3D generation methods have gained significant attention. However, these methods often suffer from shape and texture misalignment across generated multi-view images, leading to low-quality 3D generation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhuojiang Cai , Yiheng Zhang , Meitong Guo , Mingdao Wang , Yuwang Wang

Recent advances in feed-forward Novel View Synthesis (NVS) have led to a divergence between two design philosophies: bias-driven methods, which rely on explicit 3D knowledge, such as handcrafted 3D representations (e.g., NeRF and 3DGS) and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Haoru Wang , Kai Ye , Minghan Qin , Yangyan Li , Wenzheng Chen , Baoquan Chen

Dense matching methods like DUSt3R regress pairwise pointmaps for 3D reconstruction. However, the reliance on pairwise prediction and the limited generalization capability inherently restrict the global geometric consistency. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Yuheng Yuan , Qiuhong Shen , Shizun Wang , Xingyi Yang , Xinchao Wang

Inspired by the recent success of methods that employ shape priors to achieve robust 3D reconstructions, we propose a novel recurrent neural network architecture that we call the 3D Recurrent Reconstruction Neural Network (3D-R2N2). The…

Computer Vision and Pattern Recognition · Computer Science 2016-04-05 Christopher B. Choy , Danfei Xu , JunYoung Gwak , Kevin Chen , Silvio Savarese

Neural surface reconstruction (NSR) has recently shown strong potential for urban 3D reconstruction from multi-view aerial imagery. However, existing NSR methods often suffer from geometric ambiguity and instability, particularly under…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Da Li , Chen Yao , Tong Mao , Jiacheng Bao , Houjun Sun

Novel View Synthesis (NVS) from unconstrained photo collections is challenging in computer graphics. Recently, 3D Gaussian Splatting (3DGS) has shown promise for photorealistic and real-time NVS of static scenes. Building on 3DGS, we…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yuze Wang , Junyi Wang , Yue Qi

Recent learning-based approaches, in which models are trained by single-view images have shown promising results for monocular 3D face reconstruction, but they suffer from the ill-posed face pose and depth ambiguity issue. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Jiaxiang Shang , Tianwei Shen , Shiwei Li , Lei Zhou , Mingmin Zhen , Tian Fang , Long Quan