English
Related papers

Related papers: Learning single-image 3D reconstruction by generat…

200 papers

Reconstructing 3D objects from a single image is an intriguing but challenging problem. One promising solution is to utilize multi-view (MV) 3D reconstruction to fuse generated MV images into consistent 3D objects. However, the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yizheng Chen , Rengan Xie , Qi Ye , Sen Yang , Zixuan Xie , Tianxiao Chen , Rong Li , Yuchi Huo

Single-view 3D reconstruction is currently approached from two dominant perspectives: reconstruction of scenes with limited diversity using 3D data supervision or reconstruction of diverse singular objects using large image priors. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Andreea Ardelean , Mert Özer , Bernhard Egger

Representing scenes at the granularity of objects is a prerequisite for scene understanding and decision making. We propose PriSMONet, a novel approach based on Prior Shape knowledge for learning Multi-Object 3D scene decomposition and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Cathrin Elich , Martin R. Oswald , Marc Pollefeys , Joerg Stueckler

Semantic reconstruction of indoor scenes refers to both scene understanding and object reconstruction. Existing works either address one part of this problem or focus on independent objects. In this paper, we bridge the gap between…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Yinyu Nie , Xiaoguang Han , Shihui Guo , Yujian Zheng , Jian Chang , Jian Jun Zhang

Recent advancements in 3D robotic manipulation have improved grasping of everyday objects, but transparent and specular materials remain challenging due to depth sensing limitations. While several 3D reconstruction and depth completion…

Robotics · Computer Science 2025-06-23 Mingxu Zhang , Xiaoqi Li , Jiahui Xu , Kaichen Zhou , Hojin Bae , Yan Shen , Chuyan Xiong , Hao Dong

Creating realistic and simulation-ready 3D assets is crucial for autonomous driving research and virtual environment construction. However, existing 3D vehicle generation methods are often trained on synthetic data with significant domain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Hongyuan Liu , Bochao Zou , Qiankun Liu , Haochen Yu , Qi Mei , Jianfei Jiang , Chen Liu , Cheng Bi , Zhao Wang , Xueyang Zhang , Yifei Zhan , Jiansheng Chen , Huimin Ma

Learning 3D generative models from a dataset of monocular images enables self-supervised 3D reasoning and controllable synthesis. State-of-the-art 3D generative models are GANs which use neural 3D volumetric representations for synthesis.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Ayush Tewari , Mallikarjun B R , Xingang Pan , Ohad Fried , Maneesh Agrawala , Christian Theobalt

We introduce InverseFaceNet, a deep convolutional inverse rendering framework for faces that jointly estimates facial pose, shape, expression, reflectance and illumination from a single input image. By estimating all parameters from just a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Hyeongwoo Kim , Michael Zollhöfer , Ayush Tewari , Justus Thies , Christian Richardt , Christian Theobalt

Reconstructing the detailed geometric structure of a face from a given image is a key to many computer vision and graphics applications, such as motion capture and reenactment. The reconstruction task is challenging as human faces vary…

Computer Vision and Pattern Recognition · Computer Science 2017-04-07 Elad Richardson , Matan Sela , Roy Or-El , Ron Kimmel

With the recent advances in hardware and rendering techniques, 3D models have emerged everywhere in our life. Yet creating 3D shapes is arduous and requires significant professional knowledge. Meanwhile, Deep learning has enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zhiqin Chen

Single-view 3D object reconstruction has seen much progress, yet methods still struggle generalizing to novel shapes unseen during training. Common approaches predominantly rely on learned global shape priors and, hence, disregard detailed…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Jan Bechtold , Maxim Tatarchenko , Volker Fischer , Thomas Brox

Monocular dynamic reconstruction is a challenging and long-standing vision problem due to the highly ill-posed nature of the task. Existing approaches depend on templates, are effective only in quasi-static scenes, or fail to model 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Qianqian Wang , Vickie Ye , Hang Gao , Weijia Zeng , Jake Austin , Zhengqi Li , Angjoo Kanazawa

Current state-of-the-art methods cast monocular 3D human pose estimation as a learning problem by training neural networks on large data sets of images and corresponding skeleton poses. In contrast, we propose an approach that can exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Simon Jenni , Paolo Favaro

We propose a method for 3D object reconstruction and 6D-pose estimation from 2D images that uses knowledge about object shape as the primary key. In the proposed pipeline, recognition and labeling of objects in 2D images deliver 2D segment…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Marcell Wolnitza , Osman Kaya , Tomas Kulvicius , Florentin Wörgötter , Babette Dellen

We propose a new self-supervised method for pre-training the backbone of deep perception models operating on point clouds. The core idea is to train the model on a pretext task which is the reconstruction of the surface on which the 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Alexandre Boulch , Corentin Sautier , Björn Michele , Gilles Puy , Renaud Marlet

We propose a method for constructing generative models of 3D objects from a single 3D mesh. Our method produces a 3D morphable model that represents shape and albedo in terms of Gaussian processes. We define the shape deformations in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Skylar Sutherland , Bernhard Egger , Joshua Tenenbaum

State-of-the-art lidar-based 3D object detection methods rely on supervised learning and large labeled datasets. However, annotating lidar data is resource-consuming, and depending only on supervised learning limits the applicability of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Ekim Yurtsever , Emeç Erçelik , Mingyu Liu , Zhijie Yang , Hanzhen Zhang , Pınar Topçam , Maximilian Listl , Yılmaz Kaan Çaylı , Alois Knoll

Self-supervised learning has transformed 2D computer vision by enabling models trained on large, unannotated datasets to provide versatile off-the-shelf features that perform similarly to models trained with labels. However, in 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Pedro Hermosilla , Christian Stippel , Leon Sick

Image restoration, or inverse problems in image processing, has long been an extensively studied topic. In recent years supervised learning approaches have become a popular strategy attempting to tackle this task. Unfortunately, most…

Image and Video Processing · Electrical Eng. & Systems 2024-09-24 Deborah Pereg

In this paper, we propose a novel 3D-RecGAN approach, which reconstructs the complete 3D structure of a given object from a single arbitrary depth view using generative adversarial networks. Unlike the existing work which typically requires…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Bo Yang , Hongkai Wen , Sen Wang , Ronald Clark , Andrew Markham , Niki Trigoni