English
Related papers

Related papers: Single-view 3D reconstruction via inverse procedur…

200 papers

Much progress has been made in the supervised learning of 3D reconstruction of rigid objects from multi-view images or a video. However, it is more challenging to reconstruct severely deformed objects from a single-view RGB image in an…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Jie Mei , Jingxi Yu , Suzanne Romain , Craig Rose , Kelsey Magrane , Graeme LeeSon , Jenq-Neng Hwang

Reconstructing the 3D mesh of a general object from a single image is now possible thanks to the latest advances of deep learning technologies. However, due to the nontrivial difficulty of generating a feasible mesh structure, the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Junyi Pan , Xiaoguang Han , Weikai Chen , Jiapeng Tang , Kui Jia

Model-based learned iterative reconstruction methods have recently been shown to outperform classical reconstruction algorithms. Applicability of these methods to large scale inverse problems is however limited by the available memory for…

Image and Video Processing · Electrical Eng. & Systems 2020-04-21 Andreas Hauptmann , Jonas Adler , Simon Arridge , Ozan Öktem

Reconstructing 3D clothed humans from images is fundamental to applications like virtual try-on, avatar creation, and mixed reality. While recent advances have enhanced human body recovery, accurate reconstruction of garment geometry --…

Graphics · Computer Science 2025-05-16 Ren Li , Cong Cao , Corentin Dumery , Yingxuan You , Hao Li , Pascal Fua

There is some ambiguity in the 3D shape of an object when the number of observed views is small. Because of this ambiguity, although a 3D object reconstructor can be trained using a single view or a few views per object, reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Hiroharu Kato , Tatsuya Harada

In this paper, we present a new perspective towards image-based shape generation. Most existing deep learning based shape reconstruction methods employ a single-view deterministic model which is sometimes insufficient to determine a single…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Yi Wei , Shaohui Liu , Wang Zhao , Jiwen Lu , Jie Zhou

This paper is about reducing the cost of building good large-scale 3D reconstructions post-hoc. We render 2D views of an existing reconstruction and train a convolutional neural network (CNN) that refines inverse-depth to match a…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Ştefan Săftescu , Paul Newman

Recent work has shown the ability to learn generative models for 3D shapes from only unstructured 2D images. However, training such models requires differentiating through the rasterization step of the rendering process, therefore past work…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Sebastian Lunz , Yingzhen Li , Andrew Fitzgibbon , Nate Kushman

3D reconstruction of a scene from Synthetic Aperture Radar (SAR) images mainly relies on interferometric measurements, which involve strict constraints on the acquisition process. These last years, progress in deep learning has…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Emile Barbier--Renard , Florence Tupin , Nicolas Trouvé , Loïc Denis

We introduce InverseFaceNet, a deep convolutional inverse rendering framework for faces that jointly estimates facial pose, shape, expression, reflectance and illumination from a single input image. By estimating all parameters from just a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Hyeongwoo Kim , Michael Zollhöfer , Ayush Tewari , Justus Thies , Christian Richardt , Christian Theobalt

Learning-based 3D reconstruction methods have shown impressive results. However, most methods require 3D supervision which is often hard to obtain for real-world datasets. Recently, several works have proposed differentiable rendering…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Michael Niemeyer , Lars Mescheder , Michael Oechsle , Andreas Geiger

Single-view 3D object reconstruction is a fundamental and challenging computer vision task that aims at recovering 3D shapes from single-view RGB images. Most existing deep learning based reconstruction methods are trained and evaluated on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xianghui Yang , Guosheng Lin , Luping Zhou

Recent advances in 3D scene generation produce visually appealing output, but current representations hinder artists' workflows that require modifiable 3D textured mesh scenes for visual effects and game development. Despite significant…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Tobias Sautter , Jan-Niklas Dihlmann , Hendrik P. A. Lensch

Single-view 3D hair reconstruction is challenging, due to the wide range of shape variations among diverse hairstyles. Current state-of-the-art methods are specialized in recovering un-braided 3D hairs and often take braided styles as their…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Yujian Zheng , Yuda Qiu , Leyang Jin , Chongyang Ma , Haibin Huang , Di Zhang , Pengfei Wan , Xiaoguang Han

Inverse rendering in a 3D format denoted to recovering the 3D properties of a scene given 2D input image(s) and is typically done using 3D Morphable Model (3DMM) based methods from single view images. These models formulate each face as a…

Computer Vision and Pattern Recognition · Computer Science 2017-09-01 Shima Kamyab , Ali Ghodsi , S. Zohreh Azimifar

This paper investigates a 2D to 3D image translation method with a straightforward technique, enabling correlated 2D X-ray to 3D CT-like reconstruction. We observe that existing approaches, which integrate information across multiple 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Abril Corona-Figueroa , Hubert P. H. Shum , Chris G. Willcocks

Our work learns a unified model for single-view 3D reconstruction of objects from hundreds of semantic categories. As a scalable alternative to direct 3D supervision, our work relies on segmented image collections for learning 3D of generic…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Kalyan Vasudev Alwala , Abhinav Gupta , Shubham Tulsiani

Reconstructing the shape and appearance of real-world objects using measured 2D images has been a long-standing problem in computer vision. In this paper, we introduce a new analysis-by-synthesis technique capable of producing high-quality…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Fujun Luan , Shuang Zhao , Kavita Bala , Zhao Dong

For humans, visual understanding is inherently generative: given a 3D shape, we can postulate how it would look in the world; given a 2D image, we can infer the 3D structure that likely gave rise to it. We can thus translate between the 2D…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Tristan Aumentado-Armstrong , Alex Levinshtein , Stavros Tsogkas , Konstantinos G. Derpanis , Allan D. Jepson

Today, most methods for image understanding tasks rely on feed-forward neural networks. While this approach has allowed for empirical accuracy, efficiency, and task adaptation via fine-tuning, it also comes with fundamental disadvantages.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Julian Ost , Tanushree Banerjee , Mario Bijelic , Felix Heide