English
Related papers

Related papers: Shape From Tracing: Towards Reconstructing 3D Obje…

200 papers

We propose Differentiable Stereopsis, a multi-view stereo approach that reconstructs shape and texture from few input views and noisy cameras. We pair traditional stereopsis and modern differentiable rendering to build an end-to-end model…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Shubham Goel , Georgia Gkioxari , Jitendra Malik

We propose an approach to 3D reconstruction via inverse procedural modeling and investigate two variants of this approach. The first option consists in the fitting set of input parameters using a genetic algorithm. We demonstrate the…

Graphics · Computer Science 2023-10-23 Albert Garifullin , Nikolay Maiorov , Vladimir Frolov

Reconstructing the shape and spatially varying surface appearances of a physical-world object as well as its surrounding illumination based on 2D images (e.g., photographs) of the object has been a long-standing problem in computer vision…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Cheng Sun , Guangyan Cai , Zhengqin Li , Kai Yan , Cheng Zhang , Carl Marshall , Jia-Bin Huang , Shuang Zhao , Zhao Dong

We propose a novel approach for 3D mesh reconstruction from multi-view images. Our method takes inspiration from large reconstruction models like LRM that use a transformer-based triplane generator and a Neural Radiance Field (NeRF) model…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Peiye Zhuang , Songfang Han , Chaoyang Wang , Aliaksandr Siarohin , Jiaxu Zou , Michael Vasilkovsky , Vladislav Shakhrai , Sergey Korolev , Sergey Tulyakov , Hsin-Ying Lee

In computed tomography, the reconstruction is typically obtained on a voxel grid. In this work, however, we propose a mesh-based reconstruction method. For tomographic problems, 3D meshes have mostly been studied to simulate data…

Image and Video Processing · Electrical Eng. & Systems 2021-03-12 Jakeoung Koo , Anders B. Dahl , J. Andreas Bærentzen , Qiongyang Chen , Sara Bals , Vedrana A. Dahl

Fine-detailed reconstructions are in high demand in many applications. However, most of the existing RGB-D reconstruction methods rely on pre-calculated accurate camera poses to recover the detailed surface geometry, where the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Lu Sang , Bjoern Haefner , Xingxing Zuo , Daniel Cremers

Much progress has been made in the supervised learning of 3D reconstruction of rigid objects from multi-view images or a video. However, it is more challenging to reconstruct severely deformed objects from a single-view RGB image in an…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Jie Mei , Jingxi Yu , Suzanne Romain , Craig Rose , Kelsey Magrane , Graeme LeeSon , Jenq-Neng Hwang

We propose an approach for 3D reconstruction and segmentation of a single object placed on a flat surface from an input video. Our approach is to perform dense depth map estimation for multiple views using a proposed objective function that…

Computer Vision and Pattern Recognition · Computer Science 2016-07-29 Tanmay Gupta , Daeyun Shin , Naren Sivagnanadasan , Derek Hoiem

We introduce a differential visual similarity metric to train deep neural networks for 3D reconstruction, aimed at improving reconstruction quality. The metric compares two 3D shapes by measuring distances between multi-view images…

Graphics · Computer Science 2020-04-02 Jiongchao Jin , Akshay Gadi Patil , Zhang Xiong , Hao Zhang

We present an efficient method for joint optimization of topology, materials and lighting from multi-view image observations. Unlike recent multi-view reconstruction approaches, which typically produce entangled 3D representations encoded…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Jacob Munkberg , Jon Hasselgren , Tianchang Shen , Jun Gao , Wenzheng Chen , Alex Evans , Thomas Müller , Sanja Fidler

Neural implicit representations have emerged as a powerful paradigm for 3D reconstruction. However, despite their success, existing methods fail to capture fine geometric details and thin structures, especially in scenarios where only…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Aarya Patel , Hamid Laga , Ojaswa Sharma

In modern computer vision, the optimal representation of 3D shape continues to be task-dependent. One fundamental operation applied to such representations is differentiable rendering, as it enables inverse graphics approaches in learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Tristan Aumentado-Armstrong , Stavros Tsogkas , Sven Dickinson , Allan Jepson

With the support of Virtual Reality (VR) and Augmented Reality (AR) technologies, the 3D virtual eyeglasses try-on application is well on its way to becoming a new trending solution that offers a "try on" option to select the perfect pair…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Fan Zhang , Ziyue Ji , Weiguang Kang , Weiqing Li , Zhiyong Su

This paper addresses the problem of reconstructing the surface shape of transparent objects. The difficulty of this problem originates from the viewpoint dependent appearance of a transparent object, which quickly makes reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2021-05-24 Kai Han , Kwan-Yee K. Wong , Miaomiao Liu

The objective of this work is to infer the 3D shape of an object from a single image. We use sculptures as our training and test bed, as these have great variety in shape and appearance. To achieve this we build on the success of multiple…

Computer Vision and Pattern Recognition · Computer Science 2018-10-05 Olivia Wiles , Andrew Zisserman

This paper presents a process for estimating the spatially varying surface reflectance of complex scenes observed under natural illumination. In contrast to previous methods, our process is not limited to scenes viewed under controlled…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Alen Joy , Charalambos Poullis

We present differentiable point-based inverse rendering, DPIR, an analysis-by-synthesis method that processes images captured under diverse illuminations to estimate shape and spatially-varying BRDF. To this end, we adopt point-based…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Hoon-Gyu Chung , Seokjun Choi , Seung-Hwan Baek

3D Morphable Model (3DMM) fitting has widely benefited face analysis due to its strong 3D priori. However, previous reconstructed 3D faces suffer from degraded visual verisimilitude due to the loss of fine-grained geometry, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Xiangyu Zhu , Chang Yu , Di Huang , Zhen Lei , Hao Wang , Stan Z. Li

Optical images of transparent three-dimensional objects can be different from a replica of the object's cross section in the image plane due to refraction at the surface or in the body of the object. Simulations of the object's image are…

We propose a method to refine geometry of 3D meshes from a consumer level depth camera, e.g. Kinect, by exploiting shading cues captured from an infrared (IR) camera. A major benefit to using an IR camera instead of an RGB camera is that…

Computer Vision and Pattern Recognition · Computer Science 2016-08-19 Gyeongmin Choe , Jaesik Park , Yu-Wing Tai , In So Kweon