English
Related papers

Related papers: Multiview Neural Surface Reconstruction by Disenta…

200 papers

We present a new multi-sensor dataset for multi-view 3D surface reconstruction. It includes registered RGB and depth data from sensors of different resolutions and modalities: smartphones, Intel RealSense, Microsoft Kinect, industrial…

Precise calibration is a must for high reliance 3D computer vision algorithms. A challenging case is when the camera is behind a protective glass or transparent object: due to refraction, the image is heavily distorted; the pinhole camera…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Szabolcs Pável , Csanád Sándor , Lehel Csató

In this work, we propose an inverse rendering model that estimates 3D shape, spatially-varying reflectance, homogeneous subsurface scattering parameters, and an environment illumination jointly from only a pair of captured images of a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Chenhao Li , Trung Thanh Ngo , Hajime Nagahara

We propose an end-to-end deep learning architecture that produces a 3D shape in triangular mesh from a single color image. Limited by the nature of deep neural network, previous methods usually represent a 3D shape in volume or point cloud,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Nanyang Wang , Yinda Zhang , Zhuwen Li , Yanwei Fu , Wei Liu , Yu-Gang Jiang

This paper addresses the challenge of reconstructing 3D indoor scenes from multi-view images. Many previous works have shown impressive reconstruction results on textured objects, but they still have difficulty in handling low-textured…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Haoyu Guo , Sida Peng , Haotong Lin , Qianqian Wang , Guofeng Zhang , Hujun Bao , Xiaowei Zhou

An important problem for both graphics and vision is to synthesize novel views of a 3D object from a single image. This is particularly challenging due to the partial observability inherent in projecting a 3D object onto the image space,…

Machine Learning · Computer Science 2016-01-06 Jimei Yang , Scott Reed , Ming-Hsuan Yang , Honglak Lee

Neural implicit surfaces have become an important technique for multi-view 3D reconstruction but their accuracy remains limited. In this paper, we argue that this comes from the difficulty to learn and render high frequency textures with…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 François Darmon , Bénédicte Bascle , Jean-Clément Devaux , Pascal Monasse , Mathieu Aubry

Neural surface reconstruction has been shown to be powerful for recovering dense 3D surfaces via image-based neural rendering. However, current methods struggle to recover detailed structures of real-world scenes. To address the issue, we…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Zhaoshuo Li , Thomas Müller , Alex Evans , Russell H. Taylor , Mathias Unberath , Ming-Yu Liu , Chen-Hsuan Lin

We introduce a novel learning-based, visibility-aware, surface reconstruction method for large-scale, defect-laden point clouds. Our approach can cope with the scale and variety of point cloud defects encountered in real-life Multi-View…

Computer Vision and Pattern Recognition · Computer Science 2022-02-03 Raphael Sulzer , Loic Landrieu , Renaud Marlet , Bruno Vallet

To generalize to novel visual scenes with new viewpoints and new object poses, a visual system needs representations of the shapes of the parts of an object that are invariant to changes in viewpoint or pose. 3D graphics representations…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Boyang Deng , Simon Kornblith , Geoffrey Hinton

We study the problem of shape generation in 3D mesh representation from a small number of color images with or without camera poses. While many previous works learn to hallucinate the shape directly from priors, we adopt to further improve…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Chao Wen , Yinda Zhang , Chenjie Cao , Zhuwen Li , Xiangyang Xue , Yanwei Fu

We propose a scalable neural network framework to reconstruct the 3D mesh of a human body from multi-view images, in the subspace of the SMPL model. Use of multi-view images can significantly reduce the projection ambiguity of the problem,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Junbang Liang , Ming C. Lin

Fast and robust three-dimensional reconstruction of facial geometric structure from a single image is a challenging task with numerous applications. Here, we introduce a learning-based approach for reconstructing a three-dimensional face…

Computer Vision and Pattern Recognition · Computer Science 2016-09-27 Elad Richardson , Matan Sela , Ron Kimmel

Recovering textured 3D models of non-rigid human body shapes is challenging due to self-occlusions caused by complex body poses and shapes, clothing obstructions, lack of surface texture, background clutter, sparse set of cameras with…

Computer Vision and Pattern Recognition · Computer Science 2018-09-19 Abbhinav Venkat , Sai Sagar Jinka , Avinash Sharma

We present Neural Microfacet Fields, a method for recovering materials, geometry, and environment illumination from images of a scene. Our method uses a microfacet reflectance model within a volumetric setting by treating each sample along…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Alexander Mai , Dor Verbin , Falko Kuester , Sara Fridovich-Keil

3D reconstruction aims to recover the dense 3D structure of a scene. It plays an essential role in various applications such as Augmented/Virtual Reality (AR/VR), autonomous driving and robotics. Leveraging multiple views of a scene…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Fangjinhua Wang , Qingtian Zhu , Di Chang , Quankai Gao , Junlin Han , Tong Zhang , Richard Hartley , Marc Pollefeys

Remarkable advances have been achieved recently in learning neural representations that characterize object geometry, while generating textured objects suitable for downstream applications and 3D rendering remains at an early stage. In…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Alexey Bokhovkin , Shubham Tulsiani , Angela Dai

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

In this paper, we consider the problem of reconstructing a dense 3D model using images captured from different views. Recent methods based on convolutional neural networks (CNN) allow learning the entire task from data. However, they do not…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Despoina Paschalidou , Ali Osman Ulusoy , Carolin Schmitt , Luc van Gool , Andreas Geiger

Learning-based 3D reconstruction methods have shown impressive results. However, most methods require 3D supervision which is often hard to obtain for real-world datasets. Recently, several works have proposed differentiable rendering…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Michael Niemeyer , Lars Mescheder , Michael Oechsle , Andreas Geiger