English
Related papers

Related papers: MatDecompSDF: High-Fidelity 3D Shape and PBR Mater…

200 papers

3D reconstruction from images has wide applications in Virtual Reality and Automatic Driving, where the precision requirement is very high. Ground-breaking research in the neural radiance field (NeRF) by utilizing Multi-Layer Perceptions…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Jiaming Shen , Bolin Song , Zirui Wu , Yi Xu

Neural surfaces learning has shown impressive performance in multi-view surface reconstruction. However, most existing methods use large multilayer perceptrons (MLPs) to train their models from scratch, resulting in hours of training for a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jianyao Xu , Qingshan Xu , Xinyao Liao , Wanjuan Su , Chen Zhang , Yew-Soon Ong , Wenbing Tao

Implicit surface representations such as the signed distance function (SDF) have emerged as a promising approach for image-based surface reconstruction. However, existing optimization methods assume solid surfaces and are therefore unable…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Tianhao Wu , Hanxue Liang , Fangcheng Zhong , Gernot Riegler , Shimon Vainer , Jiankang Deng , Cengiz Oztireli

We introduce a high resolution, 3D-consistent image and shape generation technique which we call StyleSDF. Our method is trained on single-view RGB data only, and stands on the shoulders of StyleGAN2 for image generation, while solving two…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Roy Or-El , Xuan Luo , Mengyi Shan , Eli Shechtman , Jeong Joon Park , Ira Kemelmacher-Shlizerman

Learning a dense 3D model with fine-scale details from a single facial image is highly challenging and ill-posed. To address this problem, many approaches fit smooth geometries through facial prior while learning details as additional…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Xingyu Ren , Alexandros Lattas , Baris Gecer , Jiankang Deng , Chao Ma , Xiaokang Yang , Stefanos Zafeiriou

This paper proposes a deep-learning-based method for recovering a signed distance function (SDF) of a given hypersurface represented by an implicit level set function. Using the flexibility of constructing a neural network, we use an…

Numerical Analysis · Mathematics 2023-05-16 Yesom Park , Chang hoon Song , Jooyoung Hahn , Myungjoo Kang

Procedural modeling is now the de facto standard of material modeling in industry. Procedural models can be edited and are easily extended, unlike pixel-based representations of captured materials. In this paper, we present a semi-automatic…

Graphics · Computer Science 2022-07-01 Yiwei Hu , Chengan He , Valentin Deschaintre , Julie Dorsey , Holly Rushmeier

We present a novel method for 3D surface reconstruction from multiple images where only a part of the object of interest is captured. Our approach builds on two recent developments: surface reconstruction using neural radiance fields for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Savva Ignatyev , Daniil Selikhanovych , Oleg Voynov , Yiqun Wang , Peter Wonka , Stamatios Lefkimmiatis , Evgeny Burnaev

We present iSDF, a continual learning system for real-time signed distance field (SDF) reconstruction. Given a stream of posed depth images from a moving camera, it trains a randomly initialised neural network to map input 3D coordinate to…

In this paper, we address the "dual problem" of multi-view scene reconstruction in which we utilize single-view images captured under different point lights to learn a neural scene representation. Different from existing single-view methods…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Wenqi Yang , Guanying Chen , Chaofeng Chen , Zhenfang Chen , Kwan-Yee K. Wong

We present a modern solution to the multi-view photometric stereo problem (MVPS). Our work suitably exploits the image formation model in a MVPS experimental setup to recover the dense 3D reconstruction of an object from images. We procure…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Berk Kaya , Suryansh Kumar , Francesco Sarno , Vittorio Ferrari , Luc Van Gool

Recent progress in neural implicit functions has set new state-of-the-art in reconstructing high-fidelity 3D shapes from a collection of images. However, these approaches are limited to closed surfaces as they require the surface to be…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Xiaoxu Meng , Weikai Chen , Bo Yang

Active-stereo-based 3D shape measurement is crucial for various purposes, such as industrial inspection, reverse engineering, and medical systems, due to its strong ability to accurately acquire the shape of textureless objects. Active…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ryo Furukawa , Kota Nishihara , Hiroshi Kawasaki

Our objective is to leverage a differentiable radiance field \eg NeRF to reconstruct detailed 3D surfaces in addition to producing the standard novel view renderings. There have been related methods that perform such tasks, usually by…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Yida Wang , David Joseph Tan , Nassir Navab , Federico Tombari

Traditional multi-view photometric stereo (MVPS) methods are often composed of multiple disjoint stages, resulting in noticeable accumulated errors. In this paper, we present a neural inverse rendering method for MVPS based on implicit…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Wenqi Yang , Guanying Chen , Chaofeng Chen , Zhenfang Chen , Kwan-Yee K. Wong

We present a neural rendering-based method called NeRO for reconstructing the geometry and the BRDF of reflective objects from multiview images captured in an unknown environment. Multiview reconstruction of reflective objects is extremely…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Yuan Liu , Peng Wang , Cheng Lin , Xiaoxiao Long , Jiepeng Wang , Lingjie Liu , Taku Komura , Wenping Wang

Embodied intelligence requires precise reconstruction and rendering to simulate large-scale real-world data. Although 3D Gaussian Splatting (3DGS) has recently demonstrated high-quality results with real-time performance, it still faces…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Haodong Xiang , Xinghui Li , Kai Cheng , Xiansong Lai , Wanting Zhang , Zhichao Liao , Long Zeng , Xueping Liu

In this paper, we first propose a novel method for transferring material transformations across different scenes. Building on disentangled Neural Radiance Field (NeRF) representations, our approach learns to map Bidirectional Reflectance…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Ivan Lopes , Jean-François Lalonde , Raoul de Charette

Accurate 3D shape representation is essential in engineering applications such as design, optimization, and simulation. In practice, engineering workflows require structured, part-based representations, as objects are inherently designed as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Nicolas Talabot , Olivier Clerc , Arda Cinar Demirtas , Alexis Goujon , Hieu Le , Doruk Oner , Pascal Fua

We present a differentiable rendering framework for material and lighting estimation from multi-view images and a reconstructed geometry. In the framework, we represent scene lightings as the Neural Incident Light Field (NeILF) and material…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Yao Yao , Jingyang Zhang , Jingbo Liu , Yihang Qu , Tian Fang , David McKinnon , Yanghai Tsin , Long Quan