English
Related papers

Related papers: Neural Reflectance for Shape Recovery with Shadow …

200 papers

Multilayer perceptrons (MLPs) have been successfully used to represent 3D shapes implicitly and compactly, by mapping 3D coordinates to the corresponding signed distance values or occupancy values. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Peng-Shuai Wang , Yang Liu , Yu-Qi Yang , Xin Tong

This paper proposes a novel neural-network-based adaptive hybrid-reflectance three-dimensional (3-D) surface reconstruction model. The neural network combines the diffuse and specular components into a hybrid model. The proposed model…

Neural and Evolutionary Computing · Computer Science 2009-12-14 Vincy Joseph , Shalini Bhatia

3D reconstruction is a fundamental problem in computer vision, and the task is especially challenging when the object to reconstruct is partially or fully occluded. We introduce a method that uses the shadows cast by an unobserved object in…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Ruoshi Liu , Sachit Menon , Chengzhi Mao , Dennis Park , Simon Stent , Carl Vondrick

This paper presents a novel neural implicit radiance representation for free viewpoint relighting from a small set of unstructured photographs of an object lit by a moving point light source different from the view position. We express the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Chong Zeng , Guojun Chen , Yue Dong , Pieter Peers , Hongzhi Wu , Xin Tong

Multispectral photometric stereo(MPS) aims at recovering the surface normal of a scene from a single-shot multispectral image captured under multispectral illuminations. Existing MPS methods adopt the Lambertian reflectance model to make…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jipeng Lv , Heng Guo , Guanying Chen , Jinxiu Liang , Boxin Shi

Neural surface reconstruction has been shown to be powerful for recovering dense 3D surfaces via image-based neural rendering. However, current methods struggle to recover detailed structures of real-world scenes. To address the issue, we…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Zhaoshuo Li , Thomas Müller , Alex Evans , Russell H. Taylor , Mathias Unberath , Ming-Yu Liu , Chen-Hsuan Lin

We consider the problem of high-dimensional light field reconstruction and develop a learning-based framework for spatial and angular super-resolution. Many current approaches either require disparity clues or restore the spatial and…

Image and Video Processing · Electrical Eng. & Systems 2020-09-18 Nan Meng , Hayden K. -H. So , Xing Sun , Edmund Y. Lam

Efficiently reconstructing complex and intricate surfaces at scale is a long-standing goal in machine perception. To address this problem we introduce Deep Local Shapes (DeepLS), a deep shape representation that enables encoding and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Rohan Chabra , Jan Eric Lenssen , Eddy Ilg , Tanner Schmidt , Julian Straub , Steven Lovegrove , Richard Newcombe

Recent advances in neural rendering have achieved impressive results on photorealistic shading and relighting, by using a multilayer perceptron (MLP) as a regression model to learn the rendering equation from a real-world dataset. Such…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Zhuo He , Yingdong Ru , Qianying Liu , Paul Henderson , Nicolas Pugeault

We present Neural Microfacet Fields, a method for recovering materials, geometry, and environment illumination from images of a scene. Our method uses a microfacet reflectance model within a volumetric setting by treating each sample along…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Alexander Mai , Dor Verbin , Falko Kuester , Sara Fridovich-Keil

Recovering the physical attributes of an object's appearance from its images captured under an unknown illumination is challenging yet essential for photo-realistic rendering. Recent approaches adopt the emerging implicit scene…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Youjia Zhang , Teng Xu , Junqing Yu , Yuteng Ye , Junle Wang , Yanqing Jing , Jingyi Yu , Wei Yang

A fundamental problem in computer vision is that of inferring the intrinsic, 3D structure of the world from flat, 2D images of that world. Traditional methods for recovering scene properties such as shape, reflectance, or illumination rely…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Jonathan T. Barron , Jitendra Malik

We tackle the problem of automatically reconstructing a complete 3D model of a scene from a single RGB image. This challenging task requires inferring the shape of both visible and occluded surfaces. Our approach utilizes viewer-centered,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Daeyun Shin , Zhile Ren , Erik B. Sudderth , Charless C. Fowlkes

Decomposing a scene into its shape, reflectance, and illumination is a challenging but important problem in computer vision and graphics. This problem is inherently more challenging when the illumination is not a single light source under…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Mark Boss , Raphael Braun , Varun Jampani , Jonathan T. Barron , Ce Liu , Hendrik P. A. Lensch

Estimating and modelling the appearance of an object under outdoor illumination conditions is a complex process. Although there have been several studies on illumination estimation and relighting, very few of them focus on estimating the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Farhan Rahman Wasee , Alen Joy , Charalambos Poullis

This paper proposes a simple method which solves an open problem of multi-view 3D-Reconstruction for objects with unknown and generic surface materials, imaged by a freely moving camera and a freely moving point light source. The object can…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Ziang Cheng , Hongdong Li , Richard Hartley , Yinqiang Zheng , Imari Sato

We introduce the first learning-based method for recovering shapes from Laplacian spectra. Given an auto-encoder, our model takes the form of a cycle-consistent module to map latent vectors to sequences of eigenvalues. This module provides…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 Riccardo Marin , Arianna Rampini , Umberto Castellani , Emanuele Rodolà , Maks Ovsjanikov , Simone Melzi

Recent advances in implicit neural representations and differentiable rendering make it possible to simultaneously recover the geometry and materials of an object from multi-view RGB images captured under unknown static illumination.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Yuanqing Zhang , Jiaming Sun , Xingyi He , Huan Fu , Rongfei Jia , Xiaowei Zhou

We present a method that takes as input a set of images of a scene illuminated by unconstrained known lighting, and produces as output a 3D representation that can be rendered from novel viewpoints under arbitrary lighting conditions. Our…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Pratul P. Srinivasan , Boyang Deng , Xiuming Zhang , Matthew Tancik , Ben Mildenhall , Jonathan T. Barron

Neural 3D scene representations have shown great potential for 3D reconstruction from 2D images. However, reconstructing real-world captures of complex scenes still remains a challenge. Existing generic 3D reconstruction methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Fangjinhua Wang , Marie-Julie Rakotosaona , Michael Niemeyer , Richard Szeliski , Marc Pollefeys , Federico Tombari