English
Related papers

Related papers: Invertible Neural BRDF for Object Inverse Renderin…

200 papers

This paper presents an uncalibrated deep neural network framework for the photometric stereo problem. For training models to solve the problem, existing neural network-based methods either require exact light directions or ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Berk Kaya , Suryansh Kumar , Carlos Oliveira , Vittorio Ferrari , Luc Van Gool

This paper addresses the problem of estimating the shape of objects that exhibit spatially-varying reflectance. We assume that multiple images of the object are obtained under a fixed view-point and varying illumination, i.e., the setting…

Computer Vision and Pattern Recognition · Computer Science 2016-09-22 Zhuo Hui , Aswin C Sankaranarayanan

Recent advances in neural rendering have shown great potential for reconstructing scenes from multiview images. However, accurately representing objects with glossy surfaces remains a challenge for existing methods. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Ruofan Liang , Huiting Chen , Chunlin Li , Fan Chen , Selvakumar Panneer , Nandita Vijaykumar

Traditional multi-view photometric stereo (MVPS) methods are often composed of multiple disjoint stages, resulting in noticeable accumulated errors. In this paper, we present a neural inverse rendering method for MVPS based on implicit…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Wenqi Yang , Guanying Chen , Chaofeng Chen , Zhenfang Chen , Kwan-Yee K. Wong

We present a neural rendering-based method called NeRO for reconstructing the geometry and the BRDF of reflective objects from multiview images captured in an unknown environment. Multiview reconstruction of reflective objects is extremely…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Yuan Liu , Peng Wang , Cheng Lin , Xiaoxiao Long , Jiepeng Wang , Lingjie Liu , Taku Komura , Wenping Wang

Neural radiance fields (NeRF) have gained prominence as a machine learning technique for representing 3D scenes and estimating the bidirectional reflectance distribution function (BRDF) from multiple images. However, most existing research…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Lulin Zhang , Ewelina Rupnik , Tri Dung Nguyen , Stéphane Jacquemoud , Yann Klinger

Physically-based rendering (PBR) is key for immersive rendering effects used widely in the industry to showcase detailed realistic scenes from computer graphics assets. A well-known caveat is that producing the same is computationally heavy…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Jing Yang , Hanyuan Xiao , Wenbin Teng , Yunxuan Cai , Yajie Zhao

Artistic authoring of 3D environments is a laborious enterprise that also requires skilled content creators. There have been impressive improvements in using machine learning to address different aspects of generating 3D content, such as…

Graphics · Computer Science 2023-09-15 Sean Memery , Osmar Cedron , Kartic Subr

In this paper, we propose a novel end-to-end relightable neural inverse rendering system that achieves high-quality reconstruction of geometry and material properties, thus enabling high-quality relighting. The cornerstone of our method is…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Deheng Zhang , Jingyu Wang , Shaofei Wang , Marko Mihajlovic , Sergey Prokudin , Hendrik P. A. Lensch , Siyu Tang

Estimating surface reflectance (BRDF) is one key component for complete 3D scene capture, with wide applications in virtual reality, augmented reality, and human computer interaction. Prior work is either limited to controlled environments…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Kihwan Kim , Jinwei Gu , Stephen Tyree , Pavlo Molchanov , Matthias Nießner , Jan Kautz

We propose a neural inverse rendering approach that jointly reconstructs geometry, spatially varying reflectance, and lighting conditions from multi-view images captured under varying directional lighting. Unlike prior multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Xu Cao , Takafumi Taketomi

In this paper, we first propose a novel method for transferring material transformations across different scenes. Building on disentangled Neural Radiance Field (NeRF) representations, our approach learns to map Bidirectional Reflectance…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Ivan Lopes , Jean-François Lalonde , Raoul de Charette

Acquiring bidirectional reflectance distribution functions (BRDFs) is essential for simulating light transport and analytically modeling material properties. Over the past two decades, numerous intensity-only BRDF datasets in the visible…

Graphics · Computer Science 2025-09-18 Yunseong Moon , Ryota Maeda , Suhyun Shin , Inseung Hwang , Youngchan Kim , Min H. Kim , Seung-Hwan Baek

Efficient and accurate measurement of the bi-directional reflectance distribution function (BRDF) plays a key role in high quality image rendering and physically accurate sensor simulation. However, obtaining the reflectance properties of a…

Graphics · Computer Science 2025-03-18 Wen Cao

We introduce a novel learning-based method to reconstruct the high-quality geometry and complex, spatially-varying BRDF of an arbitrary object from a sparse set of only six images captured by wide-baseline cameras under collocated point…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Sai Bi , Zexiang Xu , Kalyan Sunkavalli , David Kriegman , Ravi Ramamoorthi

We present a physics-based inverse rendering method that learns the illumination, geometry, and materials of a scene from posed multi-view RGB images. To model the illumination of a scene, existing inverse rendering works either completely…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Youming Deng , Xueting Li , Sifei Liu , Ming-Hsuan Yang

Characterizing the appearance of real-world surfaces is a fundamental problem in multidimensional reflectometry, computer vision and computer graphics. For many applications, appearance is sufficiently well characterized by the…

Machine Learning · Statistics 2019-04-09 Mikhail A. Langovoy

We propose a material appearance modeling neural network for visualizing plausible, spatially-varying materials under diverse view and lighting conditions, utilizing only a single photograph of a material under co-located light and view as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Jay Idema , Pieter Peers

Inverse rendering aims at recovering both geometry and materials of objects. It provides a more compatible reconstruction for conventional rendering engines, compared with the neural radiance fields (NeRFs). On the other hand, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Haoyuan Wang , Wenbo Hu , Lei Zhu , Rynson W. H. Lau

We present a scheme for fast environment light estimation from the RGBD appearance of individual objects and their local image areas. Conventional inverse rendering is too computationally demanding for real-time applications, and the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Xin Wei , Guojun Chen , Yue Dong , Stephen Lin , Xin Tong