English
Related papers

Related papers: Invertible Neural BRDF for Object Inverse Renderin…

200 papers

This paper presents a unified surface reconstruction and rendering framework for LiDAR-visual systems, integrating Neural Radiance Fields (NeRF) and Neural Distance Fields (NDF) to recover both appearance and structural information from…

Robotics · Computer Science 2024-09-10 Jianheng Liu , Chunran Zheng , Yunfei Wan , Bowen Wang , Yixi Cai , Fu Zhang

NeRF-based techniques fit wide and deep multi-layer perceptrons (MLPs) to a continuous radiance field that can be rendered from any unseen viewpoint. However, the lack of surface and normals definition and high rendering times limit their…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Stefano Esposito , Daniele Baieri , Stefan Zellmann , André Hinkenjann , Emanuele Rodolà

Inverse rendering, the process of inferring scene properties from images, is a challenging inverse problem. The task is ill-posed, as many different scene configurations can give rise to the same image. Most existing solutions incorporate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Linjie Lyu , Ayush Tewari , Marc Habermann , Shunsuke Saito , Michael Zollhöfer , Thomas Leimkühler , Christian Theobalt

In modern computer vision, the optimal representation of 3D shape continues to be task-dependent. One fundamental operation applied to such representations is differentiable rendering, as it enables inverse graphics approaches in learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Tristan Aumentado-Armstrong , Stavros Tsogkas , Sven Dickinson , Allan Jepson

Relying on either deep models or physical models are two mainstream approaches for solving inverse sample reconstruction problems in programmable illumination computational microscopy. Solutions based on physical models possess strong…

Image and Video Processing · Electrical Eng. & Systems 2024-03-21 Ruiqing Sun , Delong Yang , Shaohui Zhang , Qun Hao

In this work, we propose a CNN-based approach to estimate the spectral reflectance of a surface and the spectral power distribution of the light from a single RGB image of a V-shaped surface. Interreflections happening in a concave surface…

Computer Vision and Pattern Recognition · Computer Science 2019-01-30 Rada Deeb , Joost Van De Weijer , Damien Muselet , Mathieu Hebert , Alain Tremeau

In recent years, the field of implicit neural representation has progressed significantly. Models such as neural radiance fields (NeRF), which uses relatively small neural networks, can represent high-quality scenes and achieve…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 David Dadon , Ohad Fried , Yacov Hel-Or

We present a novel method for efficient acquisition of shape and spatially varying reflectance of 3D objects using polarization cues. Unlike previous works that have exploited polarization to estimate material or object appearance under…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Valentin Deschaintre , Yiming Lin , Abhijeet Ghosh

We present a simple algorithm for differentiable rendering of surfaces represented by Signed Distance Fields (SDF), which makes it easy to integrate rendering into gradient-based optimization pipelines. To tackle visibility-related…

Graphics · Computer Science 2024-06-10 Zichen Wang , Xi Deng , Ziyi Zhang , Wenzel Jakob , Steve Marschner

This paper proposes a novel neural-network-based adaptive hybrid-reflectance three-dimensional (3-D) surface reconstruction model. The neural network combines the diffuse and specular components into a hybrid model. The proposed model…

Neural and Evolutionary Computing · Computer Science 2009-12-14 Vincy Joseph , Shalini Bhatia

Recent advances in neural rendering have achieved impressive results on photorealistic shading and relighting, by using a multilayer perceptron (MLP) as a regression model to learn the rendering equation from a real-world dataset. Such…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Zhuo He , Yingdong Ru , Qianying Liu , Paul Henderson , Nicolas Pugeault

We present a novel method of simulating wave effects in graphics using ray--based renderers with a new function: the Wave BSDF (Bidirectional Scattering Distribution Function). Reflections from neighboring surface patches represented by…

Graphics · Computer Science 2011-01-31 Tom Cuypers , Se Baek Oh , Tom Haber , Philippe Bekaert , Ramesh Raskar

Inverse rendering aims to reconstruct the scene properties of objects solely from multiview images. However, it is an ill-posed problem prone to producing ambiguous estimations deviating from physically accurate representations. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Georgios Kouros , Minye Wu , Sushruth Nagesh , Xianling Zhang , Tinne Tuytelaars

Photorealistic object appearance modeling from 2D images is a constant topic in vision and graphics. While neural implicit methods (such as Neural Radiance Fields) have shown high-fidelity view synthesis results, they cannot relight the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Hong-Xing Yu , Michelle Guo , Alireza Fathi , Yen-Yu Chang , Eric Ryan Chan , Ruohan Gao , Thomas Funkhouser , Jiajun Wu

Neural signed distance functions (SDFs) are emerging as an effective representation for 3D shapes. State-of-the-art methods typically encode the SDF with a large, fixed-size neural network to approximate complex shapes with implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Towaki Takikawa , Joey Litalien , Kangxue Yin , Karsten Kreis , Charles Loop , Derek Nowrouzezahrai , Alec Jacobson , Morgan McGuire , Sanja Fidler

We present the first system for physically based, neural inverse rendering from multi-viewpoint videos of propagating light. Our approach relies on a time-resolved extension of neural radiance caching -- a technique that accelerates inverse…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Anagh Malik , Benjamin Attal , Andrew Xie , Matthew O'Toole , David B. Lindell

Recovering the physical attributes of an object's appearance from its images captured under an unknown illumination is challenging yet essential for photo-realistic rendering. Recent approaches adopt the emerging implicit scene…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Youjia Zhang , Teng Xu , Junqing Yu , Yuteng Ye , Junle Wang , Yanqing Jing , Jingyi Yu , Wei Yang

Inverse rendering methods aim to estimate geometry, materials and illumination from multi-view RGB images. In order to achieve better decomposition, recent approaches attempt to model indirect illuminations reflected from different…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Haoqian Wu , Zhipeng Hu , Lincheng Li , Yongqiang Zhang , Changjie Fan , Xin Yu

We propose TensoIR, a novel inverse rendering approach based on tensor factorization and neural fields. Unlike previous works that use purely MLP-based neural fields, thus suffering from low capacity and high computation costs, we extend…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Haian Jin , Isabella Liu , Peijia Xu , Xiaoshuai Zhang , Songfang Han , Sai Bi , Xiaowei Zhou , Zexiang Xu , Hao Su

Neural implicit surface reconstruction using volume rendering techniques has recently achieved significant advancements in creating high-fidelity surfaces from multiple 2D images. However, current methods primarily target scenes with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Lintao Xiang , Hongpei Zheng , Bailin Deng , Hujun Yin