English
Related papers

Related papers: Material Transforms from Disentangled NeRF Represe…

200 papers

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

The ability of neural radiance fields or NeRFs to conduct accurate 3D modelling has motivated application of the technique to scene representation. Previous approaches have mainly followed a centralised learning paradigm, which assumes that…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Lachlan Holden , Feras Dayoub , David Harvey , Tat-Jun Chin

Neural Radiance Fields (NeRF) have achieved remarkable results in novel view synthesis, typically using sRGB images for supervision. However, little attention has been paid to the color space in which the network is learning the radiance…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Sihe Chen , Luv Verma , Bruce A. Maxwell

Neural radiance fields (NeRF) has gained significant attention for its exceptional visual effects. However, most existing NeRF methods reconstruct 3D scenes from RGB images captured by visible light cameras. In practical scenarios like…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Chonghao Zhong , Chao Xu

In recent years, the field of implicit neural representation has progressed significantly. Models such as neural radiance fields (NeRF), which uses relatively small neural networks, can represent high-quality scenes and achieve…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 David Dadon , Ohad Fried , Yacov Hel-Or

Reasoning the 3D structure of a non-rigid dynamic scene from a single moving camera is an under-constrained problem. Inspired by the remarkable progress of neural radiance fields (NeRFs) in photo-realistic novel view synthesis of static…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Sameera Ramasinghe , Violetta Shevchenko , Gil Avraham , Anton Van Den Hengel

Implicit neural representations have shown powerful capacity in modeling real-world 3D scenes, offering superior performance in novel view synthesis. In this paper, we target a more challenging scenario, i.e., joint scene novel view…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Yuxin Wang , Wayne Wu , Dan Xu

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

We learn a latent space for easy capture, consistent interpolation, and efficient reproduction of visual material appearance. When users provide a photo of a stationary natural material captured under flashlight illumination, first it is…

Graphics · Computer Science 2021-09-13 Philipp Henzler , Valentin Deschaintre , Niloy J. Mitra , Tobias Ritschel

We propose a novel compact and efficient neural BRDF offering highly versatile material representation, yet with very-light memory and neural computation consumption towards achieving real-time rendering. The results in Figure 1, rendered…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Yishun Dou , Zhong Zheng , Qiaoqiao Jin , Bingbing Ni , Yugang Chen , Junxiang Ke

Traditional physically-based material models rely on analytically derived bidirectional reflectance distribution functions (BRDFs), typically by considering statistics of micro-primitives such as facets, flakes, or spheres, sometimes…

Graphics · Computer Science 2026-05-07 Zixuan Li , Zixiong Wang , Jian Yang , Miloš Hašan , Beibei Wang

We present a neural rendering-based method called NeRO for reconstructing the geometry and the BRDF of reflective objects from multiview images captured in an unknown environment. Multiview reconstruction of reflective objects is extremely…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Yuan Liu , Peng Wang , Cheng Lin , Xiaoxiao Long , Jiepeng Wang , Lingjie Liu , Taku Komura , Wenping Wang

We propose X-NeRF, a novel method to learn a Cross-Spectral scene representation given images captured from cameras with different light spectrum sensitivity, based on the Neural Radiance Fields formulation. X-NeRF optimizes camera poses…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Matteo Poggi , Pierluigi Zama Ramirez , Fabio Tosi , Samuele Salti , Stefano Mattoccia , Luigi Di Stefano

Neural Radiance Field (NeRF) is a popular method in representing 3D scenes by optimising a continuous volumetric scene function. Its large success which lies in applying volumetric rendering (VR) is also its Achilles' heel in producing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Zhe Jun Tang , Tat-Jen Cham , Haiyu Zhao

3D reconstruction technology generates three-dimensional representations of real-world objects, scenes, or environments using sensor data such as 2D images, with extensive applications in robotics, autonomous vehicles, and virtual reality…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hong Zhang , Fei Guo , Zihan Xie , Dizhao Yao

Neural Radiance Fields (NeRF) have received considerable attention recently, due to its impressive capability in photo-realistic 3D reconstruction and novel view synthesis, given a set of posed camera images. Earlier work usually assumes…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Peng Wang , Lingzhe Zhao , Ruijie Ma , Peidong Liu

Neural radiance fields (NeRFs) enable novel view synthesis with unprecedented visual quality. However, to render photorealistic images, NeRFs require hundreds of deep multilayer perceptron (MLP) evaluations - for each pixel. This is…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Ziyu Wan , Christian Richardt , Aljaž Božič , Chao Li , Vijay Rengarajan , Seonghyeon Nam , Xiaoyu Xiang , Tuotuo Li , Bo Zhu , Rakesh Ranjan , Jing Liao

Radiance fields have gradually become a main representation of media. Although its appearance editing has been studied, how to achieve view-consistent recoloring in an efficient manner is still under explored. We present RecolorNeRF, a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Bingchen Gong , Yuehao Wang , Xiaoguang Han , Qi Dou

We present a method for transferring the artistic features of an arbitrary style image to a 3D scene. Previous methods that perform 3D stylization on point clouds or meshes are sensitive to geometric reconstruction errors for complex…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Kai Zhang , Nick Kolkin , Sai Bi , Fujun Luan , Zexiang Xu , Eli Shechtman , Noah Snavely

Bidirectional reflectance distribution functions (BRDFs) are pervasively used in computer graphics to produce realistic physically-based appearance. In recent years, several works explored using neural networks to represent BRDFs, taking…

Graphics · Computer Science 2021-11-16 Jiahui Fan , Beibei Wang , Miloš Hašan , Jian Yang , Ling-Qi Yan