中文
相关论文

相关论文: Monocular Reconstruction of Neural Face Reflectanc…

200 篇论文

Neural implicit surface learning has shown significant progress in multi-view 3D reconstruction, where an object is represented by multilayer perceptrons that provide continuous implicit surface representation and view-dependent radiance.…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Wenhang Ge , Tao Hu , Haoyu Zhao , Shu Liu , Ying-Cong Chen

Existing neural reconstruction schemes such as Neural Radiance Field (NeRF) are largely focused on modeling opaque objects. We present a novel neural refractive field(NeReF) to recover wavefront of transparent fluids by simultaneously…

计算机视觉与模式识别 · 计算机科学 2022-03-09 Ziyu Wang , Wei Yang , Junming Cao , Lan Xu , Junqing Yu , Jingyi Yu

While neural radiance fields (NeRF) led to a breakthrough in photorealistic novel view synthesis, handling mirroring surfaces still denotes a particular challenge as they introduce severe inconsistencies in the scene representation.…

计算机视觉与模式识别 · 计算机科学 2025-01-09 Leif Van Holland , Michael Weinmann , Jan U. Müller , Patrick Stotko , Reinhard Klein

Neural Radiance Fields (NeRF) often struggle with reconstructing and rendering highly reflective scenes. Recent advancements have developed various reflection-aware appearance models to enhance NeRF's capability to render specular…

计算机视觉与模式识别 · 计算机科学 2025-01-17 Ji Shi , Xianghua Ying , Ruohao Guo , Bowei Xing , Wenzhen Yue

We present a method for estimating detailed scene illumination using human faces in a single image. In contrast to previous works that estimate lighting in terms of low-order basis functions or distant point lights, our technique estimates…

计算机视觉与模式识别 · 计算机科学 2018-07-24 Renjiao Yi , Chenyang Zhu , Ping Tan , Stephen Lin

A fundamental problem in computer vision is that of inferring the intrinsic, 3D structure of the world from flat, 2D images of that world. Traditional methods for recovering scene properties such as shape, reflectance, or illumination rely…

计算机视觉与模式识别 · 计算机科学 2020-10-09 Jonathan T. Barron , Jitendra Malik

Neural networks have shown great success in extracting geometric information from color images. Especially, monocular depth estimation networks are increasingly reliable in real-world scenes. In this work we investigate the applicability of…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Dominik Engel , Sebastian Hartwig , Timo Ropinski

We present a learning-based method for estimating 4D reflectance field of a person given video footage illuminated under a flat-lit environment of the same subject. For training data, we use one light at a time to illuminate the subject and…

计算机视觉与模式识别 · 计算机科学 2021-04-08 Loc Huynh , Bipin Kishore , Paul Debevec

Monocular depth estimation, enabled by self-supervised learning, is a key technique for 3D perception in computer vision. However, it faces significant challenges in real-world scenarios, which encompass adverse weather variations, motion…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Runze Chen , Haiyong Luo , Fang Zhao , Jingze Yu , Yupeng Jia , Juan Wang , Xuepeng Ma

The task of extracting intrinsic components, such as reflectance and shading, from neural radiance fields is of growing interest. However, current methods largely focus on synthetic scenes and isolated objects, overlooking the complexities…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Yixiong Yang , Shilin Hu , Haoyu Wu , Ramon Baldrich , Dimitris Samaras , Maria Vanrell

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D reconstruction, but bake…

计算机视觉与模式识别 · 计算机科学 2023-04-07 Zian Wang , Tianchang Shen , Jun Gao , Shengyu Huang , Jacob Munkberg , Jon Hasselgren , Zan Gojcic , Wenzheng Chen , Sanja Fidler

In this work, we propose an inverse rendering model that estimates 3D shape, spatially-varying reflectance, homogeneous subsurface scattering parameters, and an environment illumination jointly from only a pair of captured images of a…

计算机视觉与模式识别 · 计算机科学 2023-05-16 Chenhao Li , Trung Thanh Ngo , Hajime Nagahara

Uncalibrated photometric stereo (UPS) is challenging due to the inherent ambiguity brought by unknown light. Existing solutions alleviate the ambiguity by either explicitly associating reflectance to light conditions or resolving light…

计算机视觉与模式识别 · 计算机科学 2022-08-22 Zongrui Li , Qian Zheng , Feishi Wang , Boxin Shi , Gang Pan , Xudong Jiang

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

Decomposing a scene into its shape, reflectance and illumination is a fundamental problem in computer vision and graphics. Neural approaches such as NeRF have achieved remarkable success in view synthesis, but do not explicitly perform…

计算机视觉与模式识别 · 计算机科学 2021-10-28 Mark Boss , Varun Jampani , Raphael Braun , Ce Liu , Jonathan T. Barron , Hendrik P. A. Lensch

Inferring a meaningful geometric scene representation from a single image is a fundamental problem in computer vision. Approaches based on traditional depth map prediction can only reason about areas that are visible in the image.…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Felix Wimbauer , Nan Yang , Christian Rupprecht , Daniel Cremers

We present a method for learning a generative 3D model based on neural radiance fields, trained solely from data with only single views of each object. While generating realistic images is no longer a difficult task, producing the…

计算机视觉与模式识别 · 计算机科学 2022-04-27 Daniel Rebain , Mark Matthews , Kwang Moo Yi , Dmitry Lagun , Andrea Tagliasacchi

Inverse rendering aims to reconstruct the scene properties of objects solely from multiview images. However, it is an ill-posed problem prone to producing ambiguous estimations deviating from physically accurate representations. In this…

计算机视觉与模式识别 · 计算机科学 2024-04-22 Georgios Kouros , Minye Wu , Sushruth Nagesh , Xianling Zhang , Tinne Tuytelaars

Neural radiance fields have achieved remarkable performance in modeling the appearance of 3D scenes. However, existing approaches still struggle with the view-dependent appearance of glossy surfaces, especially under complex lighting of…

计算机视觉与模式识别 · 计算机科学 2024-05-17 Li Ma , Vasu Agrawal , Haithem Turki , Changil Kim , Chen Gao , Pedro Sander , Michael Zollhöfer , Christian Richardt

Neural Radiance Fields (NeRFs) provide a high fidelity, continuous scene representation that can realistically represent complex behaviour of light. Despite works like Ref-NeRF improving geometry through physics-inspired models, the ability…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Jack Naylor , Viorela Ila , Donald G. Dansereau