中文
相关论文

相关论文: NeRFactor: Neural Factorization of Shape and Refle…

200 篇论文

Thin, reflective objects such as forks and whisks are common in our daily lives, but they are particularly challenging for robot perception because it is hard to reconstruct them using commodity RGB-D cameras or multi-view stereo…

机器人学 · 计算机科学 2022-04-28 Lin Yen-Chen , Pete Florence , Jonathan T. Barron , Tsung-Yi Lin , Alberto Rodriguez , Phillip Isola

Existing inverse rendering combined with neural rendering methods can only perform editable novel view synthesis on object-specific scenes, while we present intrinsic neural radiance fields, dubbed IntrinsicNeRF, which introduce intrinsic…

计算机视觉与模式识别 · 计算机科学 2023-08-30 Weicai Ye , Shuo Chen , Chong Bao , Hujun Bao , Marc Pollefeys , Zhaopeng Cui , Guofeng Zhang

We propose TensoIR, a novel inverse rendering approach based on tensor factorization and neural fields. Unlike previous works that use purely MLP-based neural fields, thus suffering from low capacity and high computation costs, we extend…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Haian Jin , Isabella Liu , Peijia Xu , Xiaoshuai Zhang , Songfang Han , Sai Bi , Xiaowei Zhou , Zexiang Xu , Hao Su

We present a method for the accurate 3D reconstruction of partly-symmetric objects. We build on the strengths of recent advances in neural reconstruction and rendering such as Neural Radiance Fields (NeRF). A major shortcoming of such…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Eldar Insafutdinov , Dylan Campbell , João F. Henriques , Andrea Vedaldi

We present a novel convolutional neural network architecture for photometric stereo (Woodham, 1980), a problem of recovering 3D object surface normals from multiple images observed under varying illuminations. Despite its long history in…

计算机视觉与模式识别 · 计算机科学 2018-05-30 Tatsunori Taniai , Takanori Maehara

Photorealistic object appearance modeling from 2D images is a constant topic in vision and graphics. While neural implicit methods (such as Neural Radiance Fields) have shown high-fidelity view synthesis results, they cannot relight the…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Hong-Xing Yu , Michelle Guo , Alireza Fathi , Yen-Yu Chang , Eric Ryan Chan , Ruohan Gao , Thomas Funkhouser , Jiajun Wu

Existing methods for relightable view synthesis -- using a set of images of an object under unknown lighting to recover a 3D representation that can be rendered from novel viewpoints under a target illumination -- are based on inverse…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Xiaoming Zhao , Pratul P. Srinivasan , Dor Verbin , Keunhong Park , Ricardo Martin Brualla , Philipp Henzler

This paper proposes a novel approach for rendering a pre-trained Neural Radiance Field (NeRF) in real-time on resource-constrained devices. We introduce Re-ReND, a method enabling Real-time Rendering of NeRFs across Devices. Re-ReND is…

计算机视觉与模式识别 · 计算机科学 2023-03-16 Sara Rojas , Jesus Zarzar , Juan Camilo Perez , Artsiom Sanakoyeu , Ali Thabet , Albert Pumarola , Bernard Ghanem

Recovering the physical attributes of an object's appearance from its images captured under an unknown illumination is challenging yet essential for photo-realistic rendering. Recent approaches adopt the emerging implicit scene…

计算机视觉与模式识别 · 计算机科学 2023-04-05 Youjia Zhang , Teng Xu , Junqing Yu , Yuteng Ye , Junle Wang , Yanqing Jing , Jingyi Yu , Wei Yang

Decomposing a scene into its shape, reflectance and illumination is a fundamental problem in computer vision and graphics. Neural approaches such as NeRF have achieved remarkable success in view synthesis, but do not explicitly perform…

计算机视觉与模式识别 · 计算机科学 2021-10-28 Mark Boss , Varun Jampani , Raphael Braun , Ce Liu , Jonathan T. Barron , Hendrik P. A. Lensch

Realistic face rendering from multi-view images is beneficial to various computer vision and graphics applications. Due to the complex spatially-varying reflectance properties and geometry characteristics of faces, however, it remains…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Mingwu Zheng , Haiyu Zhang , Hongyu Yang , Di Huang

Neural radiance fields (NeRF) appeared recently as a powerful tool to generate realistic views of objects and confined areas. Still, they face serious challenges with open scenes, where the camera has unrestricted movement and content can…

计算机视觉与模式识别 · 计算机科学 2023-03-23 Ahmad AlMughrabi , Umair Haroon , Ricardo Marques , Petia Radeva

Reconstructing the shape and spatially varying surface appearances of a physical-world object as well as its surrounding illumination based on 2D images (e.g., photographs) of the object has been a long-standing problem in computer vision…

计算机视觉与模式识别 · 计算机科学 2024-02-02 Cheng Sun , Guangyan Cai , Zhengqin Li , Kai Yan , Cheng Zhang , Carl Marshall , Jia-Bin Huang , Shuang Zhao , Zhao Dong

This study proposes a neural disparity field (NDF) that establishes an implicit, continuous representation of scene disparity based on a neural field and an iterative approach to address the inverse problem of NDF reconstruction from…

图像与视频处理 · 电气工程与系统科学 2025-07-01 Ligen Shi , Chang Liu , Xing Zhao , Jun Qiu

Implicit neural representation has opened up new possibilities for inverse rendering. However, existing implicit neural inverse rendering methods struggle to handle strongly illuminated scenes with significant shadows and indirect…

计算机视觉与模式识别 · 计算机科学 2023-11-22 Ziyi Yang , Yanzhen Chen , Xinyu Gao , Yazhen Yuan , Yu Wu , Xiaowei Zhou , Xiaogang Jin

NeRF is a popular model that efficiently represents 3D objects from 2D images. However, vanilla NeRF has some important limitations. NeRF must be trained on each object separately. The training time is long since we encode the object's…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Dominik Zimny , Artur Kasymov , Adam Kania , Jacek Tabor , Maciej Zięba , Marcin Mazur , Przemysław Spurek

In this paper, we first propose a novel method for transferring material transformations across different scenes. Building on disentangled Neural Radiance Field (NeRF) representations, our approach learns to map Bidirectional Reflectance…

计算机视觉与模式识别 · 计算机科学 2024-11-13 Ivan Lopes , Jean-François Lalonde , Raoul de Charette

Neural radiance fields (NeRF) have gained prominence as a machine learning technique for representing 3D scenes and estimating the bidirectional reflectance distribution function (BRDF) from multiple images. However, most existing research…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Lulin Zhang , Ewelina Rupnik , Tri Dung Nguyen , Stéphane Jacquemoud , Yann Klinger

3D reconstruction technology generates three-dimensional representations of real-world objects, scenes, or environments using sensor data such as 2D images, with extensive applications in robotics, autonomous vehicles, and virtual reality…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Hong Zhang , Fei Guo , Zihan Xie , Dizhao Yao

We introduce ROGR, a novel approach that reconstructs a relightable 3D model of an object captured from multiple views, driven by a generative relighting model that simulates the effects of placing the object under novel environment…