English
Related papers

Related papers: NeMF: Inverse Volume Rendering with Neural Microfl…

200 papers

Neural Radiance Field (NeRF) is a popular method in representing 3D scenes by optimising a continuous volumetric scene function. Its large success which lies in applying volumetric rendering (VR) is also its Achilles' heel in producing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Zhe Jun Tang , Tat-Jen Cham , Haiyu Zhao

Neural implicit fields have established a new paradigm for scene representation, with subsequent work achieving high-quality real-time rendering. However, reconstructing 3D scenes from oblique aerial photography presents unique challenges,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Xiaoyi Zeng , Kaiwen Song , Leyuan Yang , Bailin Deng , Juyong Zhang

Implicit neural representation has opened up new possibilities for inverse rendering. However, existing implicit neural inverse rendering methods struggle to handle strongly illuminated scenes with significant shadows and indirect…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Ziyi Yang , Yanzhen Chen , Xinyu Gao , Yazhen Yuan , Yu Wu , Xiaowei Zhou , Xiaogang Jin

Recent neural rendering methods have demonstrated accurate view interpolation by predicting volumetric density and color with a neural network. Although such volumetric representations can be supervised on static and dynamic scenes,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Julian Knodt , Joe Bartusek , Seung-Hwan Baek , Felix Heide

Implicit neural rendering, especially Neural Radiance Field (NeRF), has shown great potential in novel view synthesis of a scene. However, current NeRF-based methods cannot enable users to perform user-controlled shape deformation in the…

Graphics · Computer Science 2022-05-11 Yu-Jie Yuan , Yang-Tian Sun , Yu-Kun Lai , Yuewen Ma , Rongfei Jia , Lin Gao

We introduce Neural Point Light Fields that represent scenes implicitly with a light field living on a sparse point cloud. Combining differentiable volume rendering with learned implicit density representations has made it possible to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Julian Ost , Issam Laradji , Alejandro Newell , Yuval Bahat , Felix Heide

Recently, differentiable volume rendering in neural radiance fields (NeRF) has gained a lot of popularity, and its variants have attained many impressive results. However, existing methods usually assume the scene is a homogeneous volume so…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jen-I Pan , Jheng-Wei Su , Kai-Wen Hsiao , Ting-Yu Yen , Hung-Kuo Chu

Inferring a meaningful geometric scene representation from a single image is a fundamental problem in computer vision. Approaches based on traditional depth map prediction can only reason about areas that are visible in the image.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Felix Wimbauer , Nan Yang , Christian Rupprecht , Daniel Cremers

Photo-realistic free-viewpoint rendering of real-world scenes using classical computer graphics techniques is challenging, because it requires the difficult step of capturing detailed appearance and geometry models. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Lingjie Liu , Jiatao Gu , Kyaw Zaw Lin , Tat-Seng Chua , Christian Theobalt

Neural implicit representation of visual scenes has attracted a lot of attention in recent research of computer vision and graphics. Most prior methods focus on how to reconstruct 3D scene representation from a set of images. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Wenpu Li , Pian Wan , Peng Wang , Jinghang Li , Yi Zhou , Peidong Liu

In recent years, Neural Radiance Fields (NeRFs) have demonstrated significant potential in encoding highly-detailed 3D geometry and environmental appearance, positioning themselves as a promising alternative to traditional explicit…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Tianxiang Ye , Qi Wu , Junyuan Deng , Guoqing Liu , Liu Liu , Songpengcheng Xia , Liang Pang , Wenxian Yu , Ling Pei

We propose a neural inverse rendering approach that jointly reconstructs geometry, spatially varying reflectance, and lighting conditions from multi-view images captured under varying directional lighting. Unlike prior multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Xu Cao , Takafumi Taketomi

Existing methods for relightable view synthesis -- using a set of images of an object under unknown lighting to recover a 3D representation that can be rendered from novel viewpoints under a target illumination -- are based on inverse…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Xiaoming Zhao , Pratul P. Srinivasan , Dor Verbin , Keunhong Park , Ricardo Martin Brualla , Philipp Henzler

We present a method that takes as input a set of images of a scene illuminated by unconstrained known lighting, and produces as output a 3D representation that can be rendered from novel viewpoints under arbitrary lighting conditions. Our…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Pratul P. Srinivasan , Boyang Deng , Xiuming Zhang , Matthew Tancik , Ben Mildenhall , Jonathan T. Barron

We present a novel method, called NeTO, for capturing 3D geometry of solid transparent objects from 2D images via volume rendering. Reconstructing transparent objects is a very challenging task, which is ill-suited for general-purpose…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Zongcheng Li , Xiaoxiao Long , Yusen Wang , Tuo Cao , Wenping Wang , Fei Luo , Chunxia Xiao

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

We present a novel differentiable rendering framework for joint geometry, material, and lighting estimation from multi-view images. In contrast to previous methods which assume a simplified environment map or co-located flashlights, in this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Jingyang Zhang , Yao Yao , Shiwei Li , Jingbo Liu , Tian Fang , David McKinnon , Yanghai Tsin , Long Quan

Multi-view shape reconstruction has achieved impressive progresses thanks to the latest advances in neural implicit surface rendering. However, existing methods based on signed distance function (SDF) are limited to closed surfaces, failing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yu-Tao Liu , Li Wang , Jie yang , Weikai Chen , Xiaoxu Meng , Bo Yang , Lin Gao

A variety of Neural Radiance Fields (NeRF) methods have recently achieved remarkable success in high render speed. However, current accelerating methods are specialized and incompatible with various implicit methods, preventing real-time…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Xinyu Gao , Ziyi Yang , Yunlu Zhao , Yuxiang Sun , Xiaogang Jin , Changqing Zou