English
Related papers

Related papers: A Real-time Method for Inserting Virtual Objects i…

200 papers

We present a scheme for fast environment light estimation from the RGBD appearance of individual objects and their local image areas. Conventional inverse rendering is too computationally demanding for real-time applications, and the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Xin Wei , Guojun Chen , Yue Dong , Stephen Lin , Xin Tong

We present a method that takes as input a set of images of a scene illuminated by unconstrained known lighting, and produces as output a 3D representation that can be rendered from novel viewpoints under arbitrary lighting conditions. Our…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Pratul P. Srinivasan , Boyang Deng , Xiuming Zhang , Matthew Tancik , Ben Mildenhall , Jonathan T. Barron

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

While the use of neural radiance fields (NeRFs) in different challenging settings has been explored, only very recently have there been any contributions that focus on the use of NeRF in foggy environments. We argue that the traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Andreas L. Teigen , Mauhing Yip , Victor P. Hamran , Vegard Skui , Annette Stahl , Rudolf Mester

Beyond novel view synthesis, Neural Radiance Fields are useful for applications that interact with the real world. In this paper, we use them as an implicit map of a given scene and propose a camera relocalization algorithm tailored for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Arthur Moreau , Nathan Piasco , Moussab Bennehar , Dzmitry Tsishkou , Bogdan Stanciulescu , Arnaud de La Fortelle

We present a novel approach for synthesizing realistic novel views using Neural Radiance Fields (NeRF) with uncontrolled photos in the wild. While NeRF has shown impressive results in controlled settings, it struggles with transient objects…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Shuaixian Wang , Haoran Xu , Yaokun Li , Jiwei Chen , Guang Tan

With the advent of Neural Radiance Fields (NeRF), neural networks can now render novel views of a 3D scene with quality that fools the human eye. Yet, generating these images is very computationally intensive, limiting their applicability…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Daniel Rebain , Wei Jiang , Soroosh Yazdani , Ke Li , Kwang Moo Yi , Andrea Tagliasacchi

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

Recent advances in implicit neural representation have demonstrated the ability to recover detailed geometry and material from multi-view images. However, the use of simplified lighting models such as environment maps to represent…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yiyu Zhuang , Qi Zhang , Xuan Wang , Hao Zhu , Ying Feng , Xiaoyu Li , Ying Shan , Xun Cao

Although there has been significant progress in neural radiance fields, an issue on dynamic illumination changes still remains unsolved. Different from relevant works that parameterize time-variant/-invariant components in scenes, subjects'…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Changyeon Won , Hyunjun Jung , Jungu Cho , Seonmi Park , Chi-Hoon Lee , Hae-Gon Jeon

Neural Radiance Fields (NeRF) has been wildly applied to various tasks for its high-quality representation of 3D scenes. It takes long per-scene training time and per-image testing time. In this paper, we present EfficientNeRF as an…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Tao Hu , Shu Liu , Yilun Chen , Tiancheng Shen , Jiaya Jia

Neural scene representations, such as Neural Radiance Fields (NeRF), are based on training a multilayer perceptron (MLP) using a set of color images with known poses. An increasing number of devices now produce RGB-D(color + depth)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Arnab Dey , Yassine Ahmine , Andrew I. Comport

Neural Radiance Fields (NeRF) has recently gained popularity for its impressive novel view synthesis ability. This paper studies the problem of hallucinated NeRF: i.e., recovering a realistic NeRF at a different time of day from a group of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Xingyu Chen , Qi Zhang , Xiaoyu Li , Yue Chen , Ying Feng , Xuan Wang , Jue Wang

This paper proposes a novel approach for rendering a pre-trained Neural Radiance Field (NeRF) in real-time on resource-constrained devices. We introduce Re-ReND, a method enabling Real-time Rendering of NeRFs across Devices. Re-ReND is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sara Rojas , Jesus Zarzar , Juan Camilo Perez , Artsiom Sanakoyeu , Ali Thabet , Albert Pumarola , Bernard Ghanem

Neural Radiance Fields (NeRFs) have shown remarkable success in synthesizing photorealistic views from multi-view images of static scenes, but face challenges in dynamic, real-world environments with distractors like moving objects,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Weining Ren , Zihan Zhu , Boyang Sun , Jiaqi Chen , Marc Pollefeys , Songyou Peng

We present Neural Articulated Radiance Field (NARF), a novel deformable 3D representation for articulated objects learned from images. While recent advances in 3D implicit representation have made it possible to learn models of complex…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Atsuhiro Noguchi , Xiao Sun , Stephen Lin , Tatsuya Harada

Neural Radiance Fields (NeRFs) have recently emerged as a popular option for photo-realistic object capture due to their ability to faithfully capture high-fidelity volumetric content even from handheld video input. Although much research…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Binglun Wang , Niladri Shekhar Dutt , Niloy J. Mitra

Recently, Neural Radiance Fields (NeRF) has exhibited significant success in novel view synthesis, surface reconstruction, etc. However, since no physical reflection is considered in its rendering pipeline, NeRF mistakes the reflection in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Junyi Zeng , Chong Bao , Rui Chen , Zilong Dong , Guofeng Zhang , Hujun Bao , Zhaopeng Cui

Neural Radiance Field (NeRF) is a popular method in representing 3D scenes by optimising a continuous volumetric scene function. Its large success which lies in applying volumetric rendering (VR) is also its Achilles' heel in producing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Zhe Jun Tang , Tat-Jen Cham , Haiyu Zhao

Neural Radiance Field (NeRF) and its variants have exhibited great success on representing 3D scenes and synthesizing photo-realistic novel views. However, they are generally based on the pinhole camera model and assume all-in-focus inputs.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Zijin Wu , Xingyi Li , Juewen Peng , Hao Lu , Zhiguo Cao , Weicai Zhong