English
Related papers

Related papers: Real-Time Neural Light Field on Mobile Devices

200 papers

Neural Radiance Field (NeRF) has emerged as a leading technique for novel view synthesis, owing to its impressive photorealistic reconstruction and rendering capability. Nevertheless, achieving real-time NeRF rendering in large-scale scenes…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Chaojian Li , Bichen Wu , Peter Vajda , Yingyan Celine Lin

We have recently seen tremendous progress in neural rendering (NR) advances, i.e., NeRF, for photo-real free-view synthesis. Yet, as a local technique based on a single computer/GPU, even the best-engineered Instant-NGP or i-NGP cannot…

Neural Radiance Field (NeRF) is a framework that represents a 3D scene in the weights of a fully connected neural network, known as the Multi-Layer Perception(MLP). The method was introduced for the task of novel view synthesis and is able…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Mohamed Debbagh

The quality of three-dimensional reconstruction is a key factor affecting the effectiveness of its application in areas such as virtual reality (VR) and augmented reality (AR) technologies. Neural Radiance Fields (NeRF) can generate…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Qianqiu Tan , Tao Liu , Yinling Xie , Shuwan Yu , Baohua Zhang

Recent works have shown that neural radiance fields (NeRFs) on top of parametric models have reached SOTA quality to build photorealistic head avatars from a monocular video. However, one major limitation of the NeRF-based avatars is the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Huan Wang , Feitong Tan , Ziqian Bai , Yinda Zhang , Shichen Liu , Qiangeng Xu , Menglei Chai , Anish Prabhu , Rohit Pandey , Sean Fanello , Zeng Huang , Yun Fu

Recent advances in Neural Radiance Fields (NeRF) have demonstrated significant potential for representing 3D scene appearances as implicit neural networks, enabling the synthesis of high-fidelity novel views. However, the lengthy training…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Tong Wang , Shuichi Kurabayashi

Recent advances in Neural radiance fields (NeRF) have enabled high-fidelity scene reconstruction for novel view synthesis. However, NeRF requires hundreds of network evaluations per pixel to approximate a volume rendering integral, making…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Yifan Wang , Yi Gong , Yuan Zeng

A variety of Neural Radiance Fields (NeRF) methods have recently achieved remarkable success in high render speed. However, current accelerating methods are specialized and incompatible with various implicit methods, preventing real-time…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Xinyu Gao , Ziyi Yang , Yunlu Zhao , Yuxiang Sun , Xiaogang Jin , Changqing Zou

Neural Radiance Fields (NeRF) has gained significant attention for its prominent implicit 3D representation and realistic novel view synthesis capabilities. Available works unexceptionally employ straight-line volume rendering, which…

Graphics · Computer Science 2025-08-20 Nan Luo , Chenglin Ye , Jiaxu Li , Gang Liu , Bo Wan , Di Wang , Lupeng Liu , Jun Xiao

Neural radiance fields (NeRFs) have shown impressive results for novel view synthesis. However, they depend on the repetitive use of a single-input single-output multilayer perceptron (SISO MLP) that maps 3D coordinates and view direction…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Takuhiro Kaneko

Talking head generation based on the neural radiation fields model has shown promising visual effects. However, the slow rendering speed of NeRF seriously limits its application, due to the burdensome calculation process over hundreds of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Niu Guanchen

Virtual Reality (VR) is becoming ubiquitous with the rise of consumer displays and commercial VR platforms. Such displays require low latency and high quality rendering of synthetic imagery with reduced compute overheads. Recent advances in…

Graphics · Computer Science 2022-07-25 Nianchen Deng , Zhenyi He , Jiannan Ye , Budmonde Duinkharjav , Praneeth Chakravarthula , Xubo Yang , Qi Sun

Neural Radiance Fields (NeRF), an AI-driven approach for 3D view reconstruction, has demonstrated impressive performance, sparking active research across fields. As a result, a range of advanced NeRF models has emerged, leading on-device…

Hardware Architecture · Computer Science 2025-05-13 Seock-Hwan Noh , Banseok Shin , Jeik Choi , Seungpyo Lee , Jaeha Kung , Yeseong Kim

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

Neural Radiance Fields (NeRF) achieves impressive novel view rendering performance by learning implicit 3D representation from sparse view images. However, it is difficult to reconstruct a sharp NeRF from blurry input that often occurs in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yunshan Qi , Jia Li , Yifan Zhao , Yu Zhang , Lin Zhu

Modern Neural Radiance Fields (NeRFs) learn a mapping from position to volumetric density leveraging proposal network samplers. In contrast to the coarse-to-fine sampling approach with two NeRFs, this offers significant potential for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Lukas Radl , Andreas Kurz , Michael Steiner , Markus Steinberger

Recently, Neural Radiance Fields (NeRF) has shown promising performances on reconstructing 3D scenes and synthesizing novel views from a sparse set of 2D images. Albeit effective, the performance of NeRF is highly influenced by the quality…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Xuran Pan , Zihang Lai , Shiji Song , Gao Huang

Instant on-device Neural Radiance Fields (NeRFs) are in growing demand for unleashing the promise of immersive AR/VR experiences, but are still limited by their prohibitive training time. Our profiling analysis reveals a memory-bound…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Yang Zhao , Shang Wu , Jingqun Zhang , Sixu Li , Chaojian Li , Yingyan Lin

We present a differentiable rendering framework for material and lighting estimation from multi-view images and a reconstructed geometry. In the framework, we represent scene lightings as the Neural Incident Light Field (NeILF) and material…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Yao Yao , Jingyang Zhang , Jingbo Liu , Yihang Qu , Tian Fang , David McKinnon , Yanghai Tsin , Long Quan

Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Kai Zhang , Gernot Riegler , Noah Snavely , Vladlen Koltun