English
Related papers

Related papers: NGP-RT: Fusing Multi-Level Hash Features with Ligh…

200 papers

Neural radiance fields (NeRFs) enable novel view synthesis with unprecedented visual quality. However, to render photorealistic images, NeRFs require hundreds of deep multilayer perceptron (MLP) evaluations - for each pixel. This is…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Ziyu Wan , Christian Richardt , Aljaž Božič , Chao Li , Vijay Rengarajan , Seonghyeon Nam , Xiaoyu Xiang , Tuotuo Li , Bo Zhu , Rakesh Ranjan , Jing Liao

3D head avatars built with neural implicit volumetric representations have achieved unprecedented levels of photorealism. However, the computational cost of these methods remains a significant barrier to their widespread adoption,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Ziqian Bai , Feitong Tan , Sean Fanello , Rohit Pandey , Mingsong Dou , Shichen Liu , Ping Tan , Yinda Zhang

Following the burgeoning interest in implicit neural representation, Neural Light Field (NeLF) has been introduced to predict the color of a ray directly. Unlike Neural Radiance Field (NeRF), NeLF does not create a point-wise representation…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Lutao Jiang , Lin Wang

In recent years, Neural Radiance Field (NeRF) has demonstrated remarkable capabilities in representing 3D scenes. To expedite the rendering process, learnable explicit representations have been introduced for combination with implicit NeRF…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Yihang Chen , Qianyi Wu , Mehrtash Harandi , Jianfei Cai

We address the task of view synthesis, generating novel views of a scene given a set of images as input. In many recent works such as NeRF (Mildenhall et al., 2020), the scene geometry is parameterized using neural implicit representations…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Yiming Zuo , Jia Deng

We revisit NPBG, the popular approach to novel view synthesis that introduced the ubiquitous point feature neural rendering paradigm. We are interested in particular in data-efficient learning with fast view synthesis. We achieve this…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Shubhendu Jena , Franck Multon , Adnane Boukhayma

Novel view synthesis (NVS) aims to generate images at arbitrary viewpoints using multi-view images, and recent insights from neural radiance fields (NeRF) have contributed to remarkable improvements. Recently, studies on generalizable NeRF…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Youngho Yoon , Hyun-Kurl Jang , Kuk-Jin Yoon

Neural Radiance Field (NeRF) has broken new ground in the novel view synthesis due to its simple concept and state-of-the-art quality. However, it suffers from severe performance degradation unless trained with a dense set of images with…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Seunghyeon Seo , Donghoon Han , Yeonjin Chang , Nojun Kwak

Implicit Neural Representation (INR) is an innovative approach for representing complex shapes or objects without explicitly defining their geometry or surface structure. Instead, INR represents objects as continuous functions. Previous…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Hanqiu Chen , Hang Yang , Stephen Fitzmeyer , Cong Hao

Neural Radiance Fields (NeRF) have shown remarkable performance in neural rendering-based novel view synthesis. However, NeRF suffers from severe visual quality degradation when the input images have been captured under imperfect…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Byeonghyeon Lee , Howoong Lee , Usman Ali , Eunbyung Park

Recent research explosion on Neural Radiance Field (NeRF) shows the encouraging potential to represent complex scenes with neural networks. One major drawback of NeRF is its prohibitive inference time: Rendering a single pixel requires…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Huan Wang , Jian Ren , Zeng Huang , Kyle Olszewski , Menglei Chai , Yun Fu , Sergey Tulyakov

Neural scene representations, such as Neural Radiance Fields (NeRF), are based on training a multilayer perceptron (MLP) using a set of color images with known poses. An increasing number of devices now produce RGB-D(color + depth)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Arnab Dey , Yassine Ahmine , Andrew I. Comport

Instant-NGP has been the state-of-the-art architecture of neural fields in recent years. Its incredible signal-fitting capabilities are generally attributed to its multi-resolution hash grid structure and have been used and improved in…

Machine Learning · Computer Science 2025-05-07 Steven Tin Sui Luo

Despite the tremendous progress in neural radiance fields (NeRF), we still face a dilemma of the trade-off between quality and efficiency, e.g., MipNeRF presents fine-detailed and anti-aliased renderings but takes days for training, while…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Wenbo Hu , Yuling Wang , Lin Ma , Bangbang Yang , Lin Gao , Xiao Liu , Yuewen Ma

Recent advances in Neural Radiance Fields (NeRF) have demonstrated significant potential for representing 3D scene appearances as implicit neural networks, enabling the synthesis of high-fidelity novel views. However, the lengthy training…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Tong Wang , Shuichi Kurabayashi

Neural Radiance Fields (NeRFs) have achieved great success in the past few years. However, most current methods still require intensive resources due to ray marching-based rendering. To construct urban-level radiance fields efficiently, we…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Fan Lu , Yan Xu , Guang Chen , Hongsheng Li , Kwan-Yee Lin , Changjun Jiang

Recent neural rendering and reconstruction techniques, such as NeRFs or Gaussian Splatting, have shown remarkable novel view synthesis capabilities but require hundreds of images of the scene from diverse viewpoints to render high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Felix Tristram , Stefano Gasperini , Nassir Navab , Federico Tombari

Novel view synthesis aims to render unseen views given a set of calibrated images. In practical applications, the coverage, appearance or geometry of the scene may change over time, with new images continuously being captured. Efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Zhipeng Cai , Matthias Mueller

We present Generalizable NeRF Transformer (GNT), a transformer-based architecture that reconstructs Neural Radiance Fields (NeRFs) and learns to renders novel views on the fly from source views. While prior works on NeRFs optimize a scene…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Mukund Varma T , Peihao Wang , Xuxi Chen , Tianlong Chen , Subhashini Venugopalan , Zhangyang Wang

High dynamic range (HDR) novel view synthesis (NVS) aims to create photorealistic images from novel viewpoints using HDR imaging techniques. The rendered HDR images capture a wider range of brightness levels containing more details of the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yuanhao Cai , Zihao Xiao , Yixun Liang , Minghan Qin , Yulun Zhang , Xiaokang Yang , Yaoyao Liu , Alan Yuille