English
Related papers

Related papers: A Learned Radiance-Field Representation for Comple…

200 papers

We propose LIRF (Local Implicit Ray Function), a generalizable neural rendering approach for novel view rendering. Current generalizable neural radiance fields (NeRF) methods sample a scene with a single ray per pixel and may therefore…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Xin Huang , Qi Zhang , Ying Feng , Xiaoyu Li , Xuan Wang , Qing Wang

Neural Radiance Fields (NeRF) is a revolutionary approach for rendering scenes by sampling a single ray per pixel and it has demonstrated impressive capabilities in novel-view synthesis from static scene images. However, in practice, we…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yifan Yang , Shuhai Zhang , Zixiong Huang , Yubing Zhang , Mingkui Tan

This paper presents a flexible representation of neural radiance fields based on multi-plane images (MPI), for high-quality view synthesis of complex scenes. MPI with Normalized Device Coordinate (NDC) parameterization is widely used in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Yuze He , Peng Wang , Yubin Hu , Wang Zhao , Ran Yi , Yong-Jin Liu , Wenping Wang

Neural Radiance Fields (NeRF) is a novel implicit 3D reconstruction method that shows immense potential and has been gaining increasing attention. It enables the reconstruction of 3D scenes solely from a set of photographs. However, its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Jiaming Gu , Minchao Jiang , Hongsheng Li , Xiaoyuan Lu , Guangming Zhu , Syed Afaq Ali Shah , Liang Zhang , Mohammed Bennamoun

A high-quality 3D reconstruction of a scene from a collection of 2D images can be achieved through offline/online mapping methods. In this paper, we explore active mapping from the perspective of implicit representations, which have…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Huangying Zhan , Jiyang Zheng , Yi Xu , Ian Reid , Hamid Rezatofighi

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

We present a simple yet powerful neural network that implicitly represents and renders 3D objects and scenes only from 2D observations. The network models 3D geometries as a general radiance field, which takes a set of 2D images with camera…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Alex Trevithick , Bo Yang

Photorealistic simulation plays a crucial role in applications such as autonomous driving, where advances in neural radiance fields (NeRFs) may allow better scalability through the automatic creation of digital 3D assets. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Shanlin Sun , Bingbing Zhuang , Ziyu Jiang , Buyu Liu , Xiaohui Xie , Manmohan Chandraker

Neural Radiance Fields (NeRFs) have demonstrated remarkable effectiveness in novel view synthesis within 3D environments. However, extracting a radiance field of one specific object from multi-view images encounters substantial challenges…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zhiyi Li , Lihe Ding , Tianfan Xue

We propose X-NeRF, a novel method to learn a Cross-Spectral scene representation given images captured from cameras with different light spectrum sensitivity, based on the Neural Radiance Fields formulation. X-NeRF optimizes camera poses…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Matteo Poggi , Pierluigi Zama Ramirez , Fabio Tosi , Samuele Salti , Stefano Mattoccia , Luigi Di Stefano

Neural radiance fields~(NeRF) have recently been applied to render large-scale scenes. However, their limited model capacity typically results in blurred rendering results. Existing large-scale NeRFs primarily address this limitation by…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Mingqi Shao , Feng Xiong , Hang Zhang , Shuang Yang , Mu Xu , Wei Bian , Xueqian Wang

View synthesis methods using implicit continuous shape representations learned from a set of images, such as the Neural Radiance Field (NeRF) method, have gained increasing attention due to their high quality imagery and scalability to high…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Guo-Wei Yang , Wen-Yang Zhou , Hao-Yang Peng , Dun Liang , Tai-Jiang Mu , Shi-Min Hu

Photorealistic rendering of dynamic humans is an important ability for telepresence systems, virtual shopping, synthetic data generation, and more. Recently, neural rendering methods, which combine techniques from computer graphics and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Ziyan Wang , Timur Bagautdinov , Stephen Lombardi , Tomas Simon , Jason Saragih , Jessica Hodgins , Michael Zollhöfer

Neural Radiance Field (NeRF) is a powerful tool to faithfully generate novel views for scenes with only sparse captured images. Despite its strong capability for representing 3D scenes and their appearance, its editing ability is very…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Qiling Wu , Jianchao Tan , Kun Xu

Neural scene representations, such as Neural Radiance Fields (NeRF), are based on training a multilayer perceptron (MLP) using a set of color images with known poses. An increasing number of devices now produce RGB-D(color + depth)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Arnab Dey , Yassine Ahmine , Andrew I. Comport

Efficient and accurate 3D reconstruction is essential for applications in cultural heritage. This study addresses the challenge of visualizing objects within large-scale scenes at a high level of detail (LOD) using Neural Radiance Fields…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Quoc-Anh Bui , Gilles Rougeron , Géraldine Morin , Simone Gasparini

Novel view synthesis (NVS) is a challenge in computer vision and graphics, focusing on generating realistic images of a scene from unobserved camera poses, given a limited set of authentic input images. Neural radiance fields (NeRF)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Austin Peng

Volume rendering using neural fields has shown great promise in capturing and synthesizing novel views of 3D scenes. However, this type of approach requires querying the volume network at multiple points along each viewing ray in order to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Martin Piala , Ronald Clark

Neural radiance fields, or NeRFs, have become the de facto approach for high-quality view synthesis from a collection of images captured from multiple viewpoints. However, many issues remain when capturing images in-the-wild under…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Sacha Jungerman , Aryan Garg , Mohit Gupta

In this paper, we propose SpectralNeRF, an end-to-end Neural Radiance Field (NeRF)-based architecture for high-quality physically based rendering from a novel spectral perspective. We modify the classical spectral rendering into two main…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ru Li , Jia Liu , Guanghui Liu , Shengping Zhang , Bing Zeng , Shuaicheng Liu