中文
相关论文

相关论文: Generalizable Neural Radiance Fields for Novel Vie…

200 篇论文

We propose a differentiable rendering algorithm for efficient novel view synthesis. By departing from volume-based representations in favor of a learned point representation, we improve on existing methods more than an order of magnitude in…

计算机视觉与模式识别 · 计算机科学 2023-07-06 Qiang Zhang , Seung-Hwan Baek , Szymon Rusinkiewicz , Felix Heide

Existing neural radiance fields (NeRF)-based novel view synthesis methods for large-scale outdoor scenes are mainly built on a single altitude. Moreover, they often require a priori camera shooting height and scene scope, leading to…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Jingfeng Guo , Xiaohan Zhang , Baozhu Zhao , Qi Liu

Neural Radiance Fields (NeRF) have demonstrated superior novel view synthesis performance but are slow at rendering. To speed up the volume rendering process, many acceleration methods have been proposed at the cost of large memory…

计算机视觉与模式识别 · 计算机科学 2022-12-19 Sicheng Li , Hao Li , Yue Wang , Yiyi Liao , Lu Yu

Neural Radiance Fields (NeRF) have demonstrated very impressive performance in novel view synthesis via implicitly modelling 3D representations from multi-view 2D images. However, most existing studies train NeRF models with either…

计算机视觉与模式识别 · 计算机科学 2023-06-13 Jiahui Zhang , Fangneng Zhan , Rongliang Wu , Yingchen Yu , Wenqing Zhang , Bai Song , Xiaoqin Zhang , Shijian Lu

We present MVSNeRF, a novel neural rendering approach that can efficiently reconstruct neural radiance fields for view synthesis. Unlike prior works on neural radiance fields that consider per-scene optimization on densely captured images,…

计算机视觉与模式识别 · 计算机科学 2021-08-25 Anpei Chen , Zexiang Xu , Fuqiang Zhao , Xiaoshuai Zhang , Fanbo Xiang , Jingyi Yu , Hao Su

We present Generalizable NeRF Transformer (GNT), a transformer-based architecture that reconstructs Neural Radiance Fields (NeRFs) and learns to renders novel views on the fly from source views. While prior works on NeRFs optimize a scene…

计算机视觉与模式识别 · 计算机科学 2023-03-03 Mukund Varma T , Peihao Wang , Xuxi Chen , Tianlong Chen , Subhashini Venugopalan , Zhangyang Wang

Neural Radiance Field (NeRF) has revolutionized novel-view rendering tasks and achieved impressive results. However, the inefficient sampling and per-scene optimization hinder its wide applications. Though some generalizable NeRFs have been…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Yue Shi , Dingyi Rong , Chang Chen , Chaofan Ma , Bingbing Ni , Wenjun Zhang

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

计算机视觉与模式识别 · 计算机科学 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

In this paper, we introduce a new challenge for synthesizing novel view images in practical environments with limited input multi-view images and varying lighting conditions. Neural radiance fields (NeRF), one of the pioneering works for…

计算机视觉与模式识别 · 计算机科学 2023-12-19 SeokYeong Lee , JunYong Choi , Seungryong Kim , Ig-Jae Kim , Junghyun Cho

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

The goal of our work is to generate high-quality novel views from monocular videos of complex and dynamic scenes. Prior methods, such as DynamicNeRF, have shown impressive performance by leveraging time-varying dynamic radiation fields.…

计算机视觉与模式识别 · 计算机科学 2024-07-03 Xingyu Miao , Yang Bai , Haoran Duan , Yawen Huang , Fan Wan , Yang Long , Yefeng Zheng

This paper introduces a novel paradigm for the generalizable neural radiance field (NeRF). Previous generic NeRF methods combine multiview stereo techniques with image-based neural rendering for generalization, yielding impressive results,…

计算机视觉与模式识别 · 计算机科学 2024-01-26 Jiaxu Wang , Ziyi Zhang , Renjing Xu

Neural radiance fields (NeRF) methods have demonstrated impressive novel view synthesis performance. The core approach is to render individual rays by querying a neural network at points sampled along the ray to obtain the density and…

计算机视觉与模式识别 · 计算机科学 2021-06-10 Relja Arandjelović , Andrew Zisserman

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis using differentiable…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Marie-Julie Rakotosaona , Fabian Manhardt , Diego Martin Arroyo , Michael Niemeyer , Abhijit Kundu , Federico Tombari

Recently, Neural Radiance Fields (NeRF) is revolutionizing the task of novel view synthesis (NVS) for its superior performance. In this paper, we propose to synthesize dynamic scenes. Extending the methods for static scenes to dynamic…

计算机视觉与模式识别 · 计算机科学 2022-10-12 Xiang Guo , Guanying Chen , Yuchao Dai , Xiaoqing Ye , Jiadai Sun , Xiao Tan , Errui Ding

Novel view synthesis from a single image requires inferring occluded regions of objects and scenes whilst simultaneously maintaining semantic and physical consistency with the input. Existing approaches condition neural radiance fields…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Jiatao Gu , Alex Trevithick , Kai-En Lin , Josh Susskind , Christian Theobalt , Lingjie Liu , Ravi Ramamoorthi

We present a new neural representation, called Neural Ray (NeuRay), for the novel view synthesis task. Recent works construct radiance fields from image features of input views to render novel view images, which enables the generalization…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Yuan Liu , Sida Peng , Lingjie Liu , Qianqian Wang , Peng Wang , Christian Theobalt , Xiaowei Zhou , Wenping Wang

Neural Radiance Fields (NeRFs) have become increasingly popular because of their impressive ability for novel view synthesis. However, their effectiveness is hindered by the Rolling Shutter (RS) effects commonly found in most camera…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Muyao Niu , Tong Chen , Yifan Zhan , Zhuoxiao Li , Xiang Ji , Yinqiang Zheng

Neural Radiance Fields (NeRF) give rise to learning-based 3D reconstruction methods widely used in industrial applications. Although prevalent methods achieve considerable improvements in small-scale scenes, accomplishing reconstruction in…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Bingnan Ni , Huanyu Wang , Dongfeng Bai , Minghe Weng , Dexin Qi , Weichao Qiu , Bingbing Liu

Neural Radiance Fields (NeRF) achieves unprecedented performance in synthesizing novel view synthesis, utilizing multi-view consistency. When capturing multiple inputs, image signal processing (ISP) in modern cameras will independently…

计算机视觉与模式识别 · 计算机科学 2024-08-08 Yuehao Wang , Chaoyi Wang , Bingchen Gong , Tianfan Xue