中文
相关论文

相关论文: Improving Neural Radiance Fields with Depth-aware …

200 篇论文

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

Neural radiance fields (NeRF) encode a scene into a neural representation that enables photo-realistic rendering of novel views. However, a successful reconstruction from RGB images requires a large number of input views taken under static…

计算机视觉与模式识别 · 计算机科学 2022-04-08 Barbara Roessle , Jonathan T. Barron , Ben Mildenhall , Pratul P. Srinivasan , Matthias Nießner

We present NeRF-SR, a solution for high-resolution (HR) novel view synthesis with mostly low-resolution (LR) inputs. Our method is built upon Neural Radiance Fields (NeRF) that predicts per-point density and color with a multi-layer…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Chen Wang , Xian Wu , Yuan-Chen Guo , Song-Hai Zhang , Yu-Wing Tai , Shi-Min Hu

Recent work on Neural Radiance Fields (NeRF) has demonstrated significant advances in high-quality view synthesis. A major limitation of NeRF is its low rendering efficiency due to the need for multiple network forwardings to render a…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Yushuang Wu , Xiao Li , Jinglu Wang , Xiaoguang Han , Shuguang Cui , Yan Lu

Neural Radiance Field (NeRF) has shown impressive performance in novel view synthesis via implicit scene representation. However, it usually suffers from poor scalability as requiring densely sampled images for each new scene. Several…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Muyu Xu , Fangneng Zhan , Jiahui Zhang , Yingchen Yu , Xiaoqin Zhang , Christian Theobalt , Ling Shao , Shijian Lu

Neural rendering combines ideas from classical computer graphics and machine learning to synthesize images from real-world observations. NeRF, short for Neural Radiance Fields, is a recent innovation that uses AI algorithms to create 3D…

计算机视觉与模式识别 · 计算机科学 2024-03-20 AKM Shahariar Azad Rabby , Chengcui Zhang

Neural Radiance Fields (NeRF) accomplishes photo-realistic novel view synthesis by learning the implicit volumetric representation of a scene from multi-view images, which faithfully convey the colorimetric information. However, sensor…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Jiacong Xu , Mingqian Liao , K Ram Prabhakar , Vishal M. Patel

Neural Radiance Fields (NeRF) have emerged as a powerful representation for the task of novel view synthesis due to their simplicity and state-of-the-art performance. Though NeRF can produce photorealistic renderings of unseen viewpoints…

计算机视觉与模式识别 · 计算机科学 2021-12-02 Michael Niemeyer , Jonathan T. Barron , Ben Mildenhall , Mehdi S. M. Sajjadi , Andreas Geiger , Noha Radwan

Considering the problem of novel view synthesis (NVS) from only a set of 2D images, we simplify the training process of Neural Radiance Field (NeRF) on forward-facing scenes by removing the requirement of known or pre-computed camera…

计算机视觉与模式识别 · 计算机科学 2022-04-07 Zirui Wang , Shangzhe Wu , Weidi Xie , Min Chen , Victor Adrian Prisacariu

Novel view synthesis aims to generate new view images of a given view image collection. Recent attempts address this problem relying on 3D geometry priors (e.g., shapes, sizes, and positions) learned from multi-view images. However, such…

计算机视觉与模式识别 · 计算机科学 2024-04-12 Zixiong Huang , Qi Chen , Libo Sun , Yifan Yang , Naizhou Wang , Mingkui Tan , Qi Wu

Implicit neural representations have shown powerful capacity in modeling real-world 3D scenes, offering superior performance in novel view synthesis. In this paper, we target a more challenging scenario, i.e., joint scene novel view…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Yuxin Wang , Wayne Wu , Dan Xu

Neural Radiance Fields (NeRFs) have become a rapidly growing research field with the potential to revolutionize typical photogrammetric workflows, such as those used for 3D scene reconstruction. As input, NeRFs require multi-view images…

计算机视觉与模式识别 · 计算机科学 2024-05-08 Markus Hillemann , Robert Langendörfer , Max Heiken , Max Mehltretter , Andreas Schenk , Martin Weinmann , Stefan Hinz , Christian Heipke , Markus Ulrich

Domain scientists often face I/O and storage challenges when keeping raw data from large-scale simulations. Saving visualization images, albeit practical, is limited to preselected viewpoints, transfer functions, and simulation parameters.…

图形学 · 计算机科学 2025-02-25 Siyuan Yao , Yunfei Lu , Chaoli Wang

Neural Radiance Fields (NeRF) has demonstrated remarkable 3D reconstruction capabilities with dense view images. However, its performance significantly deteriorates under sparse view settings. We observe that learning the 3D consistency of…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Shoukang Hu , Kaichen Zhou , Kaiyu Li , Longhui Yu , Lanqing Hong , Tianyang Hu , Zhenguo Li , Gim Hee Lee , Ziwei Liu

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

计算机视觉与模式识别 · 计算机科学 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Neural Radiance Field (NeRF) has been a mainstream in novel view synthesis with its remarkable quality of rendered images and simple architecture. Although NeRF has been developed in various directions improving continuously its…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Seunghyeon Seo , Yeonjin Chang , Nojun Kwak

Neural Radiance Field (NeRF) is a promising approach for synthesizing novel views, given a set of images and the corresponding camera poses of a scene. However, images photographed from a low-light scene can hardly be used to train a NeRF…

计算机视觉与模式识别 · 计算机科学 2023-07-21 Haoyuan Wang , Xiaogang Xu , Ke Xu , Rynson WH. Lau

We introduce a new task, novel view synthesis for LiDAR sensors. While traditional model-based LiDAR simulators with style-transfer neural networks can be applied to render novel views, they fall short of producing accurate and realistic…

计算机视觉与模式识别 · 计算机科学 2023-07-17 Tang Tao , Longfei Gao , Guangrun Wang , Yixing Lao , Peng Chen , Hengshuang Zhao , Dayang Hao , Xiaodan Liang , Mathieu Salzmann , Kaicheng Yu

Neural Radiance Fields (NeRFs) have become increasingly popular because of their impressive ability for novel view synthesis. However, their effectiveness is hindered by the Rolling Shutter (RS) effects commonly found in most camera…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Muyao Niu , Tong Chen , Yifan Zhan , Zhuoxiao Li , Xiang Ji , Yinqiang Zheng

We represent the ResNeRF, a novel geometry-guided two-stage framework for indoor scene novel view synthesis. Be aware of that a good geometry would greatly boost the performance of novel view synthesis, and to avoid the geometry ambiguity…

计算机视觉与模式识别 · 计算机科学 2023-07-12 Yuting Xiao , Yiqun Zhao , Yanyu Xu , Shenghua Gao