中文
相关论文

相关论文: NeRF in detail: Learning to sample for view synthe…

200 篇论文

Neural Radiance Fields (NeRF) have demonstrated impressive performance in novel view synthesis. However, NeRF and most of its variants still rely on traditional complex pipelines to provide extrinsic and intrinsic camera parameters, such as…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Qingsong Yan , Qiang Wang , Kaiyong Zhao , Jie Chen , Bo Li , Xiaowen Chu , Fei Deng

Recent neural rendering and reconstruction techniques, such as NeRFs or Gaussian Splatting, have shown remarkable novel view synthesis capabilities but require hundreds of images of the scene from diverse viewpoints to render high-quality…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Felix Tristram , Stefano Gasperini , Nassir Navab , Federico Tombari

Volumetric neural rendering methods like NeRF generate high-quality view synthesis results but are optimized per-scene leading to prohibitive reconstruction time. On the other hand, deep multi-view stereo methods can quickly reconstruct…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Qiangeng Xu , Zexiang Xu , Julien Philip , Sai Bi , Zhixin Shu , Kalyan Sunkavalli , Ulrich Neumann

Neural radiance fields, or NeRF, represent a breakthrough in the field of novel view synthesis and 3D modeling of complex scenes from multi-view image collections. Numerous recent works have shown the importance of making NeRF models more…

计算机视觉与模式识别 · 计算机科学 2022-12-01 Thibaud Ehret , Roger Marí , Gabriele Facciolo

Texture synthesis is a fundamental problem in computer graphics that would benefit various applications. Existing methods are effective in handling 2D image textures. In contrast, many real-world textures contain meso-structure in the 3D…

计算机视觉与模式识别 · 计算机科学 2024-12-16 Yi-Hua Huang , Yan-Pei Cao , Yu-Kun Lai , Ying Shan , Lin Gao

Neural Radiance Fields (NeRF) has demonstrated remarkable 3D reconstruction capabilities with dense view images. However, its performance significantly deteriorates under sparse view settings. We observe that learning the 3D consistency of…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Shoukang Hu , Kaichen Zhou , Kaiyu Li , Longhui Yu , Lanqing Hong , Tianyang Hu , Zhenguo Li , Gim Hee Lee , Ziwei Liu

NeRF aims to learn a continuous neural scene representation by using a finite set of input images taken from various viewpoints. A well-known limitation of NeRF methods is their reliance on data: the fewer the viewpoints, the higher the…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Matteo Bortolon , Alessio Del Bue , Fabio Poiesi

Neural Radiance Field (NeRF) has recently emerged as a powerful representation to synthesize photorealistic novel views. While showing impressive performance, it relies on the availability of dense input views with highly accurate camera…

计算机视觉与模式识别 · 计算机科学 2023-06-14 Prune Truong , Marie-Julie Rakotosaona , Fabian Manhardt , Federico Tombari

Neural Radiance Fields (NeRFs) are a very recent and very popular approach for the problems of novel view synthesis and 3D reconstruction. A popular scene representation used by NeRFs is to combine a uniform, voxel-based subdivision of the…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Jonas Kulhanek , Torsten Sattler

Although many recent works have investigated generalizable NeRF-based novel view synthesis for unseen scenes, they seldom consider the synthetic-to-real generalization, which is desired in many practical applications. In this work, we first…

计算机视觉与模式识别 · 计算机科学 2023-06-26 Hao Yang , Lanqing Hong , Aoxue Li , Tianyang Hu , Zhenguo Li , Gim Hee Lee , Liwei Wang

In this paper, we present an efficient and robust deep learning solution for novel view synthesis of complex scenes. In our approach, a 3D scene is represented as a light field, i.e., a set of rays, each of which has a corresponding color…

计算机视觉与模式识别 · 计算机科学 2022-07-08 Zhong Li , Liangchen Song , Celong Liu , Junsong Yuan , Yi Xu

We present iNeRF, a framework that performs mesh-free pose estimation by "inverting" a Neural RadianceField (NeRF). NeRFs have been shown to be remarkably effective for the task of view synthesis - synthesizing photorealistic novel views of…

计算机视觉与模式识别 · 计算机科学 2021-08-11 Lin Yen-Chen , Pete Florence , Jonathan T. Barron , Alberto Rodriguez , Phillip Isola , Tsung-Yi Lin

Neural rendering combines ideas from classical computer graphics and machine learning to synthesize images from real-world observations. NeRF, short for Neural Radiance Fields, is a recent innovation that uses AI algorithms to create 3D…

计算机视觉与模式识别 · 计算机科学 2024-03-20 AKM Shahariar Azad Rabby , Chengcui Zhang

Recent advances in Neural Radiance Fields (NeRFs) treat the problem of novel view synthesis as Sparse Radiance Field (SRF) optimization using sparse voxels for efficient and fast rendering (plenoxels,InstantNGP). In order to leverage…

计算机视觉与模式识别 · 计算机科学 2024-02-26 Abdullah Hamdi , Bernard Ghanem , Matthias Nießner

Neural radiance fields (NeRFs) have emerged as a prominent pre-training paradigm for vision-centric autonomous driving, which enhances 3D geometry and appearance understanding in a fully self-supervised manner. To apply NeRF-based…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Hyeonjun Jeong , Juyeb Shin , Dongsuk Kum

Neural radiance fields (NeRFs) have shown impressive results for novel view synthesis. However, they depend on the repetitive use of a single-input single-output multilayer perceptron (SISO MLP) that maps 3D coordinates and view direction…

计算机视觉与模式识别 · 计算机科学 2023-10-04 Takuhiro Kaneko

Recently, Neural Radiance Fields (NeRF) has shown promising performances on reconstructing 3D scenes and synthesizing novel views from a sparse set of 2D images. Albeit effective, the performance of NeRF is highly influenced by the quality…

计算机视觉与模式识别 · 计算机科学 2022-09-20 Xuran Pan , Zihang Lai , Shiji Song , Gao Huang

Recent works on generalizable NeRFs have shown promising results on novel view synthesis from single or few images. However, such models have rarely been applied on other downstream tasks beyond synthesis such as semantic understanding and…

计算机视觉与模式识别 · 计算机科学 2024-04-10 Jianglong Ye , Naiyan Wang , Xiaolong Wang

Neural Radiance Fields (NeRFs) have achieved impressive results in novel view synthesis and surface reconstruction tasks. However, their performance suffers under challenging scenarios with sparse input views. We present CorresNeRF, a novel…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Yixing Lao , Xiaogang Xu , Zhipeng Cai , Xihui Liu , Hengshuang Zhao

This paper proposes a novel approach for rendering a pre-trained Neural Radiance Field (NeRF) in real-time on resource-constrained devices. We introduce Re-ReND, a method enabling Real-time Rendering of NeRFs across Devices. Re-ReND is…

计算机视觉与模式识别 · 计算机科学 2023-03-16 Sara Rojas , Jesus Zarzar , Juan Camilo Perez , Artsiom Sanakoyeu , Ali Thabet , Albert Pumarola , Bernard Ghanem