中文
相关论文

相关论文: VMRF: View Matching Neural Radiance Fields

200 篇论文

Reconstructing from multi-view images is a longstanding problem in 3D vision, where neural radiance fields (NeRFs) have shown great potential and get realistic rendered images of novel views. Currently, most NeRF methods either require…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Xin Wen , Xuening Zhu , Renjiao Yi , Zhifeng Wang , Chenyang Zhu , Kai Xu

Recent work on Neural Radiance Fields (NeRF) exploits multi-view 3D consistency, achieving impressive results in 3D scene modeling and high-fidelity novel-view synthesis. However, there are limitations. First, existing methods assume enough…

计算机视觉与模式识别 · 计算机科学 2024-01-09 Mengfei Li , Ming Lu , Xiaofang Li , Shanghang Zhang

Neural Radiance Fields (NeRF) revolutionize the realm of visual media by providing photorealistic Free-Viewpoint Video (FVV) experiences, offering viewers unparalleled immersion and interactivity. However, the technology's significant…

计算机视觉与模式识别 · 计算机科学 2023-12-13 Minye Wu , Zehao Wang , Georgios Kouros , Tinne Tuytelaars

We propose VDN-NeRF, a method to train neural radiance fields (NeRFs) for better geometry under non-Lambertian surface and dynamic lighting conditions that cause significant variation in the radiance of a point when viewed from different…

计算机视觉与模式识别 · 计算机科学 2023-04-03 Bingfan Zhu , Yanchao Yang , Xulong Wang , Youyi Zheng , Leonidas Guibas

We present a parallelized optimization method based on fast Neural Radiance Fields (NeRF) for estimating 6-DoF pose of a camera with respect to an object or scene. Given a single observed RGB image of the target, we can predict the…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Yunzhi Lin , Thomas Müller , Jonathan Tremblay , Bowen Wen , Stephen Tyree , Alex Evans , Patricio A. Vela , Stan Birchfield

Given the image collection of an object, we aim at building a real-time image-based pose estimation method, which requires neither its CAD model nor hours of object-specific training. Recent NeRF-based methods provide a promising solution…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Ronghan Chen , Yang Cong , Yu Ren

Recent advances in Neural Radiance Fields (NeRFs) treat the problem of novel view synthesis as Sparse Radiance Field (SRF) optimization using sparse voxels for efficient and fast rendering (plenoxels,InstantNGP). In order to leverage…

计算机视觉与模式识别 · 计算机科学 2024-02-26 Abdullah Hamdi , Bernard Ghanem , Matthias Nießner

Neural radiance fields (NeRF) is a promising approach for generating photorealistic images and representing complex scenes. However, when processing data sequentially, it can suffer from catastrophic forgetting, where previous data is…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Letian Zhang , Ming Li , Chen Chen , Jie Xu

Neural Radiance Field (NeRF) and its variants have exhibited great success on representing 3D scenes and synthesizing photo-realistic novel views. However, they are generally based on the pinhole camera model and assume all-in-focus inputs.…

计算机视觉与模式识别 · 计算机科学 2022-08-02 Zijin Wu , Xingyi Li , Juewen Peng , Hao Lu , Zhiguo Cao , Weicai Zhong

Novel view synthesis has recently made significant progress with the advent of Neural Radiance Fields (NeRF). DietNeRF is an extension of NeRF that aims to achieve this task from only a few images by introducing a new loss function for…

计算机视觉与模式识别 · 计算机科学 2023-10-23 Daiju Kanaoka , Motoharu Sonogashira , Hakaru Tamukoh , Yasutomo Kawanishi

We propose a novel framework to reconstruct accurate appearance and geometry with neural radiance fields (NeRF) for interacting hands, enabling the rendering of photo-realistic images and videos for gesture animation from arbitrary views.…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Zhiyang Guo , Wengang Zhou , Min Wang , Li Li , Houqiang Li

Implicit neural representations have shown powerful capacity in modeling real-world 3D scenes, offering superior performance in novel view synthesis. In this paper, we target a more challenging scenario, i.e., joint scene novel view…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Yuxin Wang , Wayne Wu , Dan Xu

We present NeRF-SR, a solution for high-resolution (HR) novel view synthesis with mostly low-resolution (LR) inputs. Our method is built upon Neural Radiance Fields (NeRF) that predicts per-point density and color with a multi-layer…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Chen Wang , Xian Wu , Yuan-Chen Guo , Song-Hai Zhang , Yu-Wing Tai , Shi-Min Hu

Neural radiance fields enable novel-view synthesis and scene reconstruction with photorealistic quality from a few images, but require known and accurate camera poses. Conventional pose estimation algorithms fail on smooth or self-similar…

计算机视觉与模式识别 · 计算机科学 2023-07-20 Axel Levy , Mark Matthews , Matan Sela , Gordon Wetzstein , Dmitry Lagun

Neural Radiance Field (NeRF) has enabled novel view synthesis with high fidelity given images and camera poses. Subsequent works even succeeded in eliminating the necessity of pose priors by jointly optimizing NeRF and camera pose. However,…

计算机视觉与模式识别 · 计算机科学 2023-11-09 Injae Kim , Minhyuk Choi , Hyunwoo J. Kim

Neural Radiance Fields (NeRF) have emerged as a powerful paradigm for 3D scene representation, offering high-fidelity renderings and reconstructions from a set of sparse and unstructured sensor data. In the context of autonomous robotics,…

机器人学 · 计算机科学 2024-12-09 Yuhang Ming , Xingrui Yang , Weihan Wang , Zheng Chen , Jinglun Feng , Yifan Xing , Guofeng Zhang

We present a framework, called MVG-NeRF, that combines classical Multi-View Geometry algorithms and Neural Radiance Fields (NeRF) for image-based 3D reconstruction. NeRF has revolutionized the field of implicit 3D representations, mainly…

计算机视觉与模式识别 · 计算机科学 2022-10-25 Marco Orsingher , Paolo Zani , Paolo Medici , Massimo Bertozzi

Neural Radiance Fields (NeRF) have shown impressive capabilities for photorealistic novel view synthesis when trained on dense inputs. However, when trained on sparse inputs, NeRF typically encounters issues of incorrect density or color…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Yingji Zhong , Lanqing Hong , Zhenguo Li , Dan Xu

We propose pixelNeRF, a learning framework that predicts a continuous neural scene representation conditioned on one or few input images. The existing approach for constructing neural radiance fields involves optimizing the representation…

计算机视觉与模式识别 · 计算机科学 2021-06-01 Alex Yu , Vickie Ye , Matthew Tancik , Angjoo Kanazawa

Reconstructing category-specific objects using Neural Radiance Field (NeRF) from a single image is a promising yet challenging task. Existing approaches predominantly rely on projection-based feature retrieval to associate 3D points in the…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Kun Wang , Zhiqiang Yan , Zhenyu Zhang , Xiang Li , Jun Li , Jian Yang