中文
相关论文

相关论文: LiveNeRF: Efficient Face Replacement Through Neura…

200 篇论文

The insertion of objects into a scene and relighting are commonly utilized applications in augmented reality (AR). Previous methods focused on inserting virtual objects using CAD models or real objects from single-view images, resulting in…

计算机视觉与模式识别 · 计算机科学 2024-06-24 Xuening Zhu , Renjiao Yi , Xin Wen , Chenyang Zhu , Kai Xu

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

计算机视觉与模式识别 · 计算机科学 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

We present the first real-time method for inserting a rigid virtual object into a neural radiance field, which produces realistic lighting and shadowing effects, as well as allows interactive manipulation of the object. By exploiting the…

计算机视觉与模式识别 · 计算机科学 2023-10-10 Keyang Ye , Hongzhi Wu , Xin Tong , Kun Zhou

With the rapid development of generation model, AI-based face manipulation technology, which called DeepFakes, has become more and more realistic. This means of face forgery can attack any target, which poses a new threat to personal…

计算机视觉与模式识别 · 计算机科学 2021-11-16 Yuyang Sun , Zhiyong Zhang , Changzhen Qiu , Liang Wang , Zekai Wang

Dynamic Neural Radiance Field (NeRF) is a powerful algorithm capable of rendering photo-realistic novel view images from a monocular RGB video of a dynamic scene. Although it warps moving points across frames from the observation spaces to…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Zhiwen Yan , Chen Li , Gim Hee Lee

Neural radiance fields (NeRF) achieve highly photo-realistic novel-view synthesis, but it's a challenging problem to edit the scenes modeled by NeRF-based methods, especially for dynamic scenes. We propose editable neural radiance fields…

计算机视觉与模式识别 · 计算机科学 2023-03-29 Chengwei Zheng , Wenbin Lin , Feng Xu

Deepfake technology utilizes deep learning based face manipulation techniques to seamlessly replace faces in videos creating highly realistic but artificially generated content. Although this technology has beneficial applications in media…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Siddiqui Muhammad Yasir , Hyun Kim

Generalizing Neural Radiance Fields (NeRF) to new scenes is a significant challenge that existing approaches struggle to address without extensive modifications to vanilla NeRF framework. We introduce InsertNeRF, a method for INStilling…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Yanqi Bao , Tianyu Ding , Jing Huo , Wenbin Li , Yuxin Li , Yang Gao

We introduce ViewNeRF, a Neural Radiance Field-based viewpoint estimation method that learns to predict category-level viewpoints directly from images during training. While NeRF is usually trained with ground-truth camera poses, multiple…

计算机视觉与模式识别 · 计算机科学 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

The generation of a virtual digital avatar is a crucial research topic in the field of computer vision. Many existing works utilize Neural Radiance Fields (NeRF) to address this issue and have achieved impressive results. However, previous…

计算机视觉与模式识别 · 计算机科学 2025-02-05 Shengbo Gu , Yu-Kun Qiu , Yu-Ming Tang , Ancong Wu , Wei-Shi Zheng

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis using differentiable…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Marie-Julie Rakotosaona , Fabian Manhardt , Diego Martin Arroyo , Michael Niemeyer , Abhijit Kundu , Federico Tombari

Photo-realistic rendering and novel view synthesis play a crucial role in human-computer interaction tasks, from gaming to path planning. Neural Radiance Fields (NeRFs) model scenes as continuous volumetric functions and achieve remarkable…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Iryna Repinetska , Anna Hilsmann , Peter Eisert

We present EvDNeRF, a pipeline for generating event data and training an event-based dynamic NeRF, for the purpose of faithfully reconstructing eventstreams on scenes with rigid and non-rigid deformations that may be too fast to capture…

Current methods for 3D reconstruction and environmental mapping frequently face challenges in achieving high precision, highlighting the need for practical and effective solutions. In response to this issue, our study introduces FlyNeRF, a…

机器人学 · 计算机科学 2024-04-22 Maria Dronova , Vladislav Cheremnykh , Alexey Kotcov , Aleksey Fedoseev , Dzmitry Tsetserukou

Neural Radiance Field (NeRF) research has attracted significant attention recently, with 3D modelling, virtual/augmented reality, and visual effects driving its application. While current NeRF implementations can produce high quality visual…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Adrian Azzarelli , Nantheera Anantrasirichai , David R Bull

In this study, we introduce BirdNeRF, an adaptation of Neural Radiance Fields (NeRF) designed specifically for reconstructing large-scale scenes using aerial imagery. Unlike previous research focused on small-scale and object-centric NeRF…

计算机视觉与模式识别 · 计算机科学 2024-02-13 Huiqing Zhang , Yifei Xue , Ming Liao , Yizhen Lao

Neural Radiance Fields (NeRF) presented a novel way to represent scenes, allowing for high-quality 3D reconstruction from 2D images. Following its remarkable achievements, global localization within NeRF maps is an essential task for…

机器人学 · 计算机科学 2025-03-17 Mangyu Kong , Seongwon Lee , Jaewon Lee , Euntai Kim

Audio-driven talking head synthesis is a promising topic with wide applications in digital human, film making and virtual reality. Recent NeRF-based approaches have shown superiority in quality and fidelity compared to previous studies.…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Dongze Li , Kang Zhao , Wei Wang , Bo Peng , Yingya Zhang , Jing Dong , Tieniu Tan

High-fidelity facial avatar reconstruction from a monocular video is a significant research problem in computer graphics and computer vision. Recently, Neural Radiance Field (NeRF) has shown impressive novel view rendering results and has…

计算机视觉与模式识别 · 计算机科学 2023-03-07 Yunpeng Bai , Yanbo Fan , Xuan Wang , Yong Zhang , Jingxiang Sun , Chun Yuan , Ying Shan

Neural Radiance Fields (NeRF) have shown remarkable performance in neural rendering-based novel view synthesis. However, NeRF suffers from severe visual quality degradation when the input images have been captured under imperfect…

计算机视觉与模式识别 · 计算机科学 2024-01-02 Byeonghyeon Lee , Howoong Lee , Usman Ali , Eunbyung Park