中文
相关论文

相关论文: LightAvatar: Efficient Head Avatar as Dynamic Neur…

200 篇论文

Neural Radiance Field (NeRF) research has attracted significant attention recently, with 3D modelling, virtual/augmented reality, and visual effects driving its application. While current NeRF implementations can produce high quality visual…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Adrian Azzarelli , Nantheera Anantrasirichai , David R Bull

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

Neural Radiance Fields (NeRF) have shown impressive capabilities for photorealistic novel view synthesis when trained on dense inputs. However, when trained on sparse inputs, NeRF typically encounters issues of incorrect density or color…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Yingji Zhong , Lanqing Hong , Zhenguo Li , Dan Xu

We present a novel semantic model for human head defined with neural radiance field. The 3D-consistent head model consist of a set of disentangled and interpretable bases, and can be driven by low-dimensional expression coefficients. Thanks…

图形学 · 计算机科学 2022-10-13 Xuan Gao , Chenglai Zhong , Jun Xiang , Yang Hong , Yudong Guo , Juyong Zhang

Creating high-quality controllable 3D human models from multi-view RGB videos poses a significant challenge. Neural radiance fields (NeRFs) have demonstrated remarkable quality in reconstructing and free-viewpoint rendering of static as…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Paul Knoll , Wieland Morgenstern , Anna Hilsmann , Peter Eisert

Neural Radiance Fields (NeRF)-based models have achieved remarkable success in 3D reconstruction and rendering tasks. However, during both training and inference, these models rely heavily on dense point sampling along rays from multiple…

计算机视觉与模式识别 · 计算机科学 2025-08-01 Ranxi Lin , Canming Yao , Jiayi Li , Weihang Liu , Xin Lou , Pingqiang Zhou

Animating high-fidelity video portrait with speech audio is crucial for virtual reality and digital entertainment. While most previous studies rely on accurate explicit structural information, recent works explore the implicit scene…

计算机视觉与模式识别 · 计算机科学 2022-02-11 Xian Liu , Yinghao Xu , Qianyi Wu , Hang Zhou , Wayne Wu , Bolei Zhou

Online reconstructing and rendering of large-scale indoor scenes is a long-standing challenge. SLAM-based methods can reconstruct 3D scene geometry progressively in real time but can not render photorealistic results. While NeRF-based…

计算机视觉与模式识别 · 计算机科学 2023-04-19 Yiming Gao , Yan-Pei Cao , Ying Shan

Synthesizing realistic videos of talking faces under custom lighting conditions and viewing angles benefits various downstream applications like video conferencing. However, most existing relighting methods are either time-consuming or…

计算机视觉与模式识别 · 计算机科学 2024-10-25 Ziqi Cai , Kaiwen Jiang , Shu-Yu Chen , Yu-Kun Lai , Hongbo Fu , Boxin Shi , Lin Gao

Novel view synthesis is a long-standing problem. In this work, we consider a variant of the problem where we are given only a few context views sparsely covering a scene or an object. The goal is to predict novel viewpoints in the scene,…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Jonáš Kulhánek , Erik Derner , Torsten Sattler , Robert Babuška

We present a method that enables synthesizing novel views and novel poses of arbitrary human performers from sparse multi-view images. A key ingredient of our method is a hybrid appearance blending module that combines the advantages of the…

计算机视觉与模式识别 · 计算机科学 2023-04-12 Youngjoong Kwon , Dahun Kim , Duygu Ceylan , Henry Fuchs

Neural Radiance Fields (NeRFs) can be dramatically accelerated by spatial grid representations. However, they do not explicitly reason about scale and so introduce aliasing artifacts when reconstructing scenes captured at different camera…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Haithem Turki , Michael Zollhöfer , Christian Richardt , Deva Ramanan

First-Person-View (FPV) holds immense potential for revolutionizing the trajectory of Unmanned Aerial Vehicles (UAVs), offering an exhilarating avenue for navigating complex building structures. Yet, traditional Neural Radiance Field (NeRF)…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Liqi Yan , Qifan Wang , Junhan Zhao , Qiang Guan , Zheng Tang , Jianhui Zhang , Dongfang Liu

Neural networks can represent and accurately reconstruct radiance fields for static 3D scenes (e.g., NeRF). Several works extend these to dynamic scenes captured with monocular video, with promising performance. However, the monocular…

计算机视觉与模式识别 · 计算机科学 2021-12-07 Benjamin Attal , Eliot Laidlaw , Aaron Gokaslan , Changil Kim , Christian Richardt , James Tompkin , Matthew O'Toole

We present a super-fast convergence approach to reconstructing the per-scene radiance field from a set of images that capture the scene with known poses. This task, which is often applied to novel view synthesis, is recently revolutionized…

计算机视觉与模式识别 · 计算机科学 2022-06-06 Cheng Sun , Min Sun , Hwann-Tzong Chen

Neural radiance field (NeRF) is an emerging view synthesis method that samples points in a three-dimensional (3D) space and estimates their existence and color probabilities. The disadvantage of NeRF is that it requires a long training time…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Hye Bin Yoo , Hyun Min Han , Sung Soo Hwang , Il Yong Chun

Neural Radiance Fields (NeRF) have been proposed for photorealistic novel view rendering. However, it requires many different views of one scene for training. Moreover, it has poor generalizations to new scenes and requires retraining or…

计算机视觉与模式识别 · 计算机科学 2023-05-12 Yurui Chen , Chun Gu , Feihu Zhang , Li Zhang

The standard Neural Radiance Fields (NeRF) paradigm employs a viewer-centered methodology, entangling the aspects of illumination and material reflectance into emission solely from 3D points. This simplified rendering approach presents…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Ziteng Cui , Lin Gu , Xiao Sun , Xianzheng Ma , Yu Qiao , Tatsuya Harada

We propose an application of online hard sample mining for efficient training of Neural Radiance Fields (NeRF). NeRF models produce state-of-the-art quality for many 3D reconstruction and rendering tasks but require substantial…

计算机视觉与模式识别 · 计算机科学 2024-08-07 Juuso Korhonen , Goutham Rangu , Hamed R. Tavakoli , Juho Kannala

In this paper, we address the challenge of generating novel views of real-world objects with limited multi-view images through our proposed approach, FewShotNeRF. Our method utilizes meta-learning to acquire optimal initialization,…

计算机视觉与模式识别 · 计算机科学 2024-08-12 Piraveen Sivakumar , Paul Janson , Jathushan Rajasegaran , Thanuja Ambegoda