中文
相关论文

相关论文: AV-NeRF: Learning Neural Fields for Real-World Aud…

200 篇论文

Virtual Reality (VR) is becoming ubiquitous with the rise of consumer displays and commercial VR platforms. Such displays require low latency and high quality rendering of synthetic imagery with reduced compute overheads. Recent advances in…

图形学 · 计算机科学 2022-07-25 Nianchen Deng , Zhenyi He , Jiannan Ye , Budmonde Duinkharjav , Praneeth Chakravarthula , Xubo Yang , Qi Sun

Recent approaches to render photorealistic views from a limited set of photographs have pushed the boundaries of our interactions with pictures of static scenes. The ability to recreate moments, that is, time-varying sequences, is perhaps…

计算机视觉与模式识别 · 计算机科学 2021-05-14 Chaoyang Wang , Ben Eckart , Simon Lucey , Orazio Gallo

Neural Radiance Fields (NeRF) have transformed novel view synthesis by modeling scene-specific volumetric representations directly from images. While generalizable NeRF models can generate novel views across unknown scenes by learning…

计算机视觉与模式识别 · 计算机科学 2025-05-27 You Wang , Li Fang , Hao Zhu , Fei Hu , Long Ye , Zhan Ma

As a neuromorphic sensor with high temporal resolution, spike cameras offer notable advantages over traditional cameras in high-speed vision applications such as high-speed optical estimation, depth estimation, and object tracking. Inspired…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Yijia Guo , Yuanxi Bai , Liwen Hu , Mianzhi Liu , Ziyi Guo , Lei Ma , Tiejun Huang

Under good conditions, Neural Radiance Fields (NeRFs) have shown impressive results on novel view synthesis tasks. NeRFs learn a scene's color and density fields by minimizing the photometric discrepancy between training views and…

计算机视觉与模式识别 · 计算机科学 2023-11-09 Jamie Wynn , Daniyar Turmukhambetov

Neural Radiance Fields, or NeRFs, have drastically improved novel view synthesis and 3D reconstruction for rendering. NeRFs achieve impressive results on object-centric reconstructions, but the quality of novel view synthesis with…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Georgios Kopanas , George Drettakis

Neural Radiance Field (NeRF) has revolutionized novel-view rendering tasks and achieved impressive results. However, the inefficient sampling and per-scene optimization hinder its wide applications. Though some generalizable NeRFs have been…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Yue Shi , Dingyi Rong , Chang Chen , Chaofan Ma , Bingbing Ni , Wenjun Zhang

The talking head generation recently attracted considerable attention due to its widespread application prospects, especially for digital avatars and 3D animation design. Inspired by this practical demand, several works explored Neural…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Tianyong Wang , Xiangyu Liang , Wangguandong Zheng , Dan Niu , Haifeng Xia , Siyu Xia

Neural rendering combines ideas from classical computer graphics and machine learning to synthesize images from real-world observations. NeRF, short for Neural Radiance Fields, is a recent innovation that uses AI algorithms to create 3D…

计算机视觉与模式识别 · 计算机科学 2024-03-20 AKM Shahariar Azad Rabby , Chengcui Zhang

We present NeRFEditor, an efficient learning framework for 3D scene editing, which takes a video captured over 360{\deg} as input and outputs a high-quality, identity-preserving stylized 3D scene. Our method supports diverse types of…

计算机视觉与模式识别 · 计算机科学 2022-12-09 Chunyi Sun , Yanbin Liu , Junlin Han , Stephen Gould

Neural Radiance Fields (NeRF) have garnered considerable attention as a paradigm for novel view synthesis by learning scene representations from discrete observations. Nevertheless, NeRF exhibit pronounced performance degradation when…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Zelin Gao , Weichen Dai , Yu Zhang

Neural Radiance Fields (NeRF) have recently demonstrated photo-realistic results for the task of novel view synthesis. In this paper, we propose to apply novel view synthesis to the robot relocalization problem: we demonstrate improvement…

计算机视觉与模式识别 · 计算机科学 2021-10-14 Arthur Moreau , Nathan Piasco , Dzmitry Tsishkou , Bogdan Stanciulescu , Arnaud de La Fortelle

Neural Radiance Field (NeRF) models are implicit neural scene representation methods that offer unprecedented capabilities in novel view synthesis. Semantically-aware NeRFs not only capture the shape and radiance of a scene, but also encode…

计算机视觉与模式识别 · 计算机科学 2025-07-24 Yuzhe Zhu , Lile Cai , Kangkang Lu , Fayao Liu , Xulei Yang

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis using differentiable…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Marie-Julie Rakotosaona , Fabian Manhardt , Diego Martin Arroyo , Michael Niemeyer , Abhijit Kundu , Federico Tombari

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Kang Han , Wei Xiang , Lu Yu

Novel view synthesis refers to the problem of synthesizing novel viewpoints of a scene given the images from a few viewpoints. This is a fundamental problem in computer vision and graphics, and enables a vast variety of applications such as…

计算机视觉与模式识别 · 计算机科学 2024-11-25 Nagabhushan Somraj

In this paper, we address the challenge of generating novel views of real-world objects with limited multi-view images through our proposed approach, FewShotNeRF. Our method utilizes meta-learning to acquire optimal initialization,…

计算机视觉与模式识别 · 计算机科学 2024-08-12 Piraveen Sivakumar , Paul Janson , Jathushan Rajasegaran , Thanuja Ambegoda

Creating high-quality and interactive virtual environments, such as games and simulators, often involves complex and costly manual modeling processes. In this paper, we present Video2Game, a novel approach that automatically converts videos…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Hongchi Xia , Zhi-Hao Lin , Wei-Chiu Ma , Shenlong Wang

Neural Radiance Fields (NeRF) have garnered remarkable success in novel view synthesis. Nonetheless, the task of generating high-quality images for novel views persists as a critical challenge. While the existing efforts have exhibited…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Linsheng Chen , Guangrun Wang , Liuchun Yuan , Keze Wang , Ken Deng , Philip H. S. Torr

Neural radiance fields (NeRF) have shown great potentials in representing 3D scenes and synthesizing novel views, but the computational overhead of NeRF at the inference stage is still heavy. To alleviate the burden, we delve into the…

计算机视觉与模式识别 · 计算机科学 2021-12-01 Jiemin Fang , Lingxi Xie , Xinggang Wang , Xiaopeng Zhang , Wenyu Liu , Qi Tian