English
Related papers

Related papers: AV-NeRF: Learning Neural Fields for Real-World Aud…

200 papers

Virtual Reality (VR) is becoming ubiquitous with the rise of consumer displays and commercial VR platforms. Such displays require low latency and high quality rendering of synthetic imagery with reduced compute overheads. Recent advances in…

Graphics · Computer Science 2022-07-25 Nianchen Deng , Zhenyi He , Jiannan Ye , Budmonde Duinkharjav , Praneeth Chakravarthula , Xubo Yang , Qi Sun

Recent approaches to render photorealistic views from a limited set of photographs have pushed the boundaries of our interactions with pictures of static scenes. The ability to recreate moments, that is, time-varying sequences, is perhaps…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Chaoyang Wang , Ben Eckart , Simon Lucey , Orazio Gallo

Neural Radiance Fields (NeRF) have transformed novel view synthesis by modeling scene-specific volumetric representations directly from images. While generalizable NeRF models can generate novel views across unknown scenes by learning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 You Wang , Li Fang , Hao Zhu , Fei Hu , Long Ye , Zhan Ma

As a neuromorphic sensor with high temporal resolution, spike cameras offer notable advantages over traditional cameras in high-speed vision applications such as high-speed optical estimation, depth estimation, and object tracking. Inspired…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yijia Guo , Yuanxi Bai , Liwen Hu , Mianzhi Liu , Ziyi Guo , Lei Ma , Tiejun Huang

Under good conditions, Neural Radiance Fields (NeRFs) have shown impressive results on novel view synthesis tasks. NeRFs learn a scene's color and density fields by minimizing the photometric discrepancy between training views and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Jamie Wynn , Daniyar Turmukhambetov

Neural Radiance Fields, or NeRFs, have drastically improved novel view synthesis and 3D reconstruction for rendering. NeRFs achieve impressive results on object-centric reconstructions, but the quality of novel view synthesis with…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Georgios Kopanas , George Drettakis

Neural Radiance Field (NeRF) has revolutionized novel-view rendering tasks and achieved impressive results. However, the inefficient sampling and per-scene optimization hinder its wide applications. Though some generalizable NeRFs have been…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yue Shi , Dingyi Rong , Chang Chen , Chaofan Ma , Bingbing Ni , Wenjun Zhang

The talking head generation recently attracted considerable attention due to its widespread application prospects, especially for digital avatars and 3D animation design. Inspired by this practical demand, several works explored Neural…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Tianyong Wang , Xiangyu Liang , Wangguandong Zheng , Dan Niu , Haifeng Xia , Siyu Xia

Neural rendering combines ideas from classical computer graphics and machine learning to synthesize images from real-world observations. NeRF, short for Neural Radiance Fields, is a recent innovation that uses AI algorithms to create 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 AKM Shahariar Azad Rabby , Chengcui Zhang

We present NeRFEditor, an efficient learning framework for 3D scene editing, which takes a video captured over 360{\deg} as input and outputs a high-quality, identity-preserving stylized 3D scene. Our method supports diverse types of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Chunyi Sun , Yanbin Liu , Junlin Han , Stephen Gould

Neural Radiance Fields (NeRF) have garnered considerable attention as a paradigm for novel view synthesis by learning scene representations from discrete observations. Nevertheless, NeRF exhibit pronounced performance degradation when…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Zelin Gao , Weichen Dai , Yu Zhang

Neural Radiance Fields (NeRF) have recently demonstrated photo-realistic results for the task of novel view synthesis. In this paper, we propose to apply novel view synthesis to the robot relocalization problem: we demonstrate improvement…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Arthur Moreau , Nathan Piasco , Dzmitry Tsishkou , Bogdan Stanciulescu , Arnaud de La Fortelle

Neural Radiance Field (NeRF) models are implicit neural scene representation methods that offer unprecedented capabilities in novel view synthesis. Semantically-aware NeRFs not only capture the shape and radiance of a scene, but also encode…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Yuzhe Zhu , Lile Cai , Kangkang Lu , Fayao Liu , Xulei Yang

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis using differentiable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Marie-Julie Rakotosaona , Fabian Manhardt , Diego Martin Arroyo , Michael Niemeyer , Abhijit Kundu , Federico Tombari

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Kang Han , Wei Xiang , Lu Yu

Novel view synthesis refers to the problem of synthesizing novel viewpoints of a scene given the images from a few viewpoints. This is a fundamental problem in computer vision and graphics, and enables a vast variety of applications such as…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Nagabhushan Somraj

In this paper, we address the challenge of generating novel views of real-world objects with limited multi-view images through our proposed approach, FewShotNeRF. Our method utilizes meta-learning to acquire optimal initialization,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Piraveen Sivakumar , Paul Janson , Jathushan Rajasegaran , Thanuja Ambegoda

Creating high-quality and interactive virtual environments, such as games and simulators, often involves complex and costly manual modeling processes. In this paper, we present Video2Game, a novel approach that automatically converts videos…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Hongchi Xia , Zhi-Hao Lin , Wei-Chiu Ma , Shenlong Wang

Neural Radiance Fields (NeRF) have garnered remarkable success in novel view synthesis. Nonetheless, the task of generating high-quality images for novel views persists as a critical challenge. While the existing efforts have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Linsheng Chen , Guangrun Wang , Liuchun Yuan , Keze Wang , Ken Deng , Philip H. S. Torr

Neural radiance fields (NeRF) have shown great potentials in representing 3D scenes and synthesizing novel views, but the computational overhead of NeRF at the inference stage is still heavy. To alleviate the burden, we delve into the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Jiemin Fang , Lingxi Xie , Xinggang Wang , Xiaopeng Zhang , Wenyu Liu , Qi Tian