中文
相关论文

相关论文: Semantic-Aware Implicit Neural Audio-Driven Video …

200 篇论文

This paper investigates the potential of enhancing Neural Radiance Fields (NeRF) with semantics to expand their applications. Although NeRF has been proven useful in real-world applications like VR and digital creation, the lack of…

计算机视觉与模式识别 · 计算机科学 2023-05-26 Xiaokang Chen , Jiaxiang Tang , Diwen Wan , Jingbo Wang , Gang Zeng

We present a method to learn compositional multi-object dynamics models from image observations based on implicit object encoders, Neural Radiance Fields (NeRFs), and graph neural networks. NeRFs have become a popular choice for…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Danny Driess , Zhiao Huang , Yunzhu Li , Russ Tedrake , Marc Toussaint

3D modeling holds significant importance in the realms of AR/VR and gaming, allowing for both artistic creativity and practical applications. However, the process is often time-consuming and demands a high level of skill. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2024-02-28 Eddy Chu , Yiyang Chen , Chedy Raissi , Anand Bhojan

Making generative models 3D-aware bridges the 2D image space and the 3D physical world yet remains challenging. Recent attempts equip a Generative Adversarial Network (GAN) with a Neural Radiance Field (NeRF), which maps 3D coordinates to…

计算机视觉与模式识别 · 计算机科学 2022-04-19 Yinghao Xu , Sida Peng , Ceyuan Yang , Yujun Shen , Bolei Zhou

Neural Radiance Fields (NeRFs) have recently emerged as a popular option for photo-realistic object capture due to their ability to faithfully capture high-fidelity volumetric content even from handheld video input. Although much research…

计算机视觉与模式识别 · 计算机科学 2024-04-24 Binglun Wang , Niladri Shekhar Dutt , Niloy J. Mitra

This paper presents a stylized novel view synthesis method. Applying state-of-the-art stylization methods to novel views frame by frame often causes jittering artifacts due to the lack of cross-view consistency. Therefore, this paper…

计算机视觉与模式识别 · 计算机科学 2022-07-07 Thu Nguyen-Phuoc , Feng Liu , Lei Xiao

The neural radiance fields (NeRF) have advanced the development of 3D volumetric video technology, but the large data volumes they involve pose significant challenges for storage and transmission. To address these problems, the existing…

多媒体 · 计算机科学 2024-11-11 Zhiyu Zhang , Guo Lu , Huanxiong Liang , Zhengxue Cheng , Anni Tang , Li Song

Several variants of Neural Radiance Fields (NeRFs) have significantly improved the accuracy of synthesized images and surface reconstruction of 3D scenes/objects. In all of these methods, a key characteristic is that none can train the…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Gonçalo Dias Pais , Valter Piedade , Moitreya Chatterjee , Marcus Greiff , Pedro Miraldo

Implicit representations such as Neural Radiance Fields (NeRF) have been shown to be very effective at novel view synthesis. However, these models typically require manual and careful human data collection for training. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2023-12-25 Pierre Marza , Laetitia Matignon , Olivier Simonin , Dhruv Batra , Christian Wolf , Devendra Singh Chaplot

Neural rendering techniques combining machine learning with geometric reasoning have arisen as one of the most promising approaches for synthesizing novel views of a scene from a sparse set of images. Among these, stands out the Neural…

计算机视觉与模式识别 · 计算机科学 2020-12-01 Albert Pumarola , Enric Corona , Gerard Pons-Moll , Francesc Moreno-Noguer

In this paper, we propose a Neural Radiance Fields (NeRF) based framework, referred to as Novel View Synthesis Framework (NVSF). It jointly learns the implicit neural representation of space and time-varying scene for both LiDAR and Camera.…

计算机视觉与模式识别 · 计算机科学 2025-06-26 Gaurav Sharma , Ravi Kothari , Josef Schmid

Neural volumetric representations such as Neural Radiance Fields (NeRF) have emerged as a compelling technique for learning to represent 3D scenes from images with the goal of rendering photorealistic images of the scene from unobserved…

计算机视觉与模式识别 · 计算机科学 2021-03-29 Peter Hedman , Pratul P. Srinivasan , Ben Mildenhall , Jonathan T. Barron , Paul Debevec

We propose pixelNeRF, a learning framework that predicts a continuous neural scene representation conditioned on one or few input images. The existing approach for constructing neural radiance fields involves optimizing the representation…

计算机视觉与模式识别 · 计算机科学 2021-06-01 Alex Yu , Vickie Ye , Matthew Tancik , Angjoo Kanazawa

Creating high-quality controllable 3D human models from multi-view RGB videos poses a significant challenge. Neural radiance fields (NeRFs) have demonstrated remarkable quality in reconstructing and free-viewpoint rendering of static as…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Paul Knoll , Wieland Morgenstern , Anna Hilsmann , Peter Eisert

This paper investigates the transmission of three-dimensional (3D) human face content for immersive communication over a rate-constrained transmitter-receiver link. We propose a new framework named NeRF-SeCom, which leverages neural…

图像与视频处理 · 电气工程与系统科学 2024-07-22 Guanlin Wu , Zhonghao Lyu , Juyong Zhang , Jie Xu

Neural radiance field (NeRF), in particular its extension by instant neural graphics primitives, is a novel rendering method for view synthesis that uses real-world images to build photo-realistic immersive virtual scenes. Despite its…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Ke Li , Tim Rolff , Susanne Schmidt , Reinhard Bacher , Simone Frintrop , Wim Leemans , Frank Steinicke

Recent neural view synthesis methods have achieved impressive quality and realism, surpassing classical pipelines which rely on multi-view reconstruction. State-of-the-Art methods, such as NeRF, are designed to learn a single scene with a…

计算机视觉与模式识别 · 计算机科学 2021-04-15 Julian Chibane , Aayush Bansal , Verica Lazova , Gerard Pons-Moll

We present Panoptic Neural Fields (PNF), an object-aware neural scene representation that decomposes a scene into a set of objects (things) and background (stuff). Each object is represented by an oriented 3D bounding box and a multi-layer…

计算机视觉与模式识别 · 计算机科学 2022-05-10 Abhijit Kundu , Kyle Genova , Xiaoqi Yin , Alireza Fathi , Caroline Pantofaru , Leonidas Guibas , Andrea Tagliasacchi , Frank Dellaert , Thomas Funkhouser

We propose a novel framework to reconstruct accurate appearance and geometry with neural radiance fields (NeRF) for interacting hands, enabling the rendering of photo-realistic images and videos for gesture animation from arbitrary views.…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Zhiyang Guo , Wengang Zhou , Min Wang , Li Li , Houqiang Li

Neural Radiance Fields (NeRF) have garnered remarkable success in novel view synthesis. Nonetheless, the task of generating high-quality images for novel views persists as a critical challenge. While the existing efforts have exhibited…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Linsheng Chen , Guangrun Wang , Liuchun Yuan , Keze Wang , Ken Deng , Philip H. S. Torr