中文
相关论文

相关论文: Likelihood-Based Generative Radiance Field with La…

200 篇论文

Generative Neural Radiance Field (GNeRF) models, which extract implicit 3D representations from 2D images, have recently been shown to produce realistic images representing rigid/semi-rigid objects, such as human faces or cars. However,…

计算机视觉与模式识别 · 计算机科学 2022-07-19 Jichao Zhang , Enver Sangineto , Hao Tang , Aliaksandr Siarohin , Zhun Zhong , Nicu Sebe , Wei Wang

Neural scene representations, such as Neural Radiance Fields (NeRF), are based on training a multilayer perceptron (MLP) using a set of color images with known poses. An increasing number of devices now produce RGB-D(color + depth)…

计算机视觉与模式识别 · 计算机科学 2022-11-08 Arnab Dey , Yassine Ahmine , Andrew I. Comport

Dynamic Neural Radiance Fields (NeRFs) achieve remarkable visual quality when synthesizing novel views of time-evolving 3D scenes. However, the common reliance on backward deformation fields makes reanimation of the captured object poses…

计算机视觉与模式识别 · 计算机科学 2024-02-12 Lukas Uzolas , Elmar Eisemann , Petr Kellnhofer

Neural radiance fields (NeRF) is a promising approach for generating photorealistic images and representing complex scenes. However, when processing data sequentially, it can suffer from catastrophic forgetting, where previous data is…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Letian Zhang , Ming Li , Chen Chen , Jie Xu

We propose a novel framework for 3D-aware object manipulation, called Auto-Encoding Neural Radiance Fields (AE-NeRF). Our model, which is formulated in an auto-encoder architecture, extracts disentangled 3D attributes such as 3D shape,…

计算机视觉与模式识别 · 计算机科学 2022-04-29 Mira Kim , Jaehoon Ko , Kyusun Cho , Junmyeong Choi , Daewon Choi , Seungryong Kim

Traditional 3D face models are based on mesh representations with texture. One of the most important models is FLAME (Faces Learned with an Articulated Model and Expressions), which produces meshes of human faces that are fully…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Wojciech Zając , Joanna Waczyńska , Piotr Borycki , Jacek Tabor , Maciej Zięba , Przemysław Spurek

This survey aims to investigate fundamental deep learning (DL) based 3D reconstruction techniques that produce photo-realistic 3D models and scenes, highlighting Neural Radiance Fields (NeRFs), Latent Diffusion Models (LDM), and 3D Gaussian…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Yonge Bai , LikHang Wong , TszYin Twan

We present Neural Articulated Radiance Field (NARF), a novel deformable 3D representation for articulated objects learned from images. While recent advances in 3D implicit representation have made it possible to learn models of complex…

计算机视觉与模式识别 · 计算机科学 2021-08-19 Atsuhiro Noguchi , Xiao Sun , Stephen Lin , Tatsuya Harada

We present neural radiance fields (NeRF) with templates, dubbed Template-NeRF, for modeling appearance and geometry and generating dense shape correspondences simultaneously among objects of the same category from only multi-view posed…

计算机视觉与模式识别 · 计算机科学 2021-11-09 Jianfei Guo , Zhiyuan Yang , Xi Lin , Qingfu Zhang

3D reconstruction technology generates three-dimensional representations of real-world objects, scenes, or environments using sensor data such as 2D images, with extensive applications in robotics, autonomous vehicles, and virtual reality…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Hong Zhang , Fei Guo , Zihan Xie , Dizhao Yao

The talking head generation recently attracted considerable attention due to its widespread application prospects, especially for digital avatars and 3D animation design. Inspired by this practical demand, several works explored Neural…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Tianyong Wang , Xiangyu Liang , Wangguandong Zheng , Dan Niu , Haifeng Xia , Siyu Xia

We propose pixelNeRF, a learning framework that predicts a continuous neural scene representation conditioned on one or few input images. The existing approach for constructing neural radiance fields involves optimizing the representation…

计算机视觉与模式识别 · 计算机科学 2021-06-01 Alex Yu , Vickie Ye , Matthew Tancik , Angjoo Kanazawa

We introduce Neural Radiance and Gaze Fields (NeRGs), a novel approach for representing visual attention in complex environments. Much like how Neural Radiance Fields (NeRFs) perform novel view synthesis, NeRGs reconstruct gaze patterns…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Andrei Chubarau , Yinan Wang , James J. Clark

Neural radiance fields (NeRFs) produce state-of-the-art view synthesis results. However, they are slow to render, requiring hundreds of network evaluations per pixel to approximate a volume rendering integral. Baking NeRFs into explicit…

计算机视觉与模式识别 · 计算机科学 2022-05-11 Benjamin Attal , Jia-Bin Huang , Michael Zollhoefer , Johannes Kopf , Changil Kim

We present High Dynamic Range Neural Radiance Fields (HDR-NeRF) to recover an HDR radiance field from a set of low dynamic range (LDR) views with different exposures. Using the HDR-NeRF, we are able to generate both novel HDR views and…

计算机视觉与模式识别 · 计算机科学 2023-04-26 Xin Huang , Qi Zhang , Ying Feng , Hongdong Li , Xuan Wang , Qing Wang

Existing methods for relightable view synthesis -- using a set of images of an object under unknown lighting to recover a 3D representation that can be rendered from novel viewpoints under a target illumination -- are based on inverse…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Xiaoming Zhao , Pratul P. Srinivasan , Dor Verbin , Keunhong Park , Ricardo Martin Brualla , Philipp Henzler

The recent surge in popularity of deep generative models for 3D objects has highlighted the need for more efficient training methods, particularly given the difficulties associated with training with conventional 3D representations, such as…

计算机视觉与模式识别 · 计算机科学 2024-08-23 Adam Kania , Artur Kasymov , Jakub Kościukiewicz , Artur Górak , Marcin Mazur , Maciej Zięba , Przemysław Spurek

We aim to improve the Inverted Neural Radiance Fields (iNeRF) algorithm which defines the image pose estimation problem as a NeRF based iterative linear optimization. NeRFs are novel neural space representation models that can synthesize…

计算机视觉与模式识别 · 计算机科学 2023-10-06 Ágoston István Csehi , Csaba Máté Józsa

Previous portrait image generation methods roughly fall into two categories: 2D GANs and 3D-aware GANs. 2D GANs can generate high fidelity portraits but with low view consistency. 3D-aware GAN methods can maintain view consistency but their…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Jingxiang Sun , Xuan Wang , Yong Zhang , Xiaoyu Li , Qi Zhang , Yebin Liu , Jue Wang

We propose a probabilistic generative model for unsupervised learning of structured, interpretable, object-based representations of visual scenes. We use amortized variational inference to train the generative model end-to-end. The learned…

机器学习 · 计算机科学 2019-09-30 Andrea Dittadi , Ole Winther