中文
相关论文

相关论文: Generative Deformable Radiance Fields for Disentan…

200 篇论文

Image blending aims to combine multiple images seamlessly. It remains challenging for existing 2D-based methods, especially when input images are misaligned due to differences in 3D camera poses and object shapes. To tackle these issues, we…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Hyunsu Kim , Gayoung Lee , Yunjey Choi , Jin-Hwa Kim , Jun-Yan Zhu

Generative Neural Radiance Field (GNeRF) models, which extract implicit 3D representations from 2D images, have recently been shown to produce realistic images representing rigid/semi-rigid objects, such as human faces or cars. However,…

计算机视觉与模式识别 · 计算机科学 2022-07-19 Jichao Zhang , Enver Sangineto , Hao Tang , Aliaksandr Siarohin , Zhun Zhong , Nicu Sebe , Wei Wang

The utilization of the triplane-based radiance fields has gained attention in recent years due to its ability to effectively disentangle 3D scenes with a high-quality representation and low computation cost. A key requirement of this method…

计算机视觉与模式识别 · 计算机科学 2024-09-25 Shihe Shen , Huachen Gao , Wangze Xu , Rui Peng , Luyang Tang , Kaiqiang Xiong , Jianbo Jiao , Ronggang Wang

Collecting accurate camera poses of training images has been shown to well serve the learning of 3D-aware generative adversarial networks (GANs) yet can be quite expensive in practice. This work targets learning 3D-aware GANs from unposed…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Xinya Chen , Hanlei Guo , Yanrui Bin , Shangzhan Zhang , Yuanbo Yang , Yue Wang , Yujun Shen , Yiyi Liao

3D-aware generative adversarial networks (GANs) synthesize high-fidelity and multi-view-consistent facial images using only collections of single-view 2D imagery. Towards fine-grained control over facial attributes, recent efforts…

计算机视觉与模式识别 · 计算机科学 2023-03-14 Jingxiang Sun , Xuan Wang , Lizhen Wang , Xiaoyu Li , Yong Zhang , Hongwen Zhang , Yebin Liu

Generative Neural Radiance Fields (NeRFs) have demonstrated remarkable proficiency in synthesizing multi-view images by learning the distribution of a set of unposed images. Despite the aptitude of existing generative NeRFs in generating…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Kanghyeok Ko , Minhyeok Lee

Recently, Neural Radiance Fields (NeRF) is revolutionizing the task of novel view synthesis (NVS) for its superior performance. In this paper, we propose to synthesize dynamic scenes. Extending the methods for static scenes to dynamic…

计算机视觉与模式识别 · 计算机科学 2022-10-12 Xiang Guo , Guanying Chen , Yuchao Dai , Xiaoqing Ye , Jiadai Sun , Xiao Tan , Errui Ding

We present neural radiance fields (NeRF) with templates, dubbed Template-NeRF, for modeling appearance and geometry and generating dense shape correspondences simultaneously among objects of the same category from only multi-view posed…

计算机视觉与模式识别 · 计算机科学 2021-11-09 Jianfei Guo , Zhiyuan Yang , Xi Lin , Qingfu Zhang

We present a deformable generator model to disentangle the appearance and geometric information for both image and video data in a purely unsupervised manner. The appearance generator network models the information related to appearance,…

机器学习 · 计算机科学 2023-10-09 Xianglei Xing , Ruiqi Gao , Tian Han , Song-Chun Zhu , Ying Nian Wu

This paper addresses the challenge of reconstructing an animatable human model from a multi-view video. Some recent works have proposed to decompose a non-rigidly deforming scene into a canonical neural radiance field and a set of…

计算机视觉与模式识别 · 计算机科学 2021-10-08 Sida Peng , Junting Dong , Qianqian Wang , Shangzhan Zhang , Qing Shuai , Xiaowei Zhou , Hujun Bao

Emerging neural radiance fields (NeRF) are a promising scene representation for computer graphics, enabling high-quality 3D reconstruction and novel view synthesis from image observations. However, editing a scene represented by a NeRF is…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Sosuke Kobayashi , Eiichi Matsumoto , Vincent Sitzmann

While recent NeRF-based generative models achieve the generation of diverse 3D-aware images, these approaches have limitations when generating images that contain user-specified characteristics. In this paper, we propose a novel model,…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Kyungmin Jo , Gyumin Shim , Sanghun Jung , Soyoung Yang , Jaegul Choo

The advancement of generative radiance fields has pushed the boundary of 3D-aware image synthesis. Motivated by the observation that a 3D object should look realistic from multiple viewpoints, these methods introduce a multi-view constraint…

计算机视觉与模式识别 · 计算机科学 2021-12-10 Xingang Pan , Xudong Xu , Chen Change Loy , Christian Theobalt , Bo Dai

Neural Radiance Fields (NeRF) coupled with GANs represent a promising direction in the area of 3D reconstruction from a single view, owing to their ability to efficiently model arbitrary topologies. Recent work in this area, however, has…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Dario Pavllo , David Joseph Tan , Marie-Julie Rakotosaona , Federico Tombari

In recent years, novel view synthesis has gained popularity in generating high-fidelity images. While demonstrating superior performance in the task of synthesizing novel views, the majority of these methods are still based on the…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Xiaoyan Yang , Dingbo Lu , Yang Li , Chenhui Li , Changbo Wang

Pose-conditioned convolutional generative models struggle with high-quality 3D-consistent image generation from single-view datasets, due to their lack of sufficient 3D priors. Recently, the integration of Neural Radiance Fields (NeRFs) and…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Mohamad Shahbazi , Evangelos Ntavelis , Alessio Tonioni , Edo Collins , Danda Pani Paudel , Martin Danelljan , Luc Van Gool

While remarkable success has been achieved through diffusion-based 3D generative models for shapes, 4D generative modeling remains challenging due to the complexity of object deformations over time. We propose DNF, a new 4D representation…

计算机视觉与模式识别 · 计算机科学 2024-12-09 Xinyi Zhang , Naiqi Li , Angela Dai

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

计算机视觉与模式识别 · 计算机科学 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

Recent methods for synthesizing 3D-aware face images have achieved rapid development thanks to neural radiance fields, allowing for high quality and fast inference speed. However, existing solutions for editing facial geometry and…

图形学 · 计算机科学 2022-11-16 Kaiwen Jiang , Shu-Yu Chen , Feng-Lin Liu , Hongbo Fu , Lin Gao

3D-consistent image generation from a single 2D semantic label is an important and challenging research topic in computer graphics and computer vision. Although some related works have made great progress in this field, most of the existing…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Bo Li , Yi-ke Li , Zhi-fen He , Bin Liu , Yun-Kun Lai