中文
相关论文

相关论文: SinGRAF: Learning a 3D Generative Radiance Field f…

200 篇论文

3D-aware generative models have shown that the introduction of 3D information can lead to more controllable image generation. In particular, the current state-of-the-art model GIRAFFE can control each object's rotation, translation, scale,…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Yang Xue , Yuheng Li , Krishna Kumar Singh , Yong Jae Lee

The advent of generative radiance fields has significantly promoted the development of 3D-aware image synthesis. The cumulative rendering process in radiance fields makes training these generative models much easier since gradients are…

计算机视觉与模式识别 · 计算机科学 2021-11-02 Xudong Xu , Xingang Pan , Dahua Lin , Bo Dai

Pose-conditioned convolutional generative models struggle with high-quality 3D-consistent image generation from single-view datasets, due to their lack of sufficient 3D priors. Recently, the integration of Neural Radiance Fields (NeRFs) and…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Mohamad Shahbazi , Evangelos Ntavelis , Alessio Tonioni , Edo Collins , Danda Pani Paudel , Martin Danelljan , Luc Van Gool

3D-aware image synthesis encompasses a variety of tasks, such as scene generation and novel view synthesis from images. Despite numerous task-specific methods, developing a comprehensive model remains challenging. In this paper, we present…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Hansheng Chen , Jiatao Gu , Anpei Chen , Wei Tian , Zhuowen Tu , Lingjie Liu , Hao Su

Despite the rapid development of Neural Radiance Field (NeRF), the necessity of dense covers largely prohibits its wider applications. While several recent works have attempted to address this issue, they either operate with sparse views…

计算机视觉与模式识别 · 计算机科学 2022-08-15 Dejia Xu , Yifan Jiang , Peihao Wang , Zhiwen Fan , Humphrey Shi , Zhangyang Wang

Unsupervised learning of 3D-aware generative adversarial networks (GANs) using only collections of single-view 2D photographs has very recently made much progress. These 3D GANs, however, have not been demonstrated for human bodies and the…

计算机视觉与模式识别 · 计算机科学 2023-01-10 Alexander W. Bergman , Petr Kellnhofer , Wang Yifan , Eric R. Chan , David B. Lindell , Gordon Wetzstein

We present a deep generative scene modeling technique for indoor environments. Our goal is to train a generative model using a feed-forward neural network that maps a prior distribution (e.g., a normal distribution) to the distribution of…

计算机视觉与模式识别 · 计算机科学 2018-08-08 Zaiwei Zhang , Zhenpei Yang , Chongyang Ma , Linjie Luo , Alexander Huth , Etienne Vouga , Qixing Huang

We propose a pipeline to generate Neural Radiance Fields~(NeRF) of an object or a scene of a specific class, conditioned on a single input image. This is a challenging task, as training NeRF requires multiple views of the same scene,…

计算机视觉与模式识别 · 计算机科学 2022-03-01 Shengqu Cai , Anton Obukhov , Dengxin Dai , Luc Van Gool

Differentiable rendering has paved the way to training neural networks to perform "inverse graphics" tasks such as predicting 3D geometry from monocular photographs. To train high performing models, most of the current approaches rely on…

计算机视觉与模式识别 · 计算机科学 2021-04-22 Yuxuan Zhang , Wenzheng Chen , Huan Ling , Jun Gao , Yinan Zhang , Antonio Torralba , Sanja Fidler

Generative models have emerged as an essential building block for many image synthesis and editing tasks. Recent advances in this field have also enabled high-quality 3D or video content to be generated that exhibits either multi-view or…

计算机视觉与模式识别 · 计算机科学 2023-08-10 Sherwin Bahmani , Jeong Joon Park , Despoina Paschalidou , Hao Tang , Gordon Wetzstein , Leonidas Guibas , Luc Van Gool , Radu Timofte

3D-aware image synthesis aims at learning a generative model that can render photo-realistic 2D images while capturing decent underlying 3D shapes. A popular solution is to adopt the generative adversarial network (GAN) and replace the…

计算机视觉与模式识别 · 计算机科学 2022-10-03 Zifan Shi , Yinghao Xu , Yujun Shen , Deli Zhao , Qifeng Chen , Dit-Yan Yeung

Comprehensive 3D scene understanding, both geometrically and semantically, is important for real-world applications such as robot perception. Most of the existing work has focused on developing data-driven discriminative models for scene…

计算机视觉与模式识别 · 计算机科学 2022-06-10 Mingtong Zhang , Shuhong Zheng , Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

We introduce a new generative approach for synthesizing 3D geometry and images from single-view collections. Most existing approaches predict volumetric density to render multi-view consistent images. By employing volumetric rendering using…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Salvatore Esposito , Qingshan Xu , Kacper Kania , Charlie Hewitt , Octave Mariotti , Lohit Petikam , Julien Valentin , Arno Onken , Oisin Mac Aodha

Recent advances in generative visual models and neural radiance fields have greatly boosted 3D-aware image synthesis and stylization tasks. However, previous NeRF-based work is limited to single scene stylization, training a model to…

计算机视觉与模式识别 · 计算机科学 2024-04-29 Zichen Tang , Hongyu Yang

The creation of complex 3D scenes tailored to user specifications has been a tedious and challenging task with traditional 3D modeling tools. Although some pioneering methods have achieved automatic text-to-3D generation, they are generally…

计算机视觉与模式识别 · 计算机科学 2025-05-09 Xiuyu Yang , Yunze Man , Jun-Kun Chen , Yu-Xiong Wang

While recent NeRF-based generative models achieve the generation of diverse 3D-aware images, these approaches have limitations when generating images that contain user-specified characteristics. In this paper, we propose a novel model,…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Kyungmin Jo , Gyumin Shim , Sanghun Jung , Soyoung Yang , Jaegul Choo

In recent years, 3D generation has made great strides in both academia and industry. However, generating 3D scenes from a single RGB image remains a significant challenge, as current approaches often struggle to ensure both object…

图形学 · 计算机科学 2026-02-18 Xiang Tang , Ruotong Li , Xiaopeng Fan

Text-driven 3D scene generation techniques have made rapid progress in recent years. Their success is mainly attributed to using existing generative models to iteratively perform image warping and inpainting to generate 3D scenes. However,…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Frank Zhang , Yibo Zhang , Quan Zheng , Rui Ma , Wei Hua , Hujun Bao , Weiwei Xu , Changqing Zou

The field of self-supervised 3D representation learning has emerged as a promising solution to alleviate the challenge presented by the scarcity of extensive, well-annotated datasets. However, it continues to be hindered by the lack of…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Yunsong Wang , Na Zhao , Gim Hee Lee

Neural Radiance Fields (NeRF) have shown impressive novel view synthesis results; nonetheless, even thorough recordings yield imperfections in reconstructions, for instance due to poorly observed areas or minor lighting changes. Our goal is…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Barbara Roessle , Norman Müller , Lorenzo Porzi , Samuel Rota Bulò , Peter Kontschieder , Matthias Nießner