English
Related papers

Related papers: gCoRF: Generative Compositional Radiance Fields

200 papers

Given large amount of real photos for training, Convolutional neural network shows excellent performance on object recognition tasks. However, the process of collecting data is so tedious and the background are also limited which makes it…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Yida Wang , Weihong Deng

3D-consistent image generation from a single 2D semantic label is an important and challenging research topic in computer graphics and computer vision. Although some related works have made great progress in this field, most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Bo Li , Yi-ke Li , Zhi-fen He , Bin Liu , Yun-Kun Lai

Recent breakthroughs in text-guided image generation have significantly advanced the field of 3D generation. While generating a single high-quality 3D object is now feasible, generating multiple objects with reasonable interactions within a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Chongjian Ge , Chenfeng Xu , Yuanfeng Ji , Chensheng Peng , Masayoshi Tomizuka , Ping Luo , Mingyu Ding , Varun Jampani , Wei Zhan

We introduce GAUDI, a generative model capable of capturing the distribution of complex and realistic 3D scenes that can be rendered immersively from a moving camera. We tackle this challenging problem with a scalable yet powerful approach,…

Data-driven generative modeling has made remarkable progress by leveraging the power of deep neural networks. A reoccurring challenge is how to enable a model to generate a rich variety of samples from the entire target distribution, rather…

Graphics · Computer Science 2019-09-04 Nadav Schor , Oren Katzir , Hao Zhang , Daniel Cohen-Or

Inverse graphics aims to recover 3D models from 2D observations. Utilizing differentiable rendering, recent 3D-aware generative models have shown impressive results of rigid object generation using 2D images. However, it remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Fangzhou Hong , Zhaoxi Chen , Yushi Lan , Liang Pan , Ziwei Liu

Current generative frameworks use end-to-end learning and generate images by sampling from uniform noise distribution. However, these approaches ignore the most basic principle of image formation: images are product of: (a) Structure: the…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Xiaolong Wang , Abhinav Gupta

Learning how to model complex scenes in a modular way with recombinable components is a pre-requisite for higher-order reasoning and acting in the physical world. However, current generative models lack the ability to capture the inherently…

Machine Learning · Statistics 2020-04-28 Julius von Kügelgen , Ivan Ustyuzhaninov , Peter Gehler , Matthias Bethge , Bernhard Schölkopf

Generative models have emerged as an essential building block for many image synthesis and editing tasks. Recent advances in this field have also enabled high-quality 3D or video content to be generated that exhibits either multi-view or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Sherwin Bahmani , Jeong Joon Park , Despoina Paschalidou , Hao Tang , Gordon Wetzstein , Leonidas Guibas , Luc Van Gool , Radu Timofte

Recent 3D Gaussian Splatting (3DGS) GANs for human heads synthesize and render photorealistic 3D models in real-time and offer a vast variety in identity and appearance. However, controlling specific semantic attributes such as hair color…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Florian Barthel , Shalini De Mello , Koki Nagano , Wieland Morgenstern , Anna Hilsmann , Peter Eisert

While recent generative models for 2D images achieve impressive visual results, they clearly lack the ability to perform 3D reasoning. This heavily restricts the degree of control over generated objects as well as the possible applications…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Dario Pavllo , Graham Spinks , Thomas Hofmann , Marie-Francine Moens , Aurelien Lucchi

The visual world is fundamentally compositional. Visual scenes are defined by the composition of objects and their relations. Hence, it is essential for computer vision systems to reflect and exploit this compositionality to achieve robust…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Shuhao Fu , Andrew Jun Lee , Anna Wang , Ida Momennejad , Trevor Bihl , Hongjing Lu , Taylor W. Webb

Pose-conditioned convolutional generative models struggle with high-quality 3D-consistent image generation from single-view datasets, due to their lack of sufficient 3D priors. Recently, the integration of Neural Radiance Fields (NeRFs) and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Mohamad Shahbazi , Evangelos Ntavelis , Alessio Tonioni , Edo Collins , Danda Pani Paudel , Martin Danelljan , Luc Van Gool

We present 3DGH, an unconditional generative model for 3D human heads with composable hair and face components. Unlike previous work that entangles the modeling of hair and face, we propose to separate them using a novel data representation…

Impressive progress in generative models and implicit representations gave rise to methods that can generate 3D shapes of high quality. However, being able to locally control and edit shapes is another essential property that can unlock…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Konstantinos Tertikas , Despoina Paschalidou , Boxiao Pan , Jeong Joon Park , Mikaela Angelina Uy , Ioannis Emiris , Yannis Avrithis , Leonidas Guibas

We study the problem of 3D object generation. We propose a novel framework, namely 3D Generative Adversarial Network (3D-GAN), which generates 3D objects from a probabilistic space by leveraging recent advances in volumetric convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-01-05 Jiajun Wu , Chengkai Zhang , Tianfan Xue , William T. Freeman , Joshua B. Tenenbaum

In recent years, Generative Adversarial Networks have become ubiquitous in both research and public perception, but how GANs convert an unstructured latent code to a high quality output is still an open question. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Lucy Chai , Jonas Wulff , Phillip Isola

Recent advances in 3D scene generation produce visually appealing output, but current representations hinder artists' workflows that require modifiable 3D textured mesh scenes for visual effects and game development. Despite significant…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Tobias Sautter , Jan-Niklas Dihlmann , Hendrik P. A. Lensch

Neural fields have recently enjoyed great success in representing and rendering 3D scenes. However, most state-of-the-art implicit representations model static or dynamic scenes as a whole, with minor variations. Existing work on learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Akshay Krishnan , Amit Raj , Xianling Zhang , Alexandra Carlson , Nathan Tseng , Sandhya Sridhar , Nikita Jaipuria , James Hays

Recent progress in deep generative models has led to tremendous breakthroughs in image generation. However, while existing models can synthesize photorealistic images, they lack an understanding of our underlying 3D world. We present a new…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Jun-Yan Zhu , Zhoutong Zhang , Chengkai Zhang , Jiajun Wu , Antonio Torralba , Joshua B. Tenenbaum , William T. Freeman