English
Related papers

Related papers: BallGAN: 3D-aware Image Synthesis with a Spherical…

200 papers

3D-aware image synthesis aims at learning a generative model that can render photo-realistic 2D images while capturing decent underlying 3D shapes. A popular solution is to adopt the generative adversarial network (GAN) and replace the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Zifan Shi , Yinghao Xu , Yujun Shen , Deli Zhao , Qifeng Chen , Dit-Yan Yeung

While recent 3D-aware generative models have shown photo-realistic image synthesis with multi-view consistency, the synthesized image quality degrades depending on the camera pose (e.g., a face with a blurry and noisy boundary at a side…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Kyungmin Jo , Wonjoon Jin , Jaegul Choo , Hyunjoon Lee , Sunghyun Cho

Foreground-aware image synthesis aims to generate images as well as their foreground masks. A common approach is to formulate an image as an masked blending of a foreground image and a background image. It is a challenging problem because…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Jeongmin Bae , Mingi Kwon , Youngjung Uh

Existing 3D-aware portrait synthesis methods can generate impressive high-quality images while preserving strong 3D consistency. However, most of them cannot support the fine-grained part-level control over synthesized images. Conversely,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Ruiqi Liu , Peng Zheng , Ye Wang , Rui Ma

Unsupervised generation of high-quality multi-view-consistent images and 3D shapes using only collections of single-view 2D photographs has been a long-standing challenge. Existing 3D GANs are either compute-intensive or make approximations…

Making generative models 3D-aware bridges the 2D image space and the 3D physical world yet remains challenging. Recent attempts equip a Generative Adversarial Network (GAN) with a Neural Radiance Field (NeRF), which maps 3D coordinates to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Yinghao Xu , Sida Peng , Ceyuan Yang , Yujun Shen , Bolei Zhou

Recent advances in generative adversarial networks (GANs) have achieved great success in automated image composition that generates new images by embedding interested foreground objects into background images automatically. On the other…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Changgong Zhang , Fangneng Zhan , Shijian Lu , Feiying Ma , Xuansong Xie

Recent advances in generative adversarial networks (GANs) have shown great potentials in realistic image synthesis whereas most existing works address synthesis realism in either appearance space or geometry space but few in both. This…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Fangneng Zhan , Hongyuan Zhu , Shijian Lu

3D-aware image synthesis aims to generate images of objects from multiple views by learning a 3D representation. However, one key challenge remains: existing approaches lack geometry constraints, hence usually fail to generate multi-view…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Xuanmeng Zhang , Zhedong Zheng , Daiheng Gao , Bang Zhang , Pan Pan , Yi Yang

Modern 3D-GANs synthesize geometry and texture by training on large-scale datasets with a consistent structure. Training such models on stylized, artistic data, with often unknown, highly variable geometry, and camera information has not…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Rameen Abdal , Hsin-Ying Lee , Peihao Zhu , Menglei Chai , Aliaksandr Siarohin , Peter Wonka , Sergey Tulyakov

We propose a framework, called LiftedGAN, that disentangles and lifts a pre-trained StyleGAN2 for 3D-aware face generation. Our model is "3D-aware" in the sense that it is able to (1) disentangle the latent space of StyleGAN2 into texture,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Yichun Shi , Divyansh Aggarwal , Anil K. Jain

3D-aware image synthesis has attracted increasing interest as it models the 3D nature of our real world. However, performing realistic object-level editing of the generated images in the multi-object scenario still remains a challenge.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Qian Wang , Yiqun Wang , Michael Birsak , Peter Wonka

We introduce 3inGAN, an unconditional 3D generative model trained from 2D images of a single self-similar 3D scene. Such a model can be used to produce 3D "remixes" of a given scene, by mapping spatial latent codes into a 3D volumetric…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Animesh Karnewar , Oliver Wang , Tobias Ritschel , Niloy Mitra

Generative Adversarial Networks (GANs) have gained significant attention in several computer vision tasks for generating high-quality synthetic data. Various medical applications including diagnostic imaging and radiation therapy can…

Image and Video Processing · Electrical Eng. & Systems 2022-07-25 Sanaz Mohammadjafari , Mucahit Cevik , Ayse Basar

While recent advances in 3D-aware Generative Adversarial Networks (GANs) have aided the development of near-frontal view human face synthesis, the challenge of comprehensively synthesizing a full 3D head viewable from all angles still…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Heyuan Li , Ce Chen , Tianhao Shi , Yuda Qiu , Sizhe An , Guanying Chen , Xiaoguang Han

Generative Adversarial Networks (GANs) have become the de-facto standard in image synthesis. However, without considering the foreground-background decomposition, existing GANs tend to capture excessive content correlation between…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Kaiwen Cui , Gongjie Zhang , Fangneng Zhan , Jiaxing Huang , Shijian Lu

Recently, 3D GANs based on 3D Gaussian splatting have been proposed for high quality synthesis of human heads. However, existing methods stabilize training and enhance rendering quality from steep viewpoints by conditioning the random…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Florian Barthel , Wieland Morgenstern , Paul Hinzer , Anna Hilsmann , Peter Eisert

Synthesis and reconstruction of 3D human head has gained increasing interests in computer vision and computer graphics recently. Existing state-of-the-art 3D generative adversarial networks (GANs) for 3D human head synthesis are either…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Sizhe An , Hongyi Xu , Yichun Shi , Guoxian Song , Umit Ogras , Linjie Luo

3D-aware Generative Adversarial Networks (GANs) have shown remarkable progress in learning to generate multi-view-consistent images and 3D geometries of scenes from collections of 2D images via neural volume rendering. Yet, the significant…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Alex Trevithick , Matthew Chan , Towaki Takikawa , Umar Iqbal , Shalini De Mello , Manmohan Chandraker , Ravi Ramamoorthi , Koki Nagano

Despite the recent advancement of Generative Adversarial Networks (GANs) in learning 3D-aware image synthesis from 2D data, existing methods fail to model indoor scenes due to the large diversity of room layouts and the objects inside. We…

Computer Vision and Pattern Recognition · Computer Science 2022-02-21 Zifan Shi , Yujun Shen , Jiapeng Zhu , Dit-Yan Yeung , Qifeng Chen
‹ Prev 1 2 3 10 Next ›