English
Related papers

Related papers: Improving 3D-aware Image Synthesis with A Geometry…

200 papers

Generative adversarial networks (GANs) are a class of unsupervised machine learning algorithms that can produce realistic images from randomly-sampled vectors in a multi-dimensional space. Until recently, it was not possible to generate…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Andrew Beers , James Brown , Ken Chang , J. Peter Campbell , Susan Ostmo , Michael F. Chiang , Jayashree Kalpathy-Cramer

One popular generative model that has high-quality results is the Generative Adversarial Networks(GAN). This type of architecture consists of two separate networks that play against each other. The generator creates an output from the input…

Machine Learning · Computer Science 2018-02-22 Arjun Karuvally

We propose StyleNeRF, a 3D-aware generative model for photo-realistic high-resolution image synthesis with high multi-view consistency, which can be trained on unstructured 2D images. Existing approaches either cannot synthesize…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Jiatao Gu , Lingjie Liu , Peng Wang , Christian Theobalt

Generative adversarial networks (GANs) have emerged as a powerful unsupervised method to model the statistical patterns of real-world data sets, such as natural images. These networks are trained to map random inputs in their latent space…

Machine Learning · Computer Science 2021-03-19 Binxu Wang , Carlos R. Ponce

Generative Adversarial Networks (GANs) produce impressive results on unconditional image generation when powered with large-scale image datasets. Yet generated images are still easy to spot especially on datasets with high variance (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Ning Yu , Guilin Liu , Aysegul Dundar , Andrew Tao , Bryan Catanzaro , Larry Davis , Mario Fritz

Recently, a surge of high-quality 3D-aware GANs have been proposed, which leverage the generative power of neural rendering. It is natural to associate 3D GANs with GAN inversion methods to project a real image into the generator's latent…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Fei Yin , Yong Zhang , Xuan Wang , Tengfei Wang , Xiaoyu Li , Yuan Gong , Yanbo Fan , Xiaodong Cun , Ying Shan , Cengiz Oztireli , Yujiu Yang

With the recent advances in NeRF-based 3D aware GANs quality, projecting an image into the latent space of these 3D-aware GANs has a natural advantage over 2D GAN inversion: not only does it allow multi-view consistent editing of the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Jaehoon Ko , Kyusun Cho , Daewon Choi , Kwangrok Ryoo , Seungryong Kim

For humans, visual understanding is inherently generative: given a 3D shape, we can postulate how it would look in the world; given a 2D image, we can infer the 3D structure that likely gave rise to it. We can thus translate between the 2D…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Tristan Aumentado-Armstrong , Alex Levinshtein , Stavros Tsogkas , Konstantinos G. Derpanis , Allan D. Jepson

In recent years, research on image generation methods has been developing fast. The auto-encoding variational Bayes method (VAEs) was proposed in 2013, which uses variational inference to learn a latent space from the image database and…

Computer Vision and Pattern Recognition · Computer Science 2018-07-12 Guoqiang Zhong , Wei Gao , Yongbin Liu , Youzhao Yang

The remarkable progress in neural-network-driven visual data generation, especially with neural rendering techniques like Neural Radiance Fields and 3D Gaussian splatting, offers a powerful alternative to GANs and diffusion models. These…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Chengdong Dong , Vijayakumar Bhagavatula , Zhenyu Zhou , Ajay Kumar

Over the past few years, Generative Adversarial Networks (GANs) have garnered increased interest among researchers in Computer Vision, with applications including, but not limited to, image generation, translation, imputation, and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Stylianos Moschoglou , Stylianos Ploumpis , Mihalis Nicolaou , Athanasios Papaioannou , Stefanos Zafeiriou

Generative Adversarial Networks (GANs) triggered an increased interest in problem of image generation due to their improved output image quality and versatility for expansion towards new methods. Numerous GAN-based works attempt to improve…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Gulcin Baykal , Gozde Unal

We propose a novel generative adversarial network (GAN) for the task of unsupervised learning of 3D representations from natural images. Most generative models rely on 2D kernels to generate images and make few assumptions about the 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Thu Nguyen-Phuoc , Chuan Li , Lucas Theis , Christian Richardt , Yong-Liang Yang

While generative adversarial networks (GAN) have been widely adopted in various topics, in this paper we generalize the standard GAN to a new perspective by treating realness as a random variable that can be estimated from multiple angles.…

Machine Learning · Computer Science 2020-02-14 Yuanbo Xiangli , Yubin Deng , Bo Dai , Chen Change Loy , Dahua Lin

Recent strides in Text-to-3D techniques have been propelled by distilling knowledge from powerful large text-to-image diffusion models (LDMs). Nonetheless, existing Text-to-3D approaches often grapple with challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Yiwen Chen , Chi Zhang , Xiaofeng Yang , Zhongang Cai , Gang Yu , Lei Yang , Guosheng Lin

Layout is important for graphic design and scene generation. We propose a novel Generative Adversarial Network, called LayoutGAN, that synthesizes layouts by modeling geometric relations of different types of 2D elements. The generator of…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Jianan Li , Jimei Yang , Aaron Hertzmann , Jianming Zhang , Tingfa Xu

While 3D GANs have recently demonstrated the high-quality synthesis of multi-view consistent images and 3D shapes, they are mainly restricted to photo-realistic human portraits. This paper aims to extend 3D GANs to a different, but…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Wonjoon Jin , Nuri Ryu , Geonung Kim , Seung-Hwan Baek , Sunghyun Cho

Recent advances in diffusion-based generation techniques enable AI models to produce highly realistic videos, heightening the need for reliable detection mechanisms. However, existing detection methods provide only limited exploration of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Wenhan Chen , Sezer Karaoglu , Theo Gevers

We study the problem of synthesizing immersive 3D indoor scenes from one or more images. Our aim is to generate high-resolution images and videos from novel viewpoints, including viewpoints that extrapolate far beyond the input images while…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Jing Yu Koh , Harsh Agrawal , Dhruv Batra , Richard Tucker , Austin Waters , Honglak Lee , Yinfei Yang , Jason Baldridge , Peter Anderson

Medical image synthesis generates additional imaging modalities that are costly, invasive or harmful to acquire, which helps to facilitate the clinical workflow. When training pairs are substantially misaligned (e.g., lung MRI-CT pairs with…

Image and Video Processing · Electrical Eng. & Systems 2024-08-20 Bowen Xin , Tony Young , Claire E Wainwright , Tamara Blake , Leo Lebrat , Thomas Gaass , Thomas Benkert , Alto Stemmer , David Coman , Jason Dowling