English
Related papers

Related papers: Towards Realistic 3D Embedding via View Alignment

200 papers

The visual world we sense, interpret and interact everyday is a complex composition of interleaved physical entities. Therefore, it is a very challenging task to generate vivid scenes of similar complexity using computers. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Mehmet Ozgur Turkoglu , William Thong , Luuk Spreeuwers , Berkay Kicanaoglu

Recent generative models can synthesize "views" of artificial images that mimic real-world variations, such as changes in color or pose, simply by learning from unlabeled image collections. Here, we investigate whether such views can be…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Lucy Chai , Jun-Yan Zhu , Eli Shechtman , Phillip Isola , Richard Zhang

3D-aware Generative Adversarial Networks (GANs) have shown remarkable progress in learning to generate multi-view-consistent images and 3D geometries of scenes from collections of 2D images via neural volume rendering. Yet, the significant…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Alex Trevithick , Matthew Chan , Towaki Takikawa , Umar Iqbal , Shalini De Mello , Manmohan Chandraker , Ravi Ramamoorthi , Koki Nagano

Unsupervised generation of high-quality multi-view-consistent images and 3D shapes using only collections of single-view 2D photographs has been a long-standing challenge. Existing 3D GANs are either compute-intensive or make approximations…

Generative Adversarial Networks have surprising ability for generating sharp and realistic images, though they are known to suffer from the so-called mode collapse problem. In this paper, we propose a new GAN variant called Mixture Density…

Machine Learning · Computer Science 2018-11-30 Hamid Eghbal-zadeh , Werner Zellinger , Gerhard Widmer

Data from many real-world applications can be naturally represented by multi-view networks where the different views encode different types of relationships (e.g., friendship, shared interests in music, etc.) between real-world individuals…

Social and Information Networks · Computer Science 2019-09-04 Yiwei Sun , Suhang Wang , Tsung-Yu Hsieh , Xianfeng Tang , Vasant Honavar

Recent advances in Generative Adversarial Networks (GANs) have led to the creation of realistic-looking digital images that pose a major challenge to their detection by humans or computers. GANs are used in a wide range of tasks, from…

Image and Video Processing · Electrical Eng. & Systems 2020-07-22 Michael Goebel , Lakshmanan Nataraj , Tejaswi Nanjundaswamy , Tajuddin Manhar Mohammed , Shivkumar Chandrasekaran , B. S. Manjunath

Deep generative models provide powerful tools for distributions over complicated manifolds, such as those of natural images. But many of these methods, including generative adversarial networks (GANs), can be difficult to train, in part…

Machine Learning · Statistics 2017-11-08 Akash Srivastava , Lazar Valkov , Chris Russell , Michael U. Gutmann , Charles Sutton

We introduce VIVE3D, a novel approach that extends the capabilities of image-based 3D GANs to video editing and is able to represent the input video in an identity-preserving and temporally consistent way. We propose two new building…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Anna Frühstück , Nikolaos Sarafianos , Yuanlu Xu , Peter Wonka , Tony Tung

Generative Adversarial Networks (GANs) have recently achieved impressive results for many real-world applications, and many GAN variants have emerged with improvements in sample quality and training stability. However, they have not been…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 David Bau , Jun-Yan Zhu , Hendrik Strobelt , Bolei Zhou , Joshua B. Tenenbaum , William T. Freeman , Antonio Torralba

Generative adversarial networks (GANs) have attained photo-realistic quality in image generation. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN which is trained…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xingzhe He , Bastian Wandt , Helge Rhodin

In this paper, we propose a novel 3D-RecGAN approach, which reconstructs the complete 3D structure of a given object from a single arbitrary depth view using generative adversarial networks. Unlike the existing work which typically requires…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Bo Yang , Hongkai Wen , Sen Wang , Ronald Clark , Andrew Markham , Niki Trigoni

Learning 3D generative models from a dataset of monocular images enables self-supervised 3D reasoning and controllable synthesis. State-of-the-art 3D generative models are GANs which use neural 3D volumetric representations for synthesis.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Ayush Tewari , Mallikarjun B R , Xingang Pan , Ohad Fried , Maneesh Agrawala , Christian Theobalt

Recently image inpainting has witnessed rapid progress due to generative adversarial networks (GAN) that are able to synthesize realistic contents. However, most existing GAN-based methods for semantic inpainting apply an auto-encoder…

Computer Vision and Pattern Recognition · Computer Science 2017-12-22 Haofeng Li , Guanbin Li , Liang Lin , Yizhou Yu

Despite the rapid progress of generative adversarial networks (GANs) in image synthesis in recent years, the existing image synthesis approaches work in either geometry domain or appearance domain alone which often introduces various…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Fangneng Zhan , Jiaxing Huang , Shijian Lu

Generative Adversarial Networks (GANs) are machine learning methods that are used in many important and novel applications. For example, in imaging science, GANs are effectively utilized in generating image datasets, photographs of human…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Soheyla Amirian , Thiab R. Taha , Khaled Rasheed , Hamid R. Arabnia

Recently, a surge of high-quality 3D-aware GANs have been proposed, which leverage the generative power of neural rendering. It is natural to associate 3D GANs with GAN inversion methods to project a real image into the generator's latent…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Fei Yin , Yong Zhang , Xuan Wang , Tengfei Wang , Xiaoyu Li , Yuan Gong , Yanbo Fan , Xiaodong Cun , Ying Shan , Cengiz Oztireli , Yujiu Yang

Text-to-image synthesis aims to generate a photo-realistic image from a given natural language description. Previous works have made significant progress with Generative Adversarial Networks (GANs). Nonetheless, it is still hard to generate…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Eunyeong Jeon , Kunhee Kim , Daijin Kim

Real-world image manipulation has achieved fantastic progress in recent years. GAN inversion, which aims to map the real image to the latent code faithfully, is the first step in this pipeline. However, existing GAN inversion methods fail…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Bangrui Jiang , Zhenhua Guo , Yujiu Yang

Generative Adversarial Networks (GANs) can produce images of remarkable complexity and realism but are generally structured to sample from a single latent source ignoring the explicit spatial interaction between multiple entities that could…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Samaneh Azadi , Deepak Pathak , Sayna Ebrahimi , Trevor Darrell