English
Related papers

Related papers: Unsupervised Generative 3D Shape Learning from Nat…

200 papers

Recent advances in 3D deep learning have shown that it is possible to train highly effective deep models for 3D shape generation, directly from 2D images. This is particularly interesting since the availability of 3D models is still limited…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Shichen Liu , Shunsuke Saito , Weikai Chen , Hao Li

In this paper we investigate the problem of inducing a distribution over three-dimensional structures given two-dimensional views of multiple objects taken from unknown viewpoints. Our approach called "projective generative adversarial…

Computer Vision and Pattern Recognition · Computer Science 2016-12-20 Matheus Gadelha , Subhransu Maji , Rui Wang

The task of generating natural images from 3D scenes has been a long standing goal in computer graphics. On the other hand, recent developments in deep neural networks allow for trainable models that can produce natural-looking images with…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Hassan Abu Alhaija , Siva Karthik Mustikovela , Andreas Geiger , Carsten Rother

We present a unified framework tackling two problems: class-specific 3D reconstruction from a single image, and generation of new 3D shape samples. These tasks have received considerable attention recently; however, existing approaches rely…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Paul Henderson , Vittorio Ferrari

Deep generative models learned through adversarial training have become increasingly popular for their ability to generate naturalistic image textures. However, aside from their texture, the visual appearance of objects is significantly…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Jean Kossaifi , Linh Tran , Yannis Panagakis , Maja Pantic

We propose a novel end-to-end semi-supervised adversarial framework to generate photorealistic face images of new identities with wide ranges of expressions, poses, and illuminations conditioned by a 3D morphable model. Previous adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Baris Gecer , Binod Bhattarai , Josef Kittler , Tae-Kyun Kim

Learning 3D generative models from a dataset of monocular images enables self-supervised 3D reasoning and controllable synthesis. State-of-the-art 3D generative models are GANs which use neural 3D volumetric representations for synthesis.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Ayush Tewari , Mallikarjun B R , Xingang Pan , Ohad Fried , Maneesh Agrawala , Christian Theobalt

A natural approach to generative modeling of videos is to represent them as a composition of moving objects. Recent works model a set of 2D sprites over a slowly-varying background, but without considering the underlying 3D scene that gives…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Paul Henderson , Christoph H. Lampert

This paper introduces a 3D shape generative model based on deep neural networks. A new image-like (i.e., tensor) data representation for genus-zero 3D shapes is devised. It is based on the observation that complicated shapes can be well…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Heli Ben-Hamu , Haggai Maron , Itay Kezurer , Gal Avineri , Yaron Lipman

3D-aware generative adversarial networks (GANs) synthesize high-fidelity and multi-view-consistent facial images using only collections of single-view 2D imagery. Towards fine-grained control over facial attributes, recent efforts…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Jingxiang Sun , Xuan Wang , Lizhen Wang , Xiaoyu Li , Yong Zhang , Hongwen Zhang , Yebin Liu

We are interested in learning visual representations which allow for 3D manipulations of visual objects based on a single 2D image. We cast this into an image-to-image transformation task, and propose Iterative Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Ysbrand Galama , Thomas Mensink

Collecting well-annotated image datasets to train modern machine learning algorithms is prohibitively expensive for many tasks. One appealing alternative is rendering synthetic data where ground-truth annotations are generated…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Konstantinos Bousmalis , Nathan Silberman , David Dohan , Dumitru Erhan , Dilip Krishnan

Most 3D face reconstruction methods rely on 3D morphable models, which disentangle the space of facial deformations into identity geometry, expressions and skin reflectance. These models are typically learned from a limited number of 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Mallikarjun B R , Ayush Tewari , Hans-Peter Seidel , Mohamed Elgharib , Christian Theobalt

While convolutional neural networks are dominating the field of computer vision, one usually does not have access to the large amount of domain-relevant data needed for their training. It thus became common to use available synthetic…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Benjamin Planche , Sergey Zakharov , Ziyan Wu , Andreas Hutter , Harald Kosch , Slobodan Ilic

We present a method for training a regression network from image pixels to 3D morphable model coordinates using only unlabeled photographs. The training loss is based on features from a facial recognition network, computed on-the-fly by…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Kyle Genova , Forrester Cole , Aaron Maschinot , Aaron Sarna , Daniel Vlasic , William T. Freeman

Significant progress has been made by the advances in Generative Adversarial Networks (GANs) for image generation. However, there lacks enough understanding of how a realistic image is generated by the deep representations of GANs from a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-03 Bolei Zhou

Visual surface inspection is a challenging task owing to the highly diverse appearance of target surfaces and defective regions. Previous attempts heavily rely on vast quantities of training examples with manual annotation. However, in some…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Lingyun Gu , Lin Zhang , Zhaokui Wang

Our goal is to extract meaningful transformations from raw images, such as varying the thickness of lines in handwriting or the lighting in a portrait. We propose an unsupervised approach to learn such transformations by attempting to…

Machine Learning · Statistics 2017-11-08 Tatsunori B. Hashimoto , John C. Duchi , Percy Liang

Image generation remains a fundamental problem in artificial intelligence in general and deep learning in specific. The generative adversarial network (GAN) was successful in generating high quality samples of natural images. We propose a…

Artificial Intelligence · Computer Science 2016-11-15 Hanock Kwak , Byoung-Tak Zhang

Representing 3D shape is a fundamental problem in artificial intelligence, which has numerous applications within computer vision and graphics. One avenue that has recently begun to be explored is the use of latent representations of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tristan Aumentado-Armstrong , Stavros Tsogkas , Allan Jepson , Sven Dickinson