English
Related papers

Related papers: Do 2D GANs Know 3D Shape? Unsupervised 3D shape re…

200 papers

We propose a method to learn 3D deformable object categories from raw single-view images, without external supervision. The method is based on an autoencoder that factors each input image into depth, albedo, viewpoint and illumination. In…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Shangzhe Wu , Christian Rupprecht , Andrea Vedaldi

This paper investigates the challenge of learning image manifolds, specifically pose manifolds, of 3D objects using limited training data. It proposes a DNN approach to manifold learning and for predicting images of objects for novel,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Shenyuan Liang , Pavan Turaga , Anuj Srivastava

While GANs have shown success in realistic image generation, the idea of using GANs for other tasks unrelated to synthesis is underexplored. Do GANs learn meaningful structural parts of objects during their attempt to reproduce those…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Nontawat Tritrong , Pitchaporn Rewatbowornwong , Supasorn Suwajanakorn

We present a framework for training GANs with explicit control over generated images. We are able to control the generated image by settings exact attributes such as age, pose, expression, etc. Most approaches for editing GAN-generated…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Alon Shoshan , Nadav Bhonker , Igor Kviatkovsky , Gerard Medioni

Generative Adversarial Networks (GANs) have emerged as powerful tools for high-quality image generation and real image editing by manipulating their latent spaces. Recent advancements in GANs include 3D-aware models such as EG3D, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Bahri Batuhan Bilecen , Yigit Yalin , Ning Yu , Aysegul Dundar

Deep generative models learned through adversarial training have become increasingly popular for their ability to generate naturalistic image textures. However, aside from their texture, the visual appearance of objects is significantly…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Jean Kossaifi , Linh Tran , Yannis Panagakis , Maja Pantic

Despite the growing success of 3D-aware GANs, which can be trained on 2D images to generate high-quality 3D assets, they still rely on multi-view images with camera annotations to synthesize sufficient details from all viewing directions.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Jing Yang , Kyle Fogarty , Fangcheng Zhong , Cengiz Oztireli

Recovering the 3D shape of transparent objects using a small number of unconstrained natural images is an ill-posed problem. Complex light paths induced by refraction and reflection have prevented both traditional and deep multiview stereo…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Zhengqin Li , Yu-Ying Yeh , Manmohan Chandraker

Recently, deep learning-based 3D face reconstruction methods have demonstrated promising advancements in terms of quality and efficiency. Nevertheless, these techniques face challenges in effectively handling occluded scenes and fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Dapeng Zhao

We present a high-fidelity 3D generative adversarial network (GAN) inversion framework that can synthesize photo-realistic novel views while preserving specific details of the input image. High-fidelity 3D GAN inversion is inherently…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Jiaxin Xie , Hao Ouyang , Jingtan Piao , Chenyang Lei , Qifeng Chen

The advancement of generative radiance fields has pushed the boundary of 3D-aware image synthesis. Motivated by the observation that a 3D object should look realistic from multiple viewpoints, these methods introduce a multi-view constraint…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Xingang Pan , Xudong Xu , Chen Change Loy , Christian Theobalt , Bo Dai

Generative Adversarial Networks (GAN) have demonstrated impressive results in modeling the distribution of natural images, learning latent representations that capture semantic variations in an unsupervised basis. Beyond the generation of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Marcos Pividori , Guillermo L. Grinblat , Lucas C. Uzal

We present a simple yet effective general-purpose framework for modeling 3D shapes by leveraging recent advances in 2D image generation using CNNs. Using just a single depth image of the object, we can output a dense multi-view depth map…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Kamal Gupta , Susmija Jabbireddy , Ketul Shah , Abhinav Shrivastava , Matthias Zwicker

Reasoning 3D shapes from 2D images is an essential yet challenging task, especially when only single-view images are at our disposal. While an object can have a complicated shape, individual parts are usually close to geometric primitives…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Chun-Han Yao , Wei-Chih Hung , Varun Jampani , Ming-Hsuan Yang

Generative adversarial networks (GANs) have attained photo-realistic quality in image generation. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN which is trained…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xingzhe He , Bastian Wandt , Helge Rhodin

We propose a novel framework for fine-grained object recognition that learns to recover object variation in 3D space from a single image, trained on an image collection without using any ground-truth 3D annotation. We accomplish this by…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Sunghun Joung , Seungryong Kim , Minsu Kim , Ig-Jae Kim , Kwanghoon Sohn

We study the problem of 3D object generation. We propose a novel framework, namely 3D Generative Adversarial Network (3D-GAN), which generates 3D objects from a probabilistic space by leveraging recent advances in volumetric convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-01-05 Jiajun Wu , Chengkai Zhang , Tianfan Xue , William T. Freeman , Joshua B. Tenenbaum

Generative adversarial networks (GANs) have emerged as a powerful unsupervised method to model the statistical patterns of real-world data sets, such as natural images. These networks are trained to map random inputs in their latent space…

Machine Learning · Computer Science 2021-03-19 Binxu Wang , Carlos R. Ponce

3D geometry is a very informative cue when interacting with and navigating an environment. This writing proposes a new approach to 3D reconstruction and scene understanding, which implicitly learns 3D geometry from depth maps pairing a deep…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Dario Rethage , Federico Tombari , Felix Achilles , Nassir Navab

In this paper we present a novel unsupervised representation learning approach for 3D shapes, which is an important research challenge as it avoids the manual effort required for collecting supervised data. Our method trains an RNN-based…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Zhizhong Han , Mingyang Shang , Yu-Shen Liu , Matthias Zwicker