English
Related papers

Related papers: Do 2D GANs Know 3D Shape? Unsupervised 3D shape re…

200 papers

3D-aware Generative Adversarial Networks (GANs) have shown remarkable progress in learning to generate multi-view-consistent images and 3D geometries of scenes from collections of 2D images via neural volume rendering. Yet, the significant…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Alex Trevithick , Matthew Chan , Towaki Takikawa , Umar Iqbal , Shalini De Mello , Manmohan Chandraker , Ravi Ramamoorthi , Koki Nagano

3D GAN inversion aims to achieve high reconstruction fidelity and reasonable 3D geometry simultaneously from a single image input. However, existing 3D GAN inversion methods rely on time-consuming optimization for each individual case. In…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Ziyang Yuan , Yiming Zhu , Yu Li , Hongyu Liu , Chun Yuan

GANs are able to model accurately the distribution of complex, high-dimensional datasets, e.g. images. This makes high-quality GANs useful for unsupervised anomaly detection in medical imaging. However, differences in training datasets such…

Image and Video Processing · Electrical Eng. & Systems 2022-08-18 Sam Ellis , Octavio E. Martinez Manzanera , Vasileios Baltatzis , Ibrahim Nawaz , Arjun Nair , Loïc Le Folgoc , Sujal Desai , Ben Glocker , Julia A. Schnabel

Inferring 3D structure of a generic object from a 2D image is a long-standing objective of computer vision. Conventional approaches either learn completely from CAD-generated synthetic data, which have difficulty in inference from real…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Feng Liu , Luan Tran , Xiaoming Liu

We propose a method for 3D object reconstruction and 6D-pose estimation from 2D images that uses knowledge about object shape as the primary key. In the proposed pipeline, recognition and labeling of objects in 2D images deliver 2D segment…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Marcell Wolnitza , Osman Kaya , Tomas Kulvicius , Florentin Wörgötter , Babette Dellen

The recent advances in text and image synthesis show a great promise for the future of generative models in creative fields. However, a less explored area is the one of 3D model generation, with a lot of potential applications to game…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Antoine Schnepf , Flavian Vasile , Ugo Tanielian

This paper presents a method to reconstruct high-quality textured 3D models from single images. Current methods rely on datasets with expensive annotations; multi-view images and their camera parameters. Our method relies on GAN generated…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Aysegul Dundar , Jun Gao , Andrew Tao , Bryan Catanzaro

3D reconstruction is a longstanding ill-posed problem, which has been explored for decades by the computer vision, computer graphics, and machine learning communities. Since 2015, image-based 3D reconstruction using convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Xian-Feng Han , Hamid Laga , Mohammed Bennamoun

3D GANs have the ability to generate latent codes for entire 3D volumes rather than only 2D images. These models offer desirable features like high-quality geometry and multi-view consistency, but, unlike their 2D counterparts, complex…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Enis Simsar , Alessio Tonioni , Evin Pınar Örnek , Federico Tombari

Texture cues on 3D objects are key to compelling visual representations, with the possibility to create high visual fidelity with inherent spatial consistency across different views. Since the availability of textured 3D shapes remains very…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yawar Siddiqui , Justus Thies , Fangchang Ma , Qi Shan , Matthias Nießner , Angela Dai

Recent advances in differentiable rendering have sparked an interest in learning generative models of textured 3D meshes from image collections. These models natively disentangle pose and appearance, enable downstream applications in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Dario Pavllo , Jonas Kohler , Thomas Hofmann , Aurelien Lucchi

We present a unified framework tackling two problems: class-specific 3D reconstruction from a single image, and generation of new 3D shape samples. These tasks have received considerable attention recently; however, existing approaches rely…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Paul Henderson , Vittorio Ferrari

From a single image, humans are able to perceive the full 3D shape of an object by exploiting learned shape priors from everyday life. Contemporary single-image 3D reconstruction algorithms aim to solve this task in a similar fashion, but…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Xiuming Zhang , Zhoutong Zhang , Chengkai Zhang , Joshua B. Tenenbaum , William T. Freeman , Jiajun Wu

3D-aware image synthesis aims at learning a generative model that can render photo-realistic 2D images while capturing decent underlying 3D shapes. A popular solution is to adopt the generative adversarial network (GAN) and replace the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Zifan Shi , Yinghao Xu , Yujun Shen , Deli Zhao , Qifeng Chen , Dit-Yan Yeung

We introduce 3inGAN, an unconditional 3D generative model trained from 2D images of a single self-similar 3D scene. Such a model can be used to produce 3D "remixes" of a given scene, by mapping spatial latent codes into a 3D volumetric…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Animesh Karnewar , Oliver Wang , Tobias Ritschel , Niloy Mitra

3D-aware generative adversarial networks (GANs) synthesize high-fidelity and multi-view-consistent facial images using only collections of single-view 2D imagery. Towards fine-grained control over facial attributes, recent efforts…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Jingxiang Sun , Xuan Wang , Lizhen Wang , Xiaoyu Li , Yong Zhang , Hongwen Zhang , Yebin Liu

Although 2D generative models have made great progress in face image generation and animation, they often suffer from undesirable artifacts such as 3D inconsistency when rendering images from different camera viewpoints. This prevents them…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Yue Wu , Yu Deng , Jiaolong Yang , Fangyun Wei , Qifeng Chen , Xin Tong

Synthesis and reconstruction of 3D human head has gained increasing interests in computer vision and computer graphics recently. Existing state-of-the-art 3D generative adversarial networks (GANs) for 3D human head synthesis are either…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Sizhe An , Hongyi Xu , Yichun Shi , Guoxian Song , Umit Ogras , Linjie Luo

Portrait stylization is a long-standing task enabling extensive applications. Although 2D-based methods have made great progress in recent years, real-world applications such as metaverse and games often demand 3D content. On the other…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Zhuo Chen , Xudong Xu , Yichao Yan , Ye Pan , Wenhan Zhu , Wayne Wu , Bo Dai , Xiaokang Yang

Synthesizing visual content that meets users' needs often requires flexible and precise controllability of the pose, shape, expression, and layout of the generated objects. Existing approaches gain controllability of generative adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Xingang Pan , Ayush Tewari , Thomas Leimkühler , Lingjie Liu , Abhimitra Meka , Christian Theobalt