English
Related papers

Related papers: 2D GANs Meet Unsupervised Single-view 3D Reconstru…

200 papers

Generative models have emerged as an essential building block for many image synthesis and editing tasks. Recent advances in this field have also enabled high-quality 3D or video content to be generated that exhibits either multi-view or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Sherwin Bahmani , Jeong Joon Park , Despoina Paschalidou , Hao Tang , Gordon Wetzstein , Leonidas Guibas , Luc Van Gool , Radu Timofte

3D-controllable portrait synthesis has significantly advanced, thanks to breakthroughs in generative adversarial networks (GANs). However, it is still challenging to manipulate existing face images with precise 3D control. While…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yuchen Liu , Zhixin Shu , Yijun Li , Zhe Lin , Richard Zhang , S. Y. Kung

This paper presents a method to reconstruct high-quality textured 3D models from single images. Current methods rely on datasets with expensive annotations; multi-view images and their camera parameters. Our method relies on GAN generated…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Aysegul Dundar , Jun Gao , Andrew Tao , Bryan Catanzaro

Although manipulating facial attributes by Generative Adversarial Networks (GANs) has been remarkably successful recently, there are still some challenges in explicit control of features such as pose, expression, lighting, etc. Recent…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Yuanming Li , Jeong-gi Kwak , David Han , Hanseok Ko

Neural implicit functions have achieved impressive results for reconstructing 3D shapes from single images. However, the image features for describing 3D point samplings of implicit functions are less effective when significant variations…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Yixin Zhuang , Yunzhe Liu , Yujie Wang , Baoquan Chen

We propose a pipeline to generate Neural Radiance Fields~(NeRF) of an object or a scene of a specific class, conditioned on a single input image. This is a challenging task, as training NeRF requires multiple views of the same scene,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Shengqu Cai , Anton Obukhov , Dengxin Dai , Luc Van Gool

Image generation has been heavily investigated in computer vision, where one core research challenge is to generate images from arbitrarily complex distributions with little supervision. Generative Adversarial Networks (GANs) as an implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Hui Ying , He Wang , Tianjia Shao , Yin Yang , Kun Zhou

Neural implicit representation has attracted attention in 3D reconstruction through various success cases. For further applications such as scene understanding or editing, several works have shown progress towards object compositional…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Taekbeom Lee , Youngseok Jang , H. Jin Kim

We present a unified framework tackling two problems: class-specific 3D reconstruction from a single image, and generation of new 3D shape samples. These tasks have received considerable attention recently; however, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Paul Henderson , Vittorio Ferrari

GAN-based image restoration inverts the generative process to repair images corrupted by known degradations. Existing unsupervised methods must be carefully tuned for each task and degradation level. In this work, we make StyleGAN image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Yohan Poirier-Ginter , Jean-François Lalonde

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

Accurately predicting the 3D shape of any arbitrary object in any pose from a single image is a key goal of computer vision research. This is challenging as it requires a model to learn a representation that can infer both the visible and…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Anh Thai , Stefan Stojanov , Vijay Upadhya , James M. Rehg

Recovery of a 3D head model including the complete face and hair regions is still a challenging problem in computer vision and graphics. In this paper, we consider this problem using only a few multi-view portrait images as input. Previous…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Xueying Wang , Yudong Guo , Zhongqi Yang , Juyong Zhang

Recent work has shown the ability to learn generative models for 3D shapes from only unstructured 2D images. However, training such models requires differentiating through the rasterization step of the rendering process, therefore past work…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Sebastian Lunz , Yingzhen Li , Andrew Fitzgibbon , Nate Kushman

We propose a unified Generative Adversarial Network (GAN) for controllable image-to-image translation, i.e., transferring an image from a source to a target domain guided by controllable structures. In addition to conditioning on a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Hao Tang , Hong Liu , Nicu Sebe

We present a convolutional neural network for joint 3D shape prediction and viewpoint estimation from a single input image. During training, our network gets the learning signal from a silhouette of an object in the input image - a form of…

Robotics · Computer Science 2019-10-18 Oier Mees , Maxim Tatarchenko , Thomas Brox , Wolfram Burgard

3D-aware generative adversarial networks (GANs) synthesize high-fidelity and multi-view-consistent facial images using only collections of single-view 2D imagery. Towards fine-grained control over facial attributes, recent efforts…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Jingxiang Sun , Xuan Wang , Lizhen Wang , Xiaoyu Li , Yong Zhang , Hongwen Zhang , Yebin Liu

A central goal of visual recognition is to understand objects and scenes from a single image. 2D recognition has witnessed tremendous progress thanks to large-scale learning and general-purpose representations. Comparatively, 3D poses new…

Computer Vision and Pattern Recognition · Computer Science 2023-01-20 Chao-Yuan Wu , Justin Johnson , Jitendra Malik , Christoph Feichtenhofer , Georgia Gkioxari

Generative adversarial networks (GANs) can now generate photo-realistic images. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN internally conditioned on a set of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-10 Xingzhe He , Bastian Wandt , Helge Rhodin

We introduce 3inGAN, an unconditional 3D generative model trained from 2D images of a single self-similar 3D scene. Such a model can be used to produce 3D "remixes" of a given scene, by mapping spatial latent codes into a 3D volumetric…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Animesh Karnewar , Oliver Wang , Tobias Ritschel , Niloy Mitra