English
Related papers

Related papers: Mimic3D: Thriving 3D-Aware GANs via 3D-to-2D Imita…

200 papers

Given a single image of a target object, image-to-3D generation aims to reconstruct its texture and geometric shape. Recent methods often utilize intermediate media, such as multi-view images or videos, to bridge the gap between input image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Jiacheng Wang , Zhedong Zheng , Wei Xu , Ping Liu

We investigate how to generate multimodal image outputs, such as RGB, depth, and surface normals, with a single generative model. The challenge is to produce outputs that are realistic, and also consistent with each other. Our solution…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Zhen Zhu , Yijun Li , Weijie Lyu , Krishna Kumar Singh , Zhixin Shu , Soeren Pirk , Derek Hoiem

Nerf-based Generative models have shown impressive capacity in generating high-quality images with consistent 3D geometry. Despite successful synthesis of fake identity images randomly sampled from latent space, adopting these models for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yu Yin , Kamran Ghasedi , HsiangTao Wu , Jiaolong Yang , Xin Tong , Yun Fu

Solid texture synthesis (STS), an effective way to extend a 2D exemplar to a 3D solid volume, exhibits advantages in computational photography. However, existing methods generally fail to accurately learn arbitrary textures, which may…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Xin Zhao , Jifeng Guo , Lin Wang , Fanqi Li , Jiahao Li , Junteng Zheng , Bo Yang

We present a new weakly supervised learning-based method for generating novel category-specific 3D shapes from unoccluded image collections. Our method is weakly supervised and only requires silhouette annotations from unoccluded,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Xiao Li , Yue Dong , Pieter Peers , Xin Tong

Generative models for 2D images has recently seen tremendous progress in quality, resolution and speed as a result of the efficiency of 2D convolutional architectures. However it is difficult to extend this progress into the 3D domain since…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hassan Abu Alhaija , Alara Dirik , André Knörig , Sanja Fidler , Maria Shugrina

In recent years, Generative Adversarial Networks have achieved impressive results in photorealistic image synthesis. This progress nurtures hopes that one day the classical rendering pipeline can be replaced by efficient models that are…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Yiyi Liao , Katja Schwarz , Lars Mescheder , Andreas Geiger

Facial recognition using deep convolutional neural networks relies on the availability of large datasets of face images. Many examples of identities are needed, and for each identity, a large variety of images are needed in order for the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Richard T. Marriott , Sami Romdhani , Liming Chen

Recent research has shown that controllable image generation based on pre-trained GANs can benefit a wide range of computer vision tasks. However, less attention has been devoted to 3D vision tasks. In light of this, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Feng Liu , Xiaoming Liu

Generative models have emerged as an essential building block for many image synthesis and editing tasks. Recent advances in this field have also enabled high-quality 3D or video content to be generated that exhibits either multi-view or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Sherwin Bahmani , Jeong Joon Park , Despoina Paschalidou , Hao Tang , Gordon Wetzstein , Leonidas Guibas , Luc Van Gool , Radu Timofte

Portrait stylization is a long-standing task enabling extensive applications. Although 2D-based methods have made great progress in recent years, real-world applications such as metaverse and games often demand 3D content. On the other…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Zhuo Chen , Xudong Xu , Yichao Yan , Ye Pan , Wenhan Zhu , Wayne Wu , Bo Dai , Xiaokang Yang

Image synthesis via Generative Adversarial Networks (GANs) of three-dimensional (3D) medical images has great potential that can be extended to many medical applications, such as, image enhancement and disease progression modeling. However,…

Image and Video Processing · Electrical Eng. & Systems 2021-07-22 Sungmin Hong , Razvan Marinescu , Adrian V. Dalca , Anna K. Bonkhoff , Martin Bretzner , Natalia S. Rost , Polina Golland

Generative models are widely employed to enhance the photorealism of visual synthetic data for training computer vision algorithms. However, they often introduce visual artifacts that degrade the accuracy of these algorithms and require…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Stefanos Pasios , Nikos Nikolaidis

Differentiable rendering has paved the way to training neural networks to perform "inverse graphics" tasks such as predicting 3D geometry from monocular photographs. To train high performing models, most of the current approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Yuxuan Zhang , Wenzheng Chen , Huan Ling , Jun Gao , Yinan Zhang , Antonio Torralba , Sanja Fidler

Modern 3D-GANs synthesize geometry and texture by training on large-scale datasets with a consistent structure. Training such models on stylized, artistic data, with often unknown, highly variable geometry, and camera information has not…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Rameen Abdal , Hsin-Ying Lee , Peihao Zhu , Menglei Chai , Aliaksandr Siarohin , Peter Wonka , Sergey Tulyakov

We often aim to generate images that are both photorealistic and 3D-consistent, adhering to precise geometry, material, and viewpoint controls. Typically, this is achieved by fine-tuning an image generator, pre-trained on billions of real…

Graphics · Computer Science 2026-05-15 Ido Sobol , Kihyuk Sohn , Yoav Blum , Egor Zakharov , Max Bluvstein , Andrea Vedaldi , Or Litany

Driving simulators play a large role in developing and testing new intelligent vehicle systems. The visual fidelity of the simulation is critical for building vision-based algorithms and conducting human driver experiments. Low visual…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Ekim Yurtsever , Dongfang Yang , Ibrahim Mert Koc , Keith A. Redmill

Generating realistic 3D faces is of high importance for computer graphics and computer vision applications. Generally, research on 3D face generation revolves around linear statistical models of the facial surface. Nevertheless, these…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Baris Gecer , Alexander Lattas , Stylianos Ploumpis , Jiankang Deng , Athanasios Papaioannou , Stylianos Moschoglou , Stefanos Zafeiriou

Recent work has shown significant progress in the direction of synthetic data generation using Generative Adversarial Networks (GANs). GANs have been applied in many fields of computer vision including text-to-image conversion, domain…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Mkhuseli Ngxande , Jules-Raymond Tapamo , Michael Burke

Recent strides in Text-to-3D techniques have been propelled by distilling knowledge from powerful large text-to-image diffusion models (LDMs). Nonetheless, existing Text-to-3D approaches often grapple with challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Yiwen Chen , Chi Zhang , Xiaofeng Yang , Zhongang Cai , Gang Yu , Lei Yang , Guosheng Lin