English
Related papers

Related papers: IDE-3D: Interactive Disentangled Editing for High-…

200 papers

Learning 3D generative models from a dataset of monocular images enables self-supervised 3D reasoning and controllable synthesis. State-of-the-art 3D generative models are GANs which use neural 3D volumetric representations for synthesis.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Ayush Tewari , Mallikarjun B R , Xingang Pan , Ohad Fried , Maneesh Agrawala , Christian Theobalt

We introduce a highly robust GAN-based framework for digitizing a normalized 3D avatar of a person from a single unconstrained photo. While the input image can be of a smiling person or taken in extreme lighting conditions, our method can…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Huiwen Luo , Koki Nagano , Han-Wei Kung , Mclean Goldwhite , Qingguo Xu , Zejian Wang , Lingyu Wei , Liwen Hu , Hao Li

In contrast to the traditional avatar creation pipeline which is a costly process, contemporary generative approaches directly learn the data distribution from photographs. While plenty of works extend unconditional generative models and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Junshu Tang , Bo Zhang , Binxin Yang , Ting Zhang , Dong Chen , Lizhuang Ma , Fang Wen

Distilling 3D representations from pretrained 2D diffusion models is essential for 3D creative applications across gaming, film, and interior design. Current SDS-based methods are hindered by inefficient information distillation from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Haoran Li , Yuli Tian , Yonghui Wang , Yong Liao , Lin Wang , Yuyang Wang , Peng Yuan Zhou

Previous animatable 3D-aware GANs for human generation have primarily focused on either the human head or full body. However, head-only videos are relatively uncommon in real life, and full body generation typically does not deal with…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yue Wu , Sicheng Xu , Jianfeng Xiang , Fangyun Wei , Qifeng Chen , Jiaolong Yang , Xin Tong

3D GANs have the ability to generate latent codes for entire 3D volumes rather than only 2D images. These models offer desirable features like high-quality geometry and multi-view consistency, but, unlike their 2D counterparts, complex…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Enis Simsar , Alessio Tonioni , Evin Pınar Örnek , Federico Tombari

Text-guided 3D face synthesis has achieved remarkable results by leveraging text-to-image (T2I) diffusion models. However, most existing works focus solely on the direct generation, ignoring the editing, restricting them from synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yunjie Wu , Yapeng Meng , Zhipeng Hu , Lincheng Li , Haoqian Wu , Kun Zhou , Weiwei Xu , Xin Yu

In recent years, there has been significant progress in 2D generative face models fueled by applications such as animation, synthetic data generation, and digital avatars. However, due to the absence of 3D information, these 2D models often…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Aashish Rai , Hiresh Gupta , Ayush Pandey , Francisco Vicente Carrasco , Shingo Jason Takagi , Amaury Aubel , Daeil Kim , Aayush Prakash , Fernando de la Torre

Face image manipulation via three-dimensional guidance has been widely applied in various interactive scenarios due to its semantically-meaningful understanding and user-friendly controllability. However, existing 3D-morphable-model-based…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Can Wang , Menglei Chai , Mingming He , Dongdong Chen , Jing Liao

Semantic Image Synthesis (SIS) is among the most popular and effective techniques in the field of face generation and editing, thanks to its good generation quality and the versatility is brings along. Recent works attempted to go beyond…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Alex Ergasti , Claudio Ferrari , Tomaso Fontanini , Massimo Bertozzi , Andrea Prati

Recent years have seen remarkable progress in deep learning powered visual content creation. This includes deep generative 3D-aware image synthesis, which produces high-idelity images in a 3D-consistent manner while simultaneously capturing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Weihao Xia , Jing-Hao Xue

Semantic image synthesis (SIS) refers to the problem of generating realistic imagery given a semantic segmentation mask that defines the spatial layout of object classes. Most of the approaches in the literature, other than the quality of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Tomaso Fontanini , Claudio Ferrari , Massimo Bertozzi , Andrea Prati

We propose ID-to-3D, a method to generate identity- and text-guided 3D human heads with disentangled expressions, starting from even a single casually captured in-the-wild image of a subject. The foundation of our approach is anchored in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Francesca Babiloni , Alexandros Lattas , Jiankang Deng , Stefanos Zafeiriou

For the last decades, the concern of producing convincing facial animation has garnered great interest, that has only been accelerating with the recent explosion of 3D content in both entertainment and professional activities. The use of…

Graphics · Computer Science 2020-10-13 Eloïse Berson , Catherine Soladié , Nicolas Stoiber

Efficiently generating a freestyle 3D portrait with high quality and 3D-consistency is a promising yet challenging task. The portrait styles generated by most existing methods are usually restricted by their 3D generators, which are learned…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Tianxiang Ma , Kang Zhao , Jianxin Sun , Yingya Zhang , Jing Dong

Interactive facial image manipulation attempts to edit single and multiple face attributes using a photo-realistic face and/or semantic mask as input. In the absence of the photo-realistic image (only sketch/mask available), previous…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yan Yang , Md Zakir Hossain , Tom Gedeon , Shafin Rahman

Existing methods for face image manipulation generally focus on editing the expression, changing some predefined attributes, or applying different filters. However, users lack the flexibility of controlling the shapes of different semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Sen-Zhe Xu , Hao-Zhi Huang , Shi-Min Hu , Wei Liu

We introduce a novel approach that takes a single semantic mask as input to synthesize multi-view consistent color images of natural scenes, trained with a collection of single images from the Internet. Prior works on 3D-aware image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Shangzan Zhang , Sida Peng , Tianrun Chen , Linzhan Mou , Haotong Lin , Kaicheng Yu , Yiyi Liao , Xiaowei Zhou

Semantic face editing has achieved substantial progress in recent years. Known as a growingly popular method, latent space manipulation performs face editing by changing the latent code of an input face to liberate users from painting…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Wenjing Huang , Shikui Tu , Lei Xu

We present an interactive approach to synthesizing realistic variations in facial hair in images, ranging from subtle edits to existing hair to the addition of complex and challenging hair in images of clean-shaven subjects. To circumvent…

Computer Vision and Pattern Recognition · Computer Science 2020-04-16 Kyle Olszewski , Duygu Ceylan , Jun Xing , Jose Echevarria , Zhili Chen , Weikai Chen , Hao Li