English
Related papers

Related papers: JoJoGAN: One Shot Face Stylization

200 papers

In this paper, we perform an in-depth study of the properties and applications of aligned generative models. We refer to two models as aligned if they share the same architecture, and one of them (the child) is obtained from the other (the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Zongze Wu , Yotam Nitzan , Eli Shechtman , Dani Lischinski

One-shot talking face generation aims at synthesizing a high-quality talking face video from an arbitrary portrait image, driven by a video or an audio segment. One challenging quality factor is the resolution of the output video: higher…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Fei Yin , Yong Zhang , Xiaodong Cun , Mingdeng Cao , Yanbo Fan , Xuan Wang , Qingyan Bai , Baoyuan Wu , Jue Wang , Yujiu Yang

Although significant progress has been made in synthesizing high-quality and visually realistic face images by unconditional Generative Adversarial Networks (GANs), there still lacks of control over the generation process in order to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Xianxu Hou , Xiaokang Zhang , Linlin Shen , Zhihui Lai , Jun Wan

Style variation has been a major challenge for person re-identification, which aims to match the same pedestrians across different cameras. Existing works attempted to address this problem with camera-invariant descriptor subspace learning.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Chong Liu , Xiaojun Chang , Yi-Dong Shen

To detect bias in face recognition networks, it can be useful to probe a network under test using samples in which only specific attributes vary in some controlled way. However, capturing a sufficiently large dataset with specific control…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Nataniel Ruiz , Barry-John Theobald , Anurag Ranjan , Ahmed Hussein Abdelaziz , Nicholas Apostoloff

In this work, we introduce a new approach for face stylization. Despite existing methods achieving impressive results in this task, there is still room for improvement in generating high-quality artistic faces with diverse styles and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Mengtian Li , Yi Dong , Minxuan Lin , Haibin Huang , Pengfei Wan , Chongyang Ma

In this paper, we propose a novel encoder, called ShapeEditor, for high-resolution, realistic and high-fidelity face exchange. First of all, in order to ensure sufficient clarity and authenticity, our key idea is to use an advanced…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Shuai Yang , Kai Qiao

Unsupervised image-to-image translation has gained considerable attention due to the recent impressive progress based on generative adversarial networks (GANs). However, previous methods often fail in challenging cases, in particular, when…

Machine Learning · Computer Science 2019-01-03 Sangwoo Mo , Minsu Cho , Jinwoo Shin

While substantial progresses have been made in automated 2D portrait stylization, admirable 3D portrait stylization from a single user photo remains to be an unresolved challenge. One primary obstacle here is the lack of high quality…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Guoxian Song , Hongyi Xu , Jing Liu , Tiancheng Zhi , Yichun Shi , Jianfeng Zhang , Zihang Jiang , Jiashi Feng , Shen Sang , Linjie Luo

Generating animal faces using generative AI techniques is challenging because the available training images are limited both in quantity and variation, particularly for facial expressions across individuals. In this study, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Takuya Igaue , Catia Correia-Caeiro , Akito Yoshida , Takako Miyabe-Nishiwaki , Ryusuke Hayashi

It is well-known that GANs are difficult to train, and several different techniques have been proposed in order to stabilize their training. In this paper, we propose a novel training method called manifold-matching, and a new GAN model…

We present a method for generating alpha mattes using a limited data source. We pretrain a novel transformerbased model (StyleMatte) on portrait datasets. We utilize this model to provide image-mask pairs for the StyleGAN3-based network…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Sergej Chicherin , Karen Efremyan

Facial stylization aims to transform facial images into appealing, high-quality stylized portraits, with the critical challenge of accurately learning the target style while maintaining content consistency with the original image. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zhanyi Lu , Yue Zhou

Recently, StyleGAN has enabled various image manipulation and editing tasks thanks to the high-quality generation and the disentangled latent space. However, additional architectures or task-specific training paradigms are usually required…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Min Jin Chong , Hsin-Ying Lee , David Forsyth

Fake face detection is a significant challenge for intelligent systems as generative models become more powerful every single day. As the quality of fake faces increases, the trained models become more and more inefficient to detect the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Hadi Mansourifar , Weidong Shi

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

Machine Learning · Computer Science 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

Photorealistic editing of portraits is a challenging task as humans are very sensitive to inconsistencies in faces. We present an approach for high-quality intuitive editing of the camera viewpoint and scene illumination in a portrait…

Generating images from human sketches typically requires dedicated networks trained from scratch. In contrast, the emergence of the pre-trained Vision-Language models (e.g., CLIP) has propelled generative applications based on controlling…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Shaocong Zhang

This paper addresses the complex issue of one-shot face stylization, focusing on the simultaneous consideration of appearance and structure, where previous methods have fallen short. We explore deformation-aware face stylization that…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yang Zhou , Zichong Chen , Hui Huang

Generative adversarial models (GANs) continue to produce advances in terms of the visual quality of still images, as well as the learning of temporal correlations. However, few works manage to combine these two interesting capabilities for…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Gereon Fox , Ayush Tewari , Mohamed Elgharib , Christian Theobalt