English
Related papers

Related papers: Unconstrained Facial Expression Transfer using Sty…

200 papers

The face reenactment is a popular facial animation method where the person's identity is taken from the source image and the facial motion from the driving image. Recent works have demonstrated high quality results by combining the facial…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Soumya Tripathy , Juho Kannala , Esa Rahtu

In recent years, the role of image generative models in facial reenactment has been steadily increasing. Such models are usually subject-agnostic and trained on domain-wide datasets. The appearance of the reenacted individual is learned…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Ariel Elazary , Yotam Nitzan , Daniel Cohen-Or

Animating a static face image with target facial expressions and movements is important in the area of image editing and movie production. This face reenactment process is challenging due to the complex geometry and movement of human faces.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Hanxiang Hao , Sriram Baireddy , Amy R. Reibman , Edward J. Delp

Image editing using a pretrained StyleGAN generator has emerged as a powerful paradigm for facial editing, providing disentangled controls over age, expression, illumination, etc. However, the approach cannot be directly adopted for video…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Rameen Abdal , Peihao Zhu , Niloy J. Mitra , Peter Wonka

Face reenactment methods attempt to restore and re-animate portrait videos as realistically as possible. Existing methods face a dilemma in quality versus controllability: 2D GAN-based methods achieve higher image quality but suffer in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Lizhen Wang , Xiaochen Zhao , Jingxiang Sun , Yuxiang Zhang , Hongwen Zhang , Tao Yu , Yebin Liu

Facial expression synthesis has achieved remarkable advances with the advent of Generative Adversarial Networks (GANs). However, GAN-based approaches mostly generate photo-realistic results as long as the testing data distribution is close…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Arbish Akram , Nazar Khan

While recent research has progressively overcome the low-resolution constraint of one-shot face video re-enactment with the help of StyleGAN's high-fidelity portrait generation, these approaches rely on at least one of the following:…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Trevine Oorloff , Yaser Yacoob

The task of age transformation illustrates the change of an individual's appearance over time. Accurately modeling this complex transformation over an input facial image is extremely challenging as it requires making convincing, possibly…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Yuval Alaluf , Or Patashnik , Daniel Cohen-Or

Recent studies have used GAN to transfer expressions between human faces. However, existing models have many flaws: relying on emotion labels, lacking continuous expressions, and failing to capture the expression details. To address these…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Xiaohang Hu , Nuha Aldausari , Gelareh Mohammadi

Generative Adversarial Networks (GANs) have made a dramatic leap in high-fidelity image synthesis and stylized face generation. Recently, a layer-swapping mechanism has been developed to improve the stylization performance. However, this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Mingcong Liu , Qiang Li , Zekui Qin , Guoxin Zhang , Pengfei Wan , Wen Zheng

Recent advances like StyleGAN have promoted the growth of controllable facial editing. To address its core challenge of attribute decoupling in a single latent space, attempts have been made to adopt dual-space GAN for better…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Yanbo Xu , Yueqin Yin , Liming Jiang , Qianyi Wu , Chengyao Zheng , Chen Change Loy , Bo Dai , Wayne Wu

Many recent works have been proposed for face image editing by leveraging the latent space of pretrained GANs. However, few attempts have been made to directly apply them to videos, because 1) they do not guarantee temporal consistency, 2)…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Jiyang Yu , Jingen Liu , Jing Huang , Wei Zhang , Tao Mei

Recent advances in face manipulation using StyleGAN have produced impressive results. However, StyleGAN is inherently limited to cropped aligned faces at a fixed image resolution it is pre-trained on. In this paper, we propose a simple and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Shuai Yang , Liming Jiang , Ziwei Liu , Chen Change Loy

We present an algorithm for re-rendering a person from a single image under arbitrary poses. Existing methods often have difficulties in hallucinating occluded contents photo-realistically while preserving the identity and fine details in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Badour AlBahar , Jingwan Lu , Jimei Yang , Zhixin Shu , Eli Shechtman , Jia-Bin Huang

Existing GAN inversion methods fail to provide latent codes for reliable reconstruction and flexible editing simultaneously. This paper presents a transformer-based image inversion and editing model for pretrained StyleGAN which is not only…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Xueqi Hu , Qiusheng Huang , Zhengyi Shi , Siyuan Li , Changxin Gao , Li Sun , Qingli Li

Although significant progress has been made in synthesizing high-quality and visually realistic face images by unconditional Generative Adversarial Networks (GANs), there still lacks of control over the generation process in order to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Xianxu Hou , Xiaokang Zhang , Linlin Shen , Zhihui Lai , Jun Wan

Facial expression manipulation aims to change human facial expressions without affecting face recognition. In order to transform the facial expressions to target expressions, previous methods relied on expression labels to guide the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Dongya Sun , Yunfei Hu , Xianzhe Zhang , Yingsong Hu

While current face animation methods can manipulate expressions individually, they suffer from several limitations. The expressions manipulated by some motion-based facial reenactment models are crude. Other ideas modeled with facial action…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Tianxiang Ma , Bingchuan Li , Qian He , Jing Dong , Tieniu Tan

In this paper, we address the makeup transfer task, which aims to transfer the makeup from a reference image to a source image. Existing methods have achieved promising progress in constrained scenarios, but transferring between images with…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Wentao Jiang , Si Liu , Chen Gao , Jie Cao , Ran He , Jiashi Feng , Shuicheng Yan

While the recent advances in research on video reenactment have yielded promising results, the approaches fall short in capturing the fine, detailed, and expressive facial features (e.g., lip-pressing, mouth puckering, mouth gaping, and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Trevine Oorloff , Yaser Yacoob