English
Related papers

Related papers: Video2StyleGAN: Encoding Video in Latent Space for…

200 papers

Semantic facial attribute editing using pre-trained Generative Adversarial Networks (GANs) has attracted a great deal of attention and effort from researchers in recent years. Due to the high quality of face images generated by StyleGANs,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Najmeh Mohammadbagheri , Fardin Ayar , Ahmad Nickabadi , Reza Safabakhsh

The exploration of the latent space in StyleGANs and GAN inversion exemplify impressive real-world image editing, yet the trade-off between reconstruction quality and editing quality remains an open problem. In this study, we revisit…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Kai Katsumata , Duc Minh Vo , Bei Liu , Hideki Nakayama

Controllable semantic image editing enables a user to change entire image attributes with a few clicks, e.g., gradually making a summer scene look like it was taken in winter. Classic approaches for this task use a Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Peiye Zhuang , Oluwasanmi Koyejo , Alexander G. Schwing

Our paper seeks to transfer the hairstyle of a reference image to an input photo for virtual hair try-on. We target a variety of challenges scenarios, such as transforming a long hairstyle with bangs to a pixie cut, which requires removing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Sasikarn Khwanmuang , Pakkapon Phongthawee , Patsorn Sangkloy , Supasorn Suwajanakorn

Recently audio-driven talking face video generation has attracted considerable attention. However, very few researches address the issue of emotional editing of these talking face videos with continuously controllable expressions, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyao Sun , Yu-Hui Wen , Tian Lv , Yanan Sun , Ziyang Zhang , Yaoyuan Wang , Yong-Jin Liu

3D face editing is a significant task in multimedia, aimed at the manipulation of 3D face models across various control signals. The success of 3D-aware GAN provides expressive 3D models learned from 2D single-view images only, encouraging…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Zhuo Chen , Yichao Yan , Sehngqi Liu , Yuhao Cheng , Weiming Zhao , Lincheng Li , Mengxiao Bi , Xiaokang Yang

Photo-realistic re-rendering of a human from a single image with explicit control over body pose, shape and appearance enables a wide range of applications, such as human appearance transfer, virtual try-on, motion imitation, and novel view…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Kripasindhu Sarkar , Vladislav Golyanik , Lingjie Liu , Christian Theobalt

Recently, the power of unconditional image synthesis has significantly advanced through the use of Generative Adversarial Networks (GANs). The task of inverting an image into its corresponding latent code of the trained GAN is of utmost…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Yuval Alaluf , Or Patashnik , Daniel Cohen-Or

Researchers have recently begun exploring the use of StyleGAN-based models for real image editing. One particularly interesting application is using natural language descriptions to guide the editing process. Existing approaches for editing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Ahmet Canberk Baykal , Abdul Basit Anees , Duygu Ceylan , Erkut Erdem , Aykut Erdem , Deniz Yuret

We introduce a highly robust GAN-based framework for digitizing a normalized 3D avatar of a person from a single unconstrained photo. While the input image can be of a smiling person or taken in extreme lighting conditions, our method can…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Huiwen Luo , Koki Nagano , Han-Wei Kung , Mclean Goldwhite , Qingguo Xu , Zejian Wang , Lingyu Wei , Liwen Hu , Hao Li

Human video motion transfer has a wide range of applications in multimedia, computer vision and graphics. Recently, due to the rapid development of Generative Adversarial Networks (GANs), there has been significant progress in the field.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Dongxu Wei , Xiaowei Xu , Haibin Shen , Kejie Huang

Building facial analysis systems that generalize to extreme variations in lighting and facial expressions is a challenging problem that can potentially be alleviated using natural-looking synthetic data. Towards that, we propose LEGAN, a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Sandipan Banerjee , Ajjen Joshi , Prashant Mahajan , Sneha Bhattacharya , Survi Kyal , Taniya Mishra

Facial expression manipulation aims to change human facial expressions without affecting face recognition. In order to transform the facial expressions to target expressions, previous methods relied on expression labels to guide the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Dongya Sun , Yunfei Hu , Xianzhe Zhang , Yingsong Hu

Generative Adversarial Networks (GANs) can synthesize realistic images, with the learned latent space shown to encode rich semantic information with various interpretable directions. However, due to the unstructured nature of the learned…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Zikun Chen , Han Zhao , Parham Aarabi , Ruowei Jiang

High-level manipulation of facial expressions in images --- such as changing a smile to a neutral expression --- is challenging because facial expression changes are highly non-linear, and vary depending on the appearance of the face. We…

Computer Vision and Pattern Recognition · Computer Science 2016-12-01 Raymond Yeh , Ziwei Liu , Dan B Goldman , Aseem Agarwala

Due to the emergence of Generative Adversarial Networks, video synthesis has witnessed exceptional breakthroughs. However, existing methods lack a proper representation to explicitly control the dynamics in videos. Human pose, on the other…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Ceyuan Yang , Zhe Wang , Xinge Zhu , Chen Huang , Jianping Shi , Dahua Lin

Everyday, we are bombarded with many photographs of faces, whether on social media, television, or smartphones. From an evolutionary perspective, faces are intended to be remembered, mainly due to survival and personal relevance. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Mohammad Younesi , Yalda Mohsenzadeh

Recently, there has been numerous breakthroughs in face hallucination tasks. However, the task remains rather challenging in videos in comparison to the images due to inherent consistency issues. The presence of extra temporal dimension in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Shailza Sharma , Abhinav Dhall , Vinay Kumar , Vivek Singh Bawa

Endoscopic videos from multicentres often have different imaging conditions, e.g., color and illumination, which make the models trained on one domain usually fail to generalize well to another. Domain adaptation is one of the potential…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Jiawei Chen , Yuexiang Li , Kai Ma , Yefeng Zheng

Generating high-quality artistic portrait videos is an important and desirable task in computer graphics and vision. Although a series of successful portrait image toonification models built upon the powerful StyleGAN have been proposed,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Shuai Yang , Liming Jiang , Ziwei Liu , Chen Change Loy