English
Related papers

Related papers: StyleAlign: Analysis and Applications of Aligned S…

200 papers

Facial expression transfer and reenactment has been an important research problem given its applications in face editing, image manipulation, and fabricated videos generation. We present a novel method for image-based facial expression…

Computer Vision and Pattern Recognition · Computer Science 2019-12-16 Chao Yang , Ser-Nam Lim

Image-to-image (I2I) translation is usually carried out among discrete domains. However, image domains, often corresponding to a physical value, are usually continuous. In other words, images gradually change with the value, and there…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Qiusheng Huang , Xueqi Hu , Li Sun , Qingli Li

We introduce a new method to efficiently create text-to-image models from a pre-trained CLIP and StyleGAN. It enables text driven sampling with an existing generative model without any external data or fine-tuning. This is achieved by…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Justin N. M. Pinkney , Chuan Li

Recently image-to-image translation has received increasing attention, which aims to map images in one domain to another specific one. Existing methods mainly solve this task via a deep generative model, and focus on exploring the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Songyao Jiang , Zhiqiang Tao , Yun Fu

Recent advances in face manipulation using StyleGAN have produced impressive results. However, StyleGAN is inherently limited to cropped aligned faces at a fixed image resolution it is pre-trained on. In this paper, we propose a simple and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Shuai Yang , Liming Jiang , Ziwei Liu , Chen Change Loy

With the remarkable recent progress on learning deep generative models, it becomes increasingly interesting to develop models for controllable image synthesis from reconfigurable inputs. This paper focuses on a recent emerged task,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Wei Sun , Tianfu Wu

GAN inversion aims to invert a given image back into the latent space of a pretrained GAN model, for the image to be faithfully reconstructed from the inverted code by the generator. As an emerging technique to bridge the real and fake…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Weihao Xia , Yulun Zhang , Yujiu Yang , Jing-Hao Xue , Bolei Zhou , Ming-Hsuan Yang

StyleGAN is arguably one of the most intriguing and well-studied generative models, demonstrating impressive performance in image generation, inversion, and manipulation. In this work, we explore the recent StyleGAN3 architecture, compare…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Yuval Alaluf , Or Patashnik , Zongze Wu , Asif Zamir , Eli Shechtman , Dani Lischinski , Daniel Cohen-Or

Generative Adversarial Networks (GANs), particularly StyleGAN and its variants, have demonstrated remarkable capabilities in generating highly realistic images. Despite their success, adapting these models to diverse tasks such as domain…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Abdul Basit Anees , Ahmet Canberk Baykal , Muhammed Burak Kizil , Duygu Ceylan , Erkut Erdem , Aykut Erdem

Recent deep generative models are able to provide photo-realistic images as well as visual or textual content embeddings useful to address various tasks of computer vision and natural language processing. Their usefulness is nevertheless…

Machine Learning · Computer Science 2020-01-29 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

StyleGAN is a state-of-art generative adversarial network architecture that generates random 2D high-quality synthetic facial data samples. In this paper, we recap the StyleGAN architecture and training methodology and present our…

Neural and Evolutionary Computing · Computer Science 2020-03-25 Viktor Varkarakis , Shabab Bazrafkan , Peter Corcoran

Despite remarkable recent progress on both unconditional and conditional image synthesis, it remains a long-standing problem to learn generative models that are capable of synthesizing realistic and sharp images from reconfigurable spatial…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Wei Sun , Tianfu Wu

Transferring the knowledge of pretrained networks to new domains by means of finetuning is a widely used practice for applications based on discriminative models. To the best of our knowledge this practice has not been studied within the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Yaxing Wang , Chenshen Wu , Luis Herranz , Joost van de Weijer , Abel Gonzalez-Garcia , Bogdan Raducanu

Generative models have enabled the creation of contents that are indistinguishable from those taken from nature. Open-source development of such models raised concerns about the risks of their misuse for malicious purposes. One potential…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Guangyu Nie , Changhoon Kim , Yezhou Yang , Yi Ren

We propose a method to transfer pose and expression between face images. Given a source and target face portrait, the model produces an output image in which the pose and expression of the source face image are transferred onto the target…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Petr Jahoda , Jan Cech

Although significant progress has been made in synthesizing high-quality and visually realistic face images by unconditional Generative Adversarial Networks (GANs), there still lacks of control over the generation process in order to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Xianxu Hou , Xiaokang Zhang , Linlin Shen , Zhihui Lai , Jun Wan

Recently, large pretrained models (e.g., BERT, StyleGAN, CLIP) have shown great knowledge transfer and generalization capability on various downstream tasks within their domains. Inspired by these efforts, in this paper we propose a unified…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Jing Shi , Ning Xu , Haitian Zheng , Alex Smith , Jiebo Luo , Chenliang Xu

While different neural models often exhibit latent spaces that are alike when exposed to semantically related data, this intrinsic similarity is not always immediately discernible. Towards a better understanding of this phenomenon, our work…

Machine Learning · Computer Science 2024-02-13 Valentino Maiorca , Luca Moschella , Antonio Norelli , Marco Fumero , Francesco Locatello , Emanuele Rodolà

Image-to-image translation, which translates input images to a different domain with a learned one-to-one mapping, has achieved impressive success in recent years. The success of translation mainly relies on the network architecture to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Wenju Xu , Shawn Keshmiri , Guanghui Wang

We present an algorithm for re-rendering a person from a single image under arbitrary poses. Existing methods often have difficulties in hallucinating occluded contents photo-realistically while preserving the identity and fine details in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Badour AlBahar , Jingwan Lu , Jimei Yang , Zhixin Shu , Eli Shechtman , Jia-Bin Huang