English
Related papers

Related papers: CLIP-Guided StyleGAN Inversion for Text-Driven Rea…

200 papers

GAN inversion aims at inverting given images into corresponding latent codes for Generative Adversarial Networks (GANs), especially StyleGAN where exists a disentangled latent space that allows attribute-based image manipulation at latent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Chenyi Zhuang , Pan Gao , Aljosa Smolic

Can a generative model be trained to produce images from a specific domain, guided by a text prompt only, without seeing any image? In other words: can an image generator be trained "blindly"? Leveraging the semantic power of large scale…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Rinon Gal , Or Patashnik , Haggai Maron , Gal Chechik , Daniel Cohen-Or

Recent image tone adjustment (or enhancement) approaches have predominantly adopted supervised learning for learning human-centric perceptual assessment. However, these approaches are constrained by intrinsic challenges of supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Hyeongmin Lee , Kyoungkook Kang , Jungseul Ok , Sunghyun Cho

With the advantages of fast inference and human-friendly flexible manipulation, image-agnostic style manipulation via text guidance enables new applications that were not previously available. The state-of-the-art text-guided image-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Yoonjeon Kim , Hyunsu Kim , Junho Kim , Yunjey Choi , Eunho Yang

The task of manipulating real image attributes through StyleGAN inversion has been extensively researched. This process involves searching latent variables from a well-trained StyleGAN generator that can synthesize a real image, modifying…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Denis Bobkov , Vadim Titov , Aibek Alanov , Dmitry Vetrov

StyleGAN2 is a state-of-the-art network in generating realistic images. Besides, it was explicitly trained to have disentangled directions in latent space, which allows efficient image manipulation by varying latent factors. Editing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Yuri Viazovetskyi , Vladimir Ivashkin , Evgeny Kashin

Recent works on language-guided image manipulation have shown great power of language in providing rich semantics, especially for face images. However, the other natural information, motions, in language is less explored. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Tiankai Hang , Huan Yang , Bei Liu , Jianlong Fu , Xin Geng , Baining Guo

Employing the latent space of pretrained generators has recently been shown to be an effective means for GAN-based face manipulation. The success of this approach heavily relies on the innate disentanglement of the latent space axes of the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Xianxu Hou , Linlin Shen , Or Patashnik , Daniel Cohen-Or , Hui Huang

Recently large-scale language-image models (e.g., text-guided diffusion models) have considerably improved the image generation capabilities to generate photorealistic images in various domains. Based on this success, current image editing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Wenkai Dong , Song Xue , Xiaoyue Duan , Shumin Han

StyleGAN models show editing capabilities via their semantically interpretable latent organizations which require successful GAN inversion methods to edit real images. Many works have been proposed for inverting images into StyleGAN's…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Ahmet Burak Yildirim , Hamza Pehlivan , Aysegul Dundar

Precise and flexible image editing remains a fundamental challenge in computer vision. Based on the modified areas, most editing methods can be divided into two main types: global editing and local editing. In this paper, we choose the two…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Ziqi Jiang , Zhen Wang , Long Chen

Recently, a surge of advanced facial editing techniques have been proposed that leverage the generative power of a pre-trained StyleGAN. To successfully edit an image this way, one must first project (or invert) the image into the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Daniel Roich , Ron Mokady , Amit H. Bermano , Daniel Cohen-Or

We propose Fast text2StyleGAN, a natural language interface that adapts pre-trained GANs for text-guided human face synthesis. Leveraging the recent advances in Contrastive Language-Image Pre-training (CLIP), no text data is required during…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Xiaodan Du , Raymond A. Yeh , Nicholas Kolkin , Eli Shechtman , Greg Shakhnarovich

Free-form text prompts allow users to describe their intentions during image manipulation conveniently. Based on the visual latent space of StyleGAN[21] and text embedding space of CLIP[34], studies focus on how to map these two latent…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Yiming Zhu , Hongyu Liu , Yibing Song , ziyang Yuan , Xintong Han , Chun Yuan , Qifeng Chen , Jue Wang

The ability to edit facial expressions has a wide range of applications in computer graphics. The ideal facial expression editing algorithm needs to satisfy two important criteria. First, it should allow precise and targeted editing of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Alara Zindancıoğlu , T. Metin Sezgin

Text-to-image diffusion models have remarkably excelled in producing diverse, high-quality, and photo-realistic images. This advancement has spurred a growing interest in incorporating specific identities into generated content. Most…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaoming Li , Xinyu Hou , Chen Change Loy

Pixel-level fine-grained image editing remains an open challenge. Previous works fail to achieve an ideal trade-off between control granularity and inference speed. They either fail to achieve pixel-level fine-grained control, or their…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Pengxiang Cai , Zhiwei Liu , Guibo Zhu , Yunfang Niu , Jinqiao Wang

Training a text-to-image generator in the general domain (e.g., Dall.e, CogView) requires huge amounts of paired text-image data, which is too expensive to collect. In this paper, we propose a self-supervised scheme named as CLIP-GEN for…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Zihao Wang , Wei Liu , Qian He , Xinglong Wu , Zili Yi

StyleGAN's disentangled style representation enables powerful image editing by manipulating the latent variables, but accurately mapping real-world images to their latent variables (GAN inversion) remains a challenge. Existing GAN inversion…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Anand Bhattad , Viraj Shah , Derek Hoiem , D. A. Forsyth

Existing GAN inversion and editing methods work well for aligned objects with a clean background, such as portraits and animal faces, but often struggle for more difficult categories with complex scene layouts and object occlusions, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Gaurav Parmar , Yijun Li , Jingwan Lu , Richard Zhang , Jun-Yan Zhu , Krishna Kumar Singh