中文
相关论文

相关论文: StyleCLIP: Text-Driven Manipulation of StyleGAN Im…

200 篇论文

Text-driven image manipulation is developed since the vision-language model (CLIP) has been proposed. Previous work has adopted CLIP to design a text-image consistency-based objective to address this issue. However, these methods require…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Wanfeng Zheng , Qiang Li , Xiaoyan Guo , Pengfei Wan , Zhongyuan Wang

Discovering meaningful directions in the latent space of GANs to manipulate semantic attributes typically requires large amounts of labeled data. Recent work aims to overcome this limitation by leveraging the power of Contrastive…

计算机视觉与模式识别 · 计算机科学 2021-12-17 Umut Kocasari , Alara Dirik , Mert Tiftikci , Pinar Yanardag

Researchers have recently begun exploring the use of StyleGAN-based models for real image editing. One particularly interesting application is using natural language descriptions to guide the editing process. Existing approaches for editing…

计算机视觉与模式识别 · 计算机科学 2023-07-19 Ahmet Canberk Baykal , Abdul Basit Anees , Duygu Ceylan , Erkut Erdem , Aykut Erdem , Deniz Yuret

Leveraging StyleGAN's expressivity and its disentangled latent codes, existing methods can achieve realistic editing of different visual attributes such as age and gender of facial images. An intriguing yet challenging problem arises: Can…

计算机视觉与模式识别 · 计算机科学 2022-07-13 Yingchen Yu , Fangneng Zhan , Rongliang Wu , Jiahui Zhang , Shijian Lu , Miaomiao Cui , Xuansong Xie , Xian-Sheng Hua , Chunyan Miao

Automatic image editing has great demands because of its numerous applications, and the use of natural language instructions is essential to achieving flexible and intuitive editing as the user imagines. A pioneering work in text-driven…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Tsuyoshi Baba , Kosuke Nishida , Kyosuke Nishida

This paper tackles text-guided control of StyleGAN for editing garments in full-body human images. Existing StyleGAN-based methods suffer from handling the rich diversity of garments and body shapes and poses. We propose a framework for…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Takato Yoshikawa , Yuki Endo , Yoshihiro Kanamori

Free-form text prompts allow users to describe their intentions during image manipulation conveniently. Based on the visual latent space of StyleGAN[21] and text embedding space of CLIP[34], studies focus on how to map these two latent…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Yiming Zhu , Hongyu Liu , Yibing Song , ziyang Yuan , Xintong Han , Chun Yuan , Qifeng Chen , Jue Wang

The success of StyleGAN has enabled unprecedented semantic editing capabilities, on both synthesized and real images. However, such editing operations are either trained with semantic supervision or described using human guidance. In…

计算机视觉与模式识别 · 计算机科学 2021-12-13 Rameen Abdal , Peihao Zhu , John Femiani , Niloy J. Mitra , Peter Wonka

We introduce a new method to efficiently create text-to-image models from a pre-trained CLIP and StyleGAN. It enables text driven sampling with an existing generative model without any external data or fine-tuning. This is achieved by…

计算机视觉与模式识别 · 计算机科学 2022-10-06 Justin N. M. Pinkney , Chuan Li

Text-guided image generation aimed to generate desired images conditioned on given texts, while text-guided image manipulation refers to semantically edit parts of a given image based on specified texts. For these two similar tasks, the key…

计算机视觉与模式识别 · 计算机科学 2023-09-22 Xiaozhou You , Jian Zhang

In this work, we are dedicated to text-guided image generation and propose a novel framework, i.e., CLIP2GAN, by leveraging CLIP model and StyleGAN. The key idea of our CLIP2GAN is to bridge the output feature embedding space of CLIP and…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Yixuan Wang , Wengang Zhou , Jianmin Bao , Weilun Wang , Li Li , Houqiang Li

With the advantages of fast inference and human-friendly flexible manipulation, image-agnostic style manipulation via text guidance enables new applications that were not previously available. The state-of-the-art text-guided image-agnostic…

计算机视觉与模式识别 · 计算机科学 2023-02-28 Yoonjeon Kim , Hyunsu Kim , Junho Kim , Yunjey Choi , Eunho Yang

The recent GAN inversion methods have been able to successfully invert the real image input to the corresponding editable latent code in StyleGAN. By combining with the language-vision model (CLIP), some text-driven image manipulation…

计算机视觉与模式识别 · 计算机科学 2023-09-22 Yunpeng Bai , Zihan Zhong , Chao Dong , Weichen Zhang , Guowei Xu , Chun Yuan

Generating images from human sketches typically requires dedicated networks trained from scratch. In contrast, the emergence of the pre-trained Vision-Language models (e.g., CLIP) has propelled generative applications based on controlling…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Shaocong Zhang

Generative Adversarial Networks (GANs), particularly StyleGAN and its variants, have demonstrated remarkable capabilities in generating highly realistic images. Despite their success, adapting these models to diverse tasks such as domain…

计算机视觉与模式识别 · 计算机科学 2024-11-21 Abdul Basit Anees , Ahmet Canberk Baykal , Muhammed Burak Kizil , Duygu Ceylan , Erkut Erdem , Aykut Erdem

Can a generative model be trained to produce images from a specific domain, guided by a text prompt only, without seeing any image? In other words: can an image generator be trained "blindly"? Leveraging the semantic power of large scale…

计算机视觉与模式识别 · 计算机科学 2021-12-17 Rinon Gal , Or Patashnik , Haggai Maron , Gal Chechik , Daniel Cohen-Or

Recent studies have shown that StyleGANs provide promising prior models for downstream tasks on image synthesis and editing. However, since the latent codes of StyleGANs are designed to control global styles, it is hard to achieve a…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Yichun Shi , Xiao Yang , Yangyue Wan , Xiaohui Shen

Recent studies on StyleGAN variants show promising performances for various generation tasks. In these models, latent codes have traditionally been manipulated and searched for the desired images. However, this approach sometimes suffers…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Takumi Harada , Kazuyuki Aihara , Hiroyuki Sakai

StyleGAN2 is a state-of-the-art network in generating realistic images. Besides, it was explicitly trained to have disentangled directions in latent space, which allows efficient image manipulation by varying latent factors. Editing…

计算机视觉与模式识别 · 计算机科学 2020-10-23 Yuri Viazovetskyi , Vladimir Ivashkin , Evgeny Kashin

We propose Fast text2StyleGAN, a natural language interface that adapts pre-trained GANs for text-guided human face synthesis. Leveraging the recent advances in Contrastive Language-Image Pre-training (CLIP), no text data is required during…

计算机视觉与模式识别 · 计算机科学 2022-09-09 Xiaodan Du , Raymond A. Yeh , Nicholas Kolkin , Eli Shechtman , Greg Shakhnarovich
‹ 上一页 1 2 3 10 下一页 ›