中文
相关论文

相关论文: Towards Arbitrary Text-driven Image Manipulation v…

200 篇论文

We introduce a new method to efficiently create text-to-image models from a pre-trained CLIP and StyleGAN. It enables text driven sampling with an existing generative model without any external data or fine-tuning. This is achieved by…

计算机视觉与模式识别 · 计算机科学 2022-10-06 Justin N. M. Pinkney , Chuan Li

The success of StyleGAN has enabled unprecedented semantic editing capabilities, on both synthesized and real images. However, such editing operations are either trained with semantic supervision or described using human guidance. In…

计算机视觉与模式识别 · 计算机科学 2021-12-13 Rameen Abdal , Peihao Zhu , John Femiani , Niloy J. Mitra , Peter Wonka

Recent studies on StyleGAN variants show promising performances for various generation tasks. In these models, latent codes have traditionally been manipulated and searched for the desired images. However, this approach sometimes suffers…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Takumi Harada , Kazuyuki Aihara , Hiroyuki Sakai

The recent success of the generative model shows that leveraging the multi-modal embedding space can manipulate an image using text information. However, manipulating an image with other sources rather than text, such as sound, is not easy…

图形学 · 计算机科学 2021-12-02 Seung Hyun Lee , Wonseok Roh , Wonmin Byeon , Sang Ho Yoon , Chan Young Kim , Jinkyu Kim , Sangpil Kim

The existing text-guided image synthesis methods can only produce limited quality results with at most \mbox{$\text{256}^2$} resolution and the textual instructions are constrained in a small Corpus. In this work, we propose a unified…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Weihao Xia , Yujiu Yang , Jing-Hao Xue , Baoyuan Wu

While the quality of GAN image synthesis has improved tremendously in recent years, our ability to control and condition the output is still limited. Focusing on StyleGAN, we introduce a simple and effective method for making local,…

计算机视觉与模式识别 · 计算机科学 2020-05-22 Edo Collins , Raja Bala , Bob Price , Sabine Süsstrunk

Understating and controlling generative models' latent space is a complex task. In this paper, we propose a novel method for learning to control any desired attribute in a pre-trained GAN's latent space, for the purpose of editing…

计算机视觉与模式识别 · 计算机科学 2021-11-18 Nir Diamant , Nitsan Sandor , Alex M Bronstein

Image manipulation with StyleGAN has been an increasing concern in recent years.Recent works have achieved tremendous success in analyzing several semantic latent spaces to edit the attributes of the generated images.However, due to the…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Rui Wang , Jian Chen , Gang Yu , Li Sun , Changqian Yu , Changxin Gao , Nong Sang

Recently, GAN inversion methods combined with Contrastive Language-Image Pretraining (CLIP) enables zero-shot image manipulation guided by text prompts. However, their applications to diverse real images are still difficult due to the…

计算机视觉与模式识别 · 计算机科学 2022-08-12 Gwanghyun Kim , Taesung Kwon , Jong Chul Ye

This paper investigates an open research task of text-to-image synthesis for automatically generating or manipulating images from text descriptions. Prevailing methods mainly use the text as conditions for GAN generation, and train…

计算机视觉与模式识别 · 计算机科学 2021-09-14 Hao Wang , Guosheng Lin , Steven C. H. Hoi , Chunyan Miao

Deep generative models like StyleGAN hold the promise of semantic image editing: modifying images by their content, rather than their pixel values. Unfortunately, working with arbitrary images requires inverting the StyleGAN generator,…

计算机视觉与模式识别 · 计算机科学 2022-05-16 Yohan Poirier-Ginter , Alexandre Lessard , Ryan Smith , Jean-François Lalonde

Generative models make huge progress to the photorealistic image synthesis in recent years. To enable human to steer the image generation process and customize the output, many works explore the interpretable dimensions of the latent space…

计算机视觉与模式识别 · 计算机科学 2024-01-11 Jianyuan Wang , Lalit Bhagat , Ceyuan Yang , Yinghao Xu , Yujun Shen , Hongdong Li , Bolei Zhou

Recent advances in high-fidelity semantic image editing heavily rely on the presumably disentangled latent spaces of the state-of-the-art generative models, such as StyleGAN. Specifically, recent works show that it is possible to achieve…

计算机视觉与模式识别 · 计算机科学 2021-11-30 Valentin Khrulkov , Leyla Mirvakhabova , Ivan Oseledets , Artem Babenko

Many recent works have been proposed for face image editing by leveraging the latent space of pretrained GANs. However, few attempts have been made to directly apply them to videos, because 1) they do not guarantee temporal consistency, 2)…

计算机视觉与模式识别 · 计算机科学 2022-06-28 Jiyang Yu , Jingen Liu , Jing Huang , Wei Zhang , Tao Mei

This paper describes a new technique for finding disentangled semantic directions in the latent space of StyleGAN. Our method identifies meaningful orthogonal subspaces that allow editing of one human face attribute, while minimizing…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Chen Naveh , Yacov Hel-Or

We present StyleMamba, an efficient image style transfer framework that translates text prompts into corresponding visual styles while preserving the content integrity of the original images. Existing text-guided stylization requires…

计算机视觉与模式识别 · 计算机科学 2024-05-09 Zijia Wang , Zhi-Song Liu

Language-based fashion image editing allows users to try out variations of desired garments through provided text prompts. Inspired by research on manipulating latent representations in StyleCLIP and HairCLIP, we focus on these latent…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Reza Dadfar , Sanaz Sabzevari , Mårten Björkman , Danica Kragic

Generative Adversarial Networks (GANs) are currently an indispensable tool for visual editing, being a standard component of image-to-image translation and image restoration pipelines. Furthermore, GANs are especially useful for…

机器学习 · 计算机科学 2021-04-22 Anton Cherepkov , Andrey Voynov , Artem Babenko

StyleMamba has recently demonstrated efficient text-driven image style transfer by leveraging state-space models (SSMs) and masked directional losses. In this paper, we extend the StyleMamba framework to handle video sequences. We propose…

图形学 · 计算机科学 2025-07-31 Chao Li , Minsu Park , Cristina Rossi , Zhuang Li

The success of Deep Generative Models at high-resolution image generation has led to their extensive utilization for style editing of real images. Most existing methods work on the principle of inverting real images onto their latent space,…

计算机视觉与模式识别 · 计算机科学 2022-12-13 Snehal Singh Tomar , Maitreya Suin , A. N. Rajagopalan