English
Related papers

Related papers: Customize StyleGAN with One Hand Sketch

200 papers

This paper tackles text-guided control of StyleGAN for editing garments in full-body human images. Existing StyleGAN-based methods suffer from handling the rich diversity of garments and body shapes and poses. We propose a framework for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Takato Yoshikawa , Yuki Endo , Yoshihiro Kanamori

In this paper, we propose a framework capable of generating face images that fall into the same distribution as that of a given one-shot example. We leverage a pre-trained StyleGAN model that already learned the generic face distribution.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Chao Yang , Ser-Nam Lim

Given an abstract, deformed, ordinary sketch from untrained amateurs like you and me, this paper turns it into a photorealistic image - just like those shown in Fig. 1(a), all non-cherry-picked. We differ significantly from prior art in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Subhadeep Koley , Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

We present an algorithm for re-rendering a person from a single image under arbitrary poses. Existing methods often have difficulties in hallucinating occluded contents photo-realistically while preserving the identity and fine details in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Badour AlBahar , Jingwan Lu , Jimei Yang , Zhixin Shu , Eli Shechtman , Jia-Bin Huang

Creating meaningful art is often viewed as a uniquely human endeavor. A human artist needs a combination of unique skills, understanding, and genuine intention to create artworks that evoke deep feelings and emotions. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Konstantin Dobler , Florian Hübscher , Jan Westphal , Alejandro Sierra-Múnera , Gerard de Melo , Ralf Krestel

Automatic image editing has great demands because of its numerous applications, and the use of natural language instructions is essential to achieving flexible and intuitive editing as the user imagines. A pioneering work in text-driven…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Tsuyoshi Baba , Kosuke Nishida , Kyosuke Nishida

Image stylization aims at applying a reference style to arbitrary input images. A common scenario is one-shot stylization, where only one example is available for each reference style. Recent approaches for one-shot stylization such as…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Viraj Shah , Ayush Sarkar , Sudharsan Krishnakumar Anitha , Svetlana Lazebnik

Significant progress has recently been made in creative applications of large pre-trained models for downstream tasks in 3D vision, such as text-to-shape generation. This motivates our investigation of how these pre-trained models can be…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Aditya Sanghi , Pradeep Kumar Jayaraman , Arianna Rampini , Joseph Lambourne , Hooman Shayani , Evan Atherton , Saeid Asgari Taghanaki

While the quality of GAN image synthesis has improved tremendously in recent years, our ability to control and condition the output is still limited. Focusing on StyleGAN, we introduce a simple and effective method for making local,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Edo Collins , Raja Bala , Bob Price , Sabine Süsstrunk

Recent years have witnessed remarkable progress in generative AI, with natural language emerging as the most common conditioning input. As underlying models grow more powerful, researchers are exploring increasingly diverse conditioning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Ahmed Bourouis , Mikhail Bessmeltsev , Yulia Gryaditskaya

We introduce a new method to efficiently create text-to-image models from a pre-trained CLIP and StyleGAN. It enables text driven sampling with an existing generative model without any external data or fine-tuning. This is achieved by…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Justin N. M. Pinkney , Chuan Li

Portrait sketching involves capturing identity specific attributes of a real face with abstract lines and shades. Unlike photo-realistic images, a good portrait sketch generation method needs selective attention to detail, making the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Kushal Kumar Jain , Ankith Varun J , Anoop Namboodiri

Leveraging StyleGAN's expressivity and its disentangled latent codes, existing methods can achieve realistic editing of different visual attributes such as age and gender of facial images. An intriguing yet challenging problem arises: Can…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Yingchen Yu , Fangneng Zhan , Rongliang Wu , Jiahui Zhang , Shijian Lu , Miaomiao Cui , Xuansong Xie , Xian-Sheng Hua , Chunyan Miao

Recently, StyleGAN has enabled various image manipulation and editing tasks thanks to the high-quality generation and the disentangled latent space. However, additional architectures or task-specific training paradigms are usually required…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Min Jin Chong , Hsin-Ying Lee , David Forsyth

We present a fully automated framework for building object detectors on satellite imagery without requiring any human annotation or intervention. We achieve this by leveraging the combined power of modern generative models (e.g., StyleGAN)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Yuzhe Lu , Shusen Liu , Jayaraman J. Thiagarajan , Wesam Sakla , Rushil Anirudh

Researchers have recently begun exploring the use of StyleGAN-based models for real image editing. One particularly interesting application is using natural language descriptions to guide the editing process. Existing approaches for editing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Ahmet Canberk Baykal , Abdul Basit Anees , Duygu Ceylan , Erkut Erdem , Aykut Erdem , Deniz Yuret

Generative adversarial models (GANs) continue to produce advances in terms of the visual quality of still images, as well as the learning of temporal correlations. However, few works manage to combine these two interesting capabilities for…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Gereon Fox , Ayush Tewari , Mohamed Elgharib , Christian Theobalt

The application of zero-shot learning in computer vision has been revolutionized by the use of image-text matching models. The most notable example, CLIP, has been widely used for both zero-shot classification and guiding generative models…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Roni Paiss , Hila Chefer , Lior Wolf

Advancements in generative models have sparked significant interest in generating images while adhering to specific structural guidelines. Scene graph to image generation is one such task of generating images which are consistent with the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Rameshwar Mishra , A V Subramanyam

In recent years, the recognition of free-hand sketches has remained a popular task. However, in some special fields such as the military field, free-hand sketches are difficult to sample on a large scale. Common data augmentation and image…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Jiajun Liu , Siyuan Wang , Guangming Zhu , Liang Zhang , Ning Li , Eryang Gao