English
Related papers

Related papers: Customize StyleGAN with One Hand Sketch

200 papers

Image manipulation with StyleGAN has been an increasing concern in recent years.Recent works have achieved tremendous success in analyzing several semantic latent spaces to edit the attributes of the generated images.However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Rui Wang , Jian Chen , Gang Yu , Li Sun , Changqian Yu , Changxin Gao , Nong Sang

Generating images from a single sample, as a newly developing branch of image synthesis, has attracted extensive attention. In this paper, we formulate this problem as sampling from the conditional distribution of a single image, and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 ZiCheng Zhang , CongYing Han , TianDe Guo

Generative adversarial networks (GANs) can now generate photo-realistic images. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN internally conditioned on a set of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-10 Xingzhe He , Bastian Wandt , Helge Rhodin

We introduce a novel sketch-to-image tool that aligns with the iterative refinement process of artists. Our tool lets users sketch blocking strokes to coarsely represent the placement and form of objects and detail strokes to refine their…

Graphics · Computer Science 2024-10-28 Vishnu Sarukkai , Lu Yuan , Mia Tang , Maneesh Agrawala , Kayvon Fatahalian

Visual perceptual tasks aim to predict human judgment of images (e.g., emotions invoked by images, image quality assessment). Unlike objective tasks such as object/scene recognition, perceptual tasks rely on subjective human assessments,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Amit Zalcher , Navve Wasserman , Roman Beliy , Oliver Heinimann , Michal Irani

Face sketch synthesis is a technique aimed at converting face photos into sketches. Existing face sketch synthesis research mainly relies on training with numerous photo-sketch sample pairs from existing datasets. However, these large-scale…

Graphics · Computer Science 2025-06-19 Han Wu , Junyao Li , Kangbo Zhao , Sen Zhang , Yukai Shi , Liang Lin

Recent works on language-guided image manipulation have shown great power of language in providing rich semantics, especially for face images. However, the other natural information, motions, in language is less explored. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Tiankai Hang , Huan Yang , Bei Liu , Jianlong Fu , Xin Geng , Baining Guo

Hand-drawn sketches are a natural and efficient medium for capturing and conveying ideas. Despite significant advancements in controllable natural image generation, translating freehand sketches into structured, machine-readable diagrams…

Artificial Intelligence · Computer Science 2025-08-05 Cheng Tan , Qi Chen , Jingxuan Wei , Gaowei Wu , Zhangyang Gao , Siyuan Li , Bihui Yu , Ruifeng Guo , Stan Z. Li

We introduce MyStyle, a personalized deep generative prior trained with a few shots of an individual. MyStyle allows to reconstruct, enhance and edit images of a specific person, such that the output is faithful to the person's key facial…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Yotam Nitzan , Kfir Aberman , Qiurui He , Orly Liba , Michal Yarom , Yossi Gandelsman , Inbar Mosseri , Yael Pritch , Daniel Cohen-or

The requirement for 3D content is growing as AR/VR application emerges. At the same time, 3D modelling is only available for skillful experts, because traditional methods like Computer-Aided Design (CAD) are often too labor-intensive and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Ying Zang , Yidong Han , Chaotao Ding , Jianqi Zhang , Tianrun Chen

The disentanglement of StyleGAN latent space has paved the way for realistic and controllable image editing, but does StyleGAN know anything about temporal motion, as it was only trained on static images? To study the motion features in the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Qiucheng Wu , Yifan Jiang , Junru Wu , Kai Wang , Gong Zhang , Humphrey Shi , Zhangyang Wang , Shiyu Chang

We investigate the problem of generating 3D meshes from single free-hand sketches, aiming at fast 3D modeling for novice users. It can be regarded as a single-view reconstruction problem, but with unique challenges, brought by the variation…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Song-Hai Zhang , Yuan-Chen Guo , Qing-Wen Gu

This paper presents an innovative approach to achieve face cartoonisation while preserving the original identity and accommodating various poses. Unlike previous methods in this field that relied on conditional-GANs, which posed challenges…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Kushal Jain , Ankith Varun J , Anoop Namboodiri

Text-to-Image models have introduced a remarkable leap in the evolution of machine learning, demonstrating high-quality synthesis of images from a given text-prompt. However, these powerful pretrained models still lack control handles that…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Andrey Voynov , Kfir Aberman , Daniel Cohen-Or

Truncation is widely used in generative models for improving the quality of the generated samples, at the expense of reducing their diversity. We propose to leverage the StyleGAN generative architecture to devise a new truncation technique,…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Oren Katzir , Vicky Perepelook , Dani Lischinski , Daniel Cohen-Or

StyleGAN is known to produce high-fidelity images, while also offering unprecedented semantic editing. However, these fascinating abilities have been demonstrated only on a limited set of datasets, which are usually structurally aligned and…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Ron Mokady , Michal Yarom , Omer Tov , Oran Lang , Daniel Cohen-Or , Tali Dekel , Michal Irani , Inbar Mosseri

State-of-the-art generative models (e.g. StyleGAN3 \cite{karras2021alias}) often generate photorealistic images based on vectors sampled from their latent space. However, the ability to control the output is limited. Here we present our…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Róbert Belanec , Peter Lacko , Kristína Malinovská

Sketch-based image manipulation is an interactive image editing task to modify an image based on input sketches from users. Existing methods typically formulate this task as a conditional inpainting problem, which requires users to draw an…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Yu Zeng , Zhe Lin , Vishal M. Patel

In this work, we propose and validate a framework to leverage language-image pretraining representations for training-free zero-shot sketch-to-image synthesis. We show that disentangled content and style representations can be utilized to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Jan Zuiderveld

Generating preferred images using generative adversarial networks (GANs) is challenging owing to the high-dimensional nature of latent space. In this study, we propose a novel approach that uses simple user-swipe interactions to generate…

Human-Computer Interaction · Computer Science 2024-05-01 Yuto Nakashima , Mingzhe Yang , Yukino Baba