English
Related papers

Related papers: Scribbler: Controlling Deep Image Synthesis with S…

200 papers

Recent facial image synthesis methods have been mainly based on conditional generative models. Sketch-based conditions can effectively describe the geometry of faces, including the contours of facial components, hair structures, as well as…

Graphics · Computer Science 2021-07-20 Shu-Yu Chen , Feng-Lin Liu , Yu-Kun Lai , Paul L. Rosin , Chunpeng Li , Hongbo Fu , Lin Gao

Sketch-based face recognition is an interesting task in vision and multimedia research, yet it is quite challenging due to the great difference between face photos and sketches. In this paper, we propose a novel approach for photo-sketch…

Computer Vision and Pattern Recognition · Computer Science 2015-04-14 Liliang Zhang , Liang Lin , Xian Wu , Shengyong Ding , Lei Zhang

In many applications of computer graphics, art and design, it is desirable for a user to provide intuitive non-image input, such as text, sketch, stroke, graph or layout, and have a computer system automatically generate photo-realistic…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Yuan Xue , Yuan-Chen Guo , Han Zhang , Tao Xu , Song-Hai Zhang , Xiaolei Huang

Synthesizing face sketches from real photos and its inverse have many applications. However, photo/sketch synthesis remains a challenging problem due to the fact that photo and sketch have different characteristics. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2018-03-06 Lidan Wang , Vishwanath A. Sindagi , Vishal M. Patel

Generative Adversarial Networks (GANs) have the capability of synthesizing images, which have been successfully applied to medical image synthesis tasks. However, most of existing methods merely consider the global contextual information…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Tianyang Zhang , Huazhu Fu , Yitian Zhao , Jun Cheng , Mengjie Guo , Zaiwang Gu , Bing Yang , Yuting Xiao , Shenghua Gao , Jiang Liu

We introduce a novel sketch-to-image tool that aligns with the iterative refinement process of artists. Our tool lets users sketch blocking strokes to coarsely represent the placement and form of objects and detail strokes to refine their…

Graphics · Computer Science 2024-10-28 Vishnu Sarukkai , Lu Yuan , Mia Tang , Maneesh Agrawala , Kayvon Fatahalian

In this paper we investigate image generation guided by hand sketch. When the input sketch is badly drawn, the output of common image-to-image translation follows the input edges due to the hard condition imposed by the translation process.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Yongyi Lu , Shangzhe Wu , Yu-Wing Tai , Chi-Keung Tang

Text-to-image models are showcasing the impressive ability to create high-quality and diverse generative images. Nevertheless, the transition from freehand sketches to complex scene images remains challenging using diffusion models. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Tianyu Zhang , Xiaoxuan Xie , Xusheng Du , Haoran Xie

Face modeling has been paid much attention in the field of visual computing. There exist many scenarios, including cartoon characters, avatars for social media, 3D face caricatures as well as face-related art and design, where low-cost…

Graphics · Computer Science 2017-06-08 Xiaoguang Han , Chang Gao , Yizhou Yu

Convolutional neural networks (CNNs) with deep architectures have substantially advanced the state-of-the-art in computer vision tasks. However, deep networks are typically resource-intensive and thus difficult to be deployed on mobile…

Neural and Evolutionary Computing · Computer Science 2017-06-08 Yiwen Guo , Anbang Yao , Hao Zhao , Yurong Chen

Sketch-guided image editing aims to achieve local fine-tuning of the image based on the sketch information provided by the user, while maintaining the original status of the unedited areas. Due to the high cost of acquiring human sketches,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Weihang Mao , Bo Han , Zihao Wang

Face photo-sketch synthesis aims at generating a facial sketch/photo conditioned on a given photo/sketch. It is of wide applications including digital entertainment and law enforcement. Precisely depicting face photos/sketches remains…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Jun Yu , Xingxin Xu , Fei Gao , Shengjie Shi , Meng Wang , Dacheng Tao , Qingming Huang

Normal map is an important and efficient way to represent complex 3D models. A designer may benefit from the auto-generation of high quality and accurate normal maps from freehand sketches in 3D content creation. This paper proposes a deep…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Yi He , Haoran Xie , Chao Zhang , Xi Yang , Kazunori Miyata

Sketches serve as fundamental blueprints in artistic creation because sketch editing is easier and more intuitive than pixel-level RGB image editing for painting artists, yet sketch generation remains unexplored despite advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Ruohao Zhan , Yijin Li , Yisheng He , Shuo Chen , Yichen Shen , Xinyu Chen , Zilong Dong , Zhaoyang Huang , Guofeng Zhang

Recent years have witnessed remarkable progress in generative AI, with natural language emerging as the most common conditioning input. As underlying models grow more powerful, researchers are exploring increasingly diverse conditioning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Ahmed Bourouis , Mikhail Bessmeltsev , Yulia Gryaditskaya

Deep image-based modeling received lots of attention in recent years, yet the parallel problem of sketch-based modeling has only been briefly studied, often as a potential application. In this work, for the first time, we identify the main…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Yue Zhong , Yulia Gryaditskaya , Honggang Zhang , Yi-Zhe Song

We propose a new approach for synthesizing fully detailed art-stylized images from sketches. Given a sketch, with no semantic tagging, and a reference image of a specific style, the model can synthesize meaningful details with colors and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Bingchen Liu , Kunpeng Song , Ahmed Elgammal

Face photo synthesis from simple line drawing is a one-to-many task as simple line drawing merely contains the contour of human face. Previous exemplar-based methods are over-dependent on the datasets and are hard to generalize to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-10 Qi Guo , Ce Zhu , Zhiqiang Xia , Zhengtao Wang , Yipeng Liu

In recent years, Generative Adversarial Networks have achieved impressive results in photorealistic image synthesis. This progress nurtures hopes that one day the classical rendering pipeline can be replaced by efficient models that are…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Yiyi Liao , Katja Schwarz , Lars Mescheder , Andreas Geiger

Recent advancements in large vision-language models have enabled highly expressive and diverse vector sketch generation. However, state-of-the-art methods rely on a time-consuming optimization process involving repeated feedback from a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Ellie Arar , Yarden Frenkel , Daniel Cohen-Or , Ariel Shamir , Yael Vinker