English
Related papers

Related papers: DoodleFormer: Creative Sketch Drawing with Transfo…

200 papers

Sketches serve as fundamental blueprints in artistic creation because sketch editing is easier and more intuitive than pixel-level RGB image editing for painting artists, yet sketch generation remains unexplored despite advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Ruohao Zhan , Yijin Li , Yisheng He , Shuo Chen , Yichen Shen , Xinyu Chen , Zilong Dong , Zhaoyang Huang , Guofeng Zhang

Text-to-image models are showcasing the impressive ability to create high-quality and diverse generative images. Nevertheless, the transition from freehand sketches to complex scene images remains challenging using diffusion models. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Tianyu Zhang , Xiaoxuan Xie , Xusheng Du , Haoran Xie

Although recent advancements in diffusion models have significantly enriched the quality of generated images, challenges remain in synthesizing pixel-based human-drawn sketches, a representative example of abstract expression. To combat…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Jiho Park , Sieun Choi , Jaeyoon Seo , Jihie Kim

Researchers have explored various ways to generate realistic images from freehand sketches, e.g., for objects and human faces. However, how to generate realistic human body images from sketches is still a challenging problem. It is, first…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Xian Wu , Chen Wang , Hongbo Fu , Ariel Shamir , Song-Hai Zhang , Shi-Min Hu

Recent deep image-to-image translation techniques allow fast generation of face images from freehand sketches. However, existing solutions tend to overfit to sketches, thus requiring professional sketches or even edge maps as input. To…

Graphics · Computer Science 2020-06-09 Shu-Yu Chen , Wanchao Su , Lin Gao , Shihong Xia , Hongbo Fu

Sketch-based image editing aims to synthesize and modify photos based on the structural information provided by the human-drawn sketches. Since sketches are difficult to collect, previous methods mainly use edge maps instead of sketches to…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Shuai Yang , Zhangyang Wang , Jiaying Liu , Zongming Guo

Sketching provides an intuitive way to convey dynamic intent in animation authoring (i.e., how elements change over time and space), making it a natural medium for automatic content creation. Yet existing approaches often constrain sketches…

Human-Computer Interaction · Computer Science 2026-01-29 Boyu Li , Lin-Ping Yuan , Zeyu Wang , Hongbo Fu

Graphic layout generation is a growing research area focusing on generating aesthetically pleasing layouts ranging from poster designs to documents. While recent research has explored ways to incorporate user constraints to guide the layout…

Sketching is a uniquely human tool for expressing ideas and creativity. The animation of sketches infuses life into these static drawings, opening a new dimension for designers. Animating sketches is a time-consuming process that demands…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Ruolin Yang , Da Li , Honggang Zhang , Yi-Zhe Song

To see is to sketch -- free-hand sketching naturally builds ties between human and machine vision. In this paper, we present a novel approach for translating an object photo to a sketch, mimicking the human sketching process. This is an…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Jifei Song , Kaiyue Pang , Yi-Zhe Song , Tao Xiang , Timothy Hospedales

Given an abstract, deformed, ordinary sketch from untrained amateurs like you and me, this paper turns it into a photorealistic image - just like those shown in Fig. 1(a), all non-cherry-picked. We differ significantly from prior art in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Subhadeep Koley , Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Computer-aided design (CAD) is the most widely used modeling approach for technical design. The typical starting point in these designs is 2D sketches which can later be extruded and combined to obtain complex three-dimensional assemblies.…

Machine Learning · Computer Science 2021-06-08 Wamiq Reyaz Para , Shariq Farooq Bhat , Paul Guerrero , Tom Kelly , Niloy Mitra , Leonidas Guibas , Peter Wonka

We propose a multi-scale multi-channel deep neural network framework that, for the first time, yields sketch recognition performance surpassing that of humans. Our superior performance is a result of explicitly embedding the unique…

Computer Vision and Pattern Recognition · Computer Science 2015-07-22 Qian Yu , Yongxin Yang , Yi-Zhe Song , Tao Xiang , Timothy Hospedales

Doodling is a useful and common intelligent skill that people can learn and master. In this work, we propose a two-stage learning framework to teach a machine to doodle in a simulated painting environment via Stroke Demonstration and deep…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Tao Zhou , Chen Fang , Zhaowen Wang , Jimei Yang , Byungmoon Kim , Zhili Chen , Jonathan Brandt , Demetri Terzopoulos

We study the underexplored but fundamental vision problem of machine understanding of abstract freehand scene sketches. We introduce a sketch encoder that results in semantically-aware feature space, which we evaluate by testing its…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Ahmed Bourouis , Judith Ellen Fan , Yulia Gryaditskaya

One tough problem of image inpainting is to restore complex structures in the corrupted regions. It motivates interactive image inpainting which leverages additional hints, e.g., sketches, to assist the inpainting process. Sketch is simple…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Chang Liu , Shunxin Xu , Jialun Peng , Kaidong Zhang , Dong Liu

Generating high-quality 3D models from 2D sketches is a challenging task due to the inherent ambiguity and sparsity of sketch data. In this paper, we present S3D, a novel framework that converts simple hand-drawn sketches into detailed 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Hail Song , Wonsik Shin , Naeun Lee , Soomin Chung , Nojun Kwak , Woontack Woo

We present a sketch-based CAD modeling system, where users create objects incrementally by sketching the desired shape edits, which our system automatically translates to CAD operations. Our approach is motivated by the close similarities…

Graphics · Computer Science 2020-09-11 Changjian Li , Hao Pan , Adrien Bousseau , Niloy J. Mitra

Sketches are the most abstract 2D representations of real-world objects. Although a sketch usually has geometrical distortion and lacks visual cues, humans can effortlessly envision a 3D object from it. This suggests that sketches encode…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Jiayun Wang , Jierui Lin , Qian Yu , Runtao Liu , Yubei Chen , Stella X. Yu

With the involvement of artificial intelligence (AI), sketches can be automatically generated under certain topics. Even though breakthroughs have been made in previous studies in this area, a relatively high proportion of the generated…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Yunkui Pang , Zhiqing Pan , Ruiyang Sun , Shuchong Wang