English
Related papers

Related papers: SketchyCOCO: Image Generation from Freehand Scene …

200 papers

Face sketch synthesis has made significant progress with the development of deep neural networks in these years. The delicate depiction of sketch portraits facilitates a wide range of applications like digital entertainment and law…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Xingqun Qi , Muyi Sun , Weining Wang , Xiaoxiao Dong , Qi Li , Caifeng Shan

Hand-drawn sketches are a natural and efficient medium for capturing and conveying ideas. Despite significant advancements in controllable natural image generation, translating freehand sketches into structured, machine-readable diagrams…

Artificial Intelligence · Computer Science 2025-08-05 Cheng Tan , Qi Chen , Jingxuan Wei , Gaowei Wu , Zhangyang Gao , Siyuan Li , Bihui Yu , Ruifeng Guo , Stan Z. Li

Generative Adversarial Networks (GANs) have the capability of synthesizing images, which have been successfully applied to medical image synthesis tasks. However, most of existing methods merely consider the global contextual information…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Tianyang Zhang , Huazhu Fu , Yitian Zhao , Jun Cheng , Mengjie Guo , Zaiwang Gu , Bing Yang , Yuting Xiao , Shenghua Gao , Jiang Liu

The goal of Scene-level Sketch-Based Image Retrieval is to retrieve natural images matching the overall semantics and spatial layout of a free-hand sketch. Unlike prior work focused on architectural augmentations of retrieval models, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Emil Demić , Luka Čehovin Zajc

Geometry- and appearance-controlled full-body human image generation is an interesting but challenging task. Existing solutions are either unconditional or dependent on coarse conditions (e.g., pose, text), thus lacking explicit geometry…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Linzi Qu , Jiaxiang Shang , Hui Ye , Xiaoguang Han , Hongbo Fu

Sketching serves as a versatile tool for externalizing ideas, enabling rapid exploration and visual communication that spans various disciplines. While artificial systems have driven substantial advances in content creation and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yael Vinker , Tamar Rott Shaham , Kristine Zheng , Alex Zhao , Judith E Fan , Antonio Torralba

Sketching is an important activity in any design process. Designers and stakeholders share their ideas through hand-drawn sketches. These sketches are further used to create 3D models. Current methods to generate 3D models from sketches are…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Nitish Bhardwaj , Dhornala Bharadwaj , Alpana Dubey

Generating images from hand-drawings is a crucial and fundamental task in content creation. The translation is difficult as there exist infinite possibilities and the different users usually expect different outcomes. Therefore, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Shin-I Cheng , Yu-Jie Chen , Wei-Chen Chiu , Hung-Yu Tseng , Hsin-Ying Lee

Researchers have explored various ways to generate realistic images from freehand sketches, e.g., for objects and human faces. However, how to generate realistic human body images from sketches is still a challenging problem. It is, first…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Xian Wu , Chen Wang , Hongbo Fu , Ariel Shamir , Song-Hai Zhang , Shi-Min Hu

Face photo-sketch synthesis aims at generating a facial sketch/photo conditioned on a given photo/sketch. It is of wide applications including digital entertainment and law enforcement. Precisely depicting face photos/sketches remains…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Jun Yu , Xingxin Xu , Fei Gao , Shengjie Shi , Meng Wang , Dacheng Tao , Qingming Huang

Existing text-based 3D generation methods generate attractive results but lack detailed geometry control. Sketches, known for their conciseness and expressiveness, have contributed to intuitive 3D modeling but are confined to producing…

Graphics · Computer Science 2024-05-15 Feng-Lin Liu , Hongbo Fu , Yu-Kun Lai , Lin Gao

Facial attributes are important since they provide a detailed description and determine the visual appearance of human faces. In this paper, we aim at converting a face image to a sketch while simultaneously generating facial attributes. To…

Computer Vision and Pattern Recognition · Computer Science 2019-08-29 Hao Tang , Xinya Chen , Wei Wang , Dan Xu , Jason J. Corso , Nicu Sebe , Yan Yan

Sketching and natural languages are effective communication media for interactive applications. We introduce Sketchforme, the first neural-network-based system that can generate sketches based on text descriptions specified by users.…

Human-Computer Interaction · Computer Science 2019-04-10 Forrest Huang , John F. Canny

We present CoGS, a novel method for the style-conditioned, sketch-driven synthesis of images. CoGS enables exploration of diverse appearance possibilities for a given sketched object, enabling decoupled control over the structure and the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Cusuh Ham , Gemma Canet Tarres , Tu Bui , James Hays , Zhe Lin , John Collomosse

The research topic of sketch-to-portrait generation has witnessed a boost of progress with deep learning techniques. The recently proposed StyleGAN architectures achieve state-of-the-art generation ability but the original StyleGAN is not…

Graphics · Computer Science 2022-06-01 Wanchao Su , Hui Ye , Shu-Yu Chen , Lin Gao , Hongbo Fu

Sketches make an intuitive and powerful visual expression as they are fast executed freehand drawings. We present a method for synthesizing realistic photos from scene sketches. Without the need for sketch and photo pairs, our framework…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Jiayun Wang , Sangryul Jeon , Stella X. Yu , Xi Zhang , Himanshu Arora , Yu Lou

Generating images from human sketches typically requires dedicated networks trained from scratch. In contrast, the emergence of the pre-trained Vision-Language models (e.g., CLIP) has propelled generative applications based on controlling…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Shaocong Zhang

Automatic synthesis of faces from visual attributes is an important problem in computer vision and has wide applications in law enforcement and entertainment. With the advent of deep generative convolutional neural networks (CNNs), attempts…

Computer Vision and Pattern Recognition · Computer Science 2018-01-03 Xing Di , Vishal M. Patel

Contemporary deep learning techniques have made image recognition a reasonably reliable technology. However training effective photo classifiers typically takes numerous examples which limits image recognition's scalability and…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Conghui Hu , Da Li , Yi-Zhe Song , Tao Xiang , Timothy M. Hospedales

The outpainting results produced by existing approaches are often too random to meet users' requirement. In this work, we take the image outpainting one step forward by allowing users to harvest personal custom outpainting results using…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Yaxiong Wang , Yunchao Wei , Xueming Qian , Li Zhu , Yi Yang