English
Related papers

Related papers: SketchyCOCO: Image Generation from Freehand Scene …

200 papers

We introduce SketchDeco, a training-free approach to sketch colourisation that bridges the gap between professional design needs and intuitive, region-based control. Our method empowers artists to use simple masks and colour palettes for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Chaitat Utintu , Yi-Zhe Song

Sketches are a medium to convey a visual scene from an individual's creative perspective. The addition of color substantially enhances the overall expressivity of a sketch. This paper proposes two methods to mimic human-drawn colored…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 V Manushree , Sameer Saxena , Parna Chowdhury , Manisimha Varma , Harsh Rathod , Ankita Ghosh , Sahil Khose

We propose a new approach for synthesizing fully detailed art-stylized images from sketches. Given a sketch, with no semantic tagging, and a reference image of a specific style, the model can synthesize meaningful details with colors and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Bingchen Liu , Kunpeng Song , Ahmed Elgammal

We propose a new recurrent generative model for generating images from text captions while attending on specific parts of text captions. Our model creates images by incrementally adding patches on a "canvas" while attending on words from…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Amanpreet Singh , Sharan Agrawal

Synthesizing high-quality images from text descriptions is a challenging problem in computer vision and has many practical applications. Samples generated by existing text-to-image approaches can roughly reflect the meaning of the given…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Han Zhang , Tao Xu , Hongsheng Li , Shaoting Zhang , Xiaogang Wang , Xiaolei Huang , Dimitris Metaxas

We introduce a new method for generating color images from sketches or edge maps. Current methods either require some form of additional user-guidance or are limited to the "paired" translation approach. We argue that segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Samet Hicsonmez , Nermin Samet , Emre Akbas , Pinar Duygulu

Cross-view image translation is challenging because it involves images with drastically different views and severe deformation. In this paper, we propose a novel approach named Multi-Channel Attention SelectionGAN (SelectionGAN) that makes…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Hao Tang , Dan Xu , Nicu Sebe , Yanzhi Wang , Jason J. Corso , Yan Yan

Designing stylized cinemagraphs is challenging due to the difficulty in customizing complex and expressive flow elements. To achieve intuitive and detailed control of the generated cinemagraphs, sketches provide a feasible solution to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Hao Jin , Hengyuan Chang , Xiaoxuan Xie , Zhengyang Wang , Xusheng Du , Shaojun Hu , Haoran Xie

Generating high-quality, textured 3D scenes from a single image remains a fundamental challenge in vision and graphics. Recent image-to-3D generators recover reasonable geometry from single views, but their object-centric training limits…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Kaizhi Zheng , Yue Fan , Jing Gu , Zishuo Xu , Xuehai He , Xin Eric Wang

In the field of computer vision, multimodal image generation has become a research hotspot, especially the task of integrating text, image, and style. In this study, we propose a multimodal image generation method based on Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chaoyi Tan , Wenqing Zhang , Zhen Qi , Kowei Shih , Xinshi Li , Ao Xiang

Generating photorealistic images of human faces at scale remains a prohibitively difficult task using computer graphics approaches. This is because these require the simulation of light to be photorealistic, which in turn requires…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Stephan J. Garbin , Marek Kowalski , Matthew Johnson , Jamie Shotton

While great progress has been made recently in automatic image manipulation, it has been limited to object centric images like faces or structured scene datasets. In this work, we take a step towards general scene-level image editing by…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Rakshith Shetty , Mario Fritz , Bernt Schiele

3D content generation has recently attracted significant research interest, driven by its critical applications in VR/AR and embodied AI. In this work, we tackle the challenging task of synthesizing multiple 3D assets within a single scene…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Yanxu Meng , Haoning Wu , Ya Zhang , Weidi Xie

Sketches serve as fundamental blueprints in artistic creation because sketch editing is easier and more intuitive than pixel-level RGB image editing for painting artists, yet sketch generation remains unexplored despite advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Ruohao Zhan , Yijin Li , Yisheng He , Shuo Chen , Yichen Shen , Xinyu Chen , Zilong Dong , Zhaoyang Huang , Guofeng Zhang

The rise of AR/VR has led to an increased demand for 3D content. However, the traditional method of creating 3D content using Computer-Aided Design (CAD) is a labor-intensive and skill-demanding process, making it difficult to use for…

Human-Computer Interaction · Computer Science 2023-10-30 Ying Zang , Chaotao Ding , Tianrun Chen , Papa Mao , Wenjun Hu

Humans can envision a realistic photo given a free-hand sketch that is not only spatially imprecise and geometrically distorted but also without colors and visual details. We study unsupervised sketch-to-photo synthesis for the first time,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Runtao Liu , Qian Yu , Stella Yu

SCONE-GAN presents an end-to-end image translation, which is shown to be effective for learning to generate realistic and diverse scenery images. Most current image-to-image translation approaches are devised as two mappings: a translation…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Iman Abbasnejad , Fabio Zambetta , Flora Salim , Timothy Wiley , Jeffrey Chan , Russell Gallagher , Ehsan Abbasnejad

In this paper, we explore the task of generating photo-realistic face images from lines. Previous methods based on conditional generative adversarial networks (cGANs) have shown their power to generate visually plausible images when a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Yuhang Li , Xuejin Chen , Feng Wu , Zheng-Jun Zha

Generative Adversarial Networks (GANs) have made a dramatic leap in high-fidelity image synthesis and stylized face generation. Recently, a layer-swapping mechanism has been developed to improve the stylization performance. However, this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Mingcong Liu , Qiang Li , Zekui Qin , Guoxin Zhang , Pengfei Wan , Wen Zheng

In the last few years, we have witnessed the rise of a series of deep learning methods to generate synthetic images that look extremely realistic. These techniques prove useful in the movie industry and for artistic purposes. However, they…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Sara Mandelli , Nicolò Bonettini , Paolo Bestagini , Stefano Tubaro