English
Related papers

Related papers: FlipSketch: Flipping Static Drawings to Text-Guide…

200 papers

We introduce a novel sketch-to-image tool that aligns with the iterative refinement process of artists. Our tool lets users sketch blocking strokes to coarsely represent the placement and form of objects and detail strokes to refine their…

Graphics · Computer Science 2024-10-28 Vishnu Sarukkai , Lu Yuan , Mia Tang , Maneesh Agrawala , Kayvon Fatahalian

Sketches serve as fundamental blueprints in artistic creation because sketch editing is easier and more intuitive than pixel-level RGB image editing for painting artists, yet sketch generation remains unexplored despite advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Ruohao Zhan , Yijin Li , Yisheng He , Shuo Chen , Yichen Shen , Xinyu Chen , Zilong Dong , Zhaoyang Huang , Guofeng Zhang

Although recent advancements in diffusion models have significantly enriched the quality of generated images, challenges remain in synthesizing pixel-based human-drawn sketches, a representative example of abstract expression. To combat…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Jiho Park , Sieun Choi , Jaeyoon Seo , Jihie Kim

Sketching is a direct and inexpensive means of visual expression. Though image-based sketching has been well studied, video-based sketch animation generation is still very challenging due to the temporal coherence requirement. In this…

Graphics · Computer Science 2026-03-19 Xinding Zhu , Xinye Yang , Shuyang Zheng , Zhexin Zhang , Fei Gao , Jing Huang , Jiazhou Chen

Sketching serves as a versatile tool for externalizing ideas, enabling rapid exploration and visual communication that spans various disciplines. While artificial systems have driven substantial advances in content creation and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yael Vinker , Tamar Rott Shaham , Kristine Zheng , Alex Zhao , Judith E Fan , Antonio Torralba

Sketching is a natural and effective visual communication medium commonly used in creative processes. Recent developments in deep-learning models drastically improved machines' ability in understanding and generating visual content. An…

Human-Computer Interaction · Computer Science 2021-11-22 Forrest Huang , Eldon Schoop , David Ha , Jeffrey Nichols , John Canny

Recent advancements in large vision-language models have enabled highly expressive and diverse vector sketch generation. However, state-of-the-art methods rely on a time-consuming optimization process involving repeated feedback from a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Ellie Arar , Yarden Frenkel , Daniel Cohen-Or , Ariel Shamir , Yael Vinker

Generating images from hand-drawings is a crucial and fundamental task in content creation. The translation is difficult as there exist infinite possibilities and the different users usually expect different outcomes. Therefore, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Shin-I Cheng , Yu-Jie Chen , Wei-Chen Chiu , Hung-Yu Tseng , Hsin-Ying Lee

We propose a novel image-to-pencil translation method that could not only generate high-quality pencil sketches but also offer the drawing process. Existing pencil sketch algorithms are based on texture rendering rather than the direct…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Zhengyan Tong , Xuanhong Chen , Bingbing Ni , Xiaohang Wang

Text-to-image models are showcasing the impressive ability to create high-quality and diverse generative images. Nevertheless, the transition from freehand sketches to complex scene images remains challenging using diffusion models. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Tianyu Zhang , Xiaoxuan Xie , Xusheng Du , Haoran Xie

In the early stages of engineering design, it is essential to know how a product behaves, especially how it moves. As designers must keep adjusting the motion until it meets the intended requirements, this process is often repetitive and…

Human-Computer Interaction · Computer Science 2025-10-10 Kalyan Ramana Gattoz , Prasad S. Onkar

Sketching is inherently a sequential process, in which strokes are drawn in a meaningful order to explore and refine ideas. However, most generative models treat sketches as static images, overlooking the temporal structure that underlies…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Hui Ren , Yuval Alaluf , Omer Bar Tal , Alexander Schwing , Antonio Torralba , Yael Vinker

Sketching is a widely used medium for generating and exploring early-stage design concepts. While generative AI (GenAI) chatbots are increasingly used for idea generation, designers often struggle to craft effective prompts and find it…

Human-Computer Interaction · Computer Science 2025-11-19 Weiyan Shi , Sunaya Upadhyay , Geraldine Quek , Kenny Tsu Wei Choo

Sketching is an important activity for understanding, designing, and communicating different aspects of software systems such as their requirements or architecture. Often, sketches start on paper or whiteboards, are revised, and may evolve…

Software Engineering · Computer Science 2017-08-08 Sebastian Baltes , Fabrice Hollerich , Stephan Diehl

We propose a method to interactively control the animation of fluid elements in still images to generate cinemagraphs. Specifically, we focus on the animation of fluid elements like water, smoke, fire, which have the properties of repeating…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Aniruddha Mahapatra , Kuldeep Kulkarni

Integrating motion into static images not only enhances visual expressiveness but also creates a sense of immersion and temporal depth, establishing it as a longstanding and impactful theme in artistic expression. Fluid elements such as…

Graphics · Computer Science 2025-10-21 Hao Jin , Haoran Xie

2D animation is a common factor in game development, used for characters, effects and background art. It involves work that takes both skill and time, but parts of which are repetitive and tedious. Automated animation approaches exist, but…

Graphics · Computer Science 2022-09-02 Dagmar Lukka Loftsdóttir , Matthew Guzdial

Sketching and natural languages are effective communication media for interactive applications. We introduce Sketchforme, the first neural-network-based system that can generate sketches based on text descriptions specified by users.…

Human-Computer Interaction · Computer Science 2019-04-10 Forrest Huang , John F. Canny

Creating physically realistic content in VR often requires complex modeling tools or predefined 3D models, textures, and animations, which present significant barriers for non-expert users. In this paper, we propose SketchPlay, a novel VR…

Human-Computer Interaction · Computer Science 2025-12-29 Xiangwen Zhang , Xiaowei Dai , Runnan Chen , Xiaoming Chen , Zeke Zexi Hu

Modern data stream applications demand memory-efficient solutions for accurately tracking frequent items, such as heavy hitters and heavy changers, under strict resource constraints. Traditional sketches face inherent accuracy-memory…

Databases · Computer Science 2025-05-20 Zicang Xu , Yuxuan Tian , Yuhan Wu , Tong Yang