English
Related papers

Related papers: SketchDynamics: Exploring Free-Form Sketches for D…

200 papers

Sketching is a widely used medium for generating and exploring early-stage design concepts. While generative AI (GenAI) chatbots are increasingly used for idea generation, designers often struggle to craft effective prompts and find it…

Human-Computer Interaction · Computer Science 2025-11-19 Weiyan Shi , Sunaya Upadhyay , Geraldine Quek , Kenny Tsu Wei Choo

This work aims to investigate the problem of 3D modeling using single free-hand sketches, which is one of the most natural ways we humans express ideas. Although sketch-based 3D modeling can drastically make the 3D modeling process more…

Multimedia · Computer Science 2023-12-08 Tianrun Chen , Chenglong Fu , Lanyun Zhu , Papa Mao , Jia Zhang , Ying Zang , Lingyun Sun

Sketch2Prototype is an AI-based framework that transforms a hand-drawn sketch into a diverse set of 2D images and 3D prototypes through sketch-to-text, text-to-image, and image-to-3D stages. This framework, shown across various sketches,…

Human-Computer Interaction · Computer Science 2024-05-24 Kristen M. Edwards , Brandon Man , Faez Ahmed

Design mockups are essential instruments for visualizing and testing design ideas. However, the process of generating mockups can be time-consuming and challenging for designers. In this article, we present and evaluate two different…

Human-Computer Interaction · Computer Science 2023-03-23 Tommaso Calò , Luigi De Russis

Artificial Intelligence Generated Content (AIGC) has shown remarkable progress in generating realistic images. However, in this paper, we take a step "backward" and address AIGC for the most rudimentary visual modality of human sketches.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Zhiyu Qu , Tao Xiang , Yi-Zhe Song

Sketches have been used to conceptualise and depict visual objects from pre-historic times. Sketch research has flourished in the past decade, particularly with the proliferation of touchscreen devices. Much of the utilisation of sketch has…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Ayan Kumar Bhunia

Early-stage design ideation often relies on rough sketches created under time pressure, leaving much of the designer's intent implicit. In practice, designers frequently speak while sketching, verbally articulating functional goals and…

Human-Computer Interaction · Computer Science 2026-04-15 Weiyan Shi , Dorien Herremans , Kenny Tsu Wei Choo

We propose an interactive GAN-based sketch-to-image translation method that helps novice users create images of simple objects. As the user starts to draw a sketch of a desired object type, the network interactively recommends plausible…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Arnab Ghosh , Richard Zhang , Puneet K. Dokania , Oliver Wang , Alexei A. Efros , Philip H. S. Torr , Eli Shechtman

In the context of a classroom lesson, concepts must be visualized and organized in many ways depending on the needs of the teacher and students. Traditional presentation media such as the blackboard or electronic whiteboard allow for static…

Human-Computer Interaction · Computer Science 2018-09-20 Ken Perlin , Zhenyi He , Karl Rosenberg

We present a novel task: text-to-3D sketch animation, which aims to bring freeform sketches to life in dynamic 3D space. Unlike prior works focused on photorealistic content generation, we target sparse, stylized, and view-consistent 3D…

Graphics · Computer Science 2025-10-30 Hao Chen , Jiaqi Wang , Yonggang Qi , Ke Li , Kaiyue Pang , Yi-Zhe Song

Visual design relies on seeing things in different ways, acting on them, and seeing results to act again. Parametric design tools are often not robust to design changes that result from sketching over the visualization of their output. We…

Graphics · Computer Science 2023-12-20 Demircan Tas

We present SENS, a novel method for generating and editing 3D models from hand-drawn sketches, including those of abstract nature. Our method allows users to quickly and easily sketch a shape, and then maps the sketch into the latent space…

Graphics · Computer Science 2024-02-22 Alexandre Binninger , Amir Hertz , Olga Sorkine-Hornung , Daniel Cohen-Or , Raja Giryes

Drawing freehand sketches of mechanical components on multimedia devices for AI-based engineering modeling has become a new trend. However, its development is being impeded because existing works cannot produce suitable sketches for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Zhichao Liao , Di Huang , Heming Fang , Yue Ma , Fengyuan Piao , Xinghui Li , Long Zeng , Pingfa Feng

With the advancement of generative artificial intelligence, previous studies have achieved the task of generating aesthetic images from hand-drawn sketches, fulfilling the public's needs for drawing. However, these methods are limited to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Lifan Jiang , Shuang Chen , Boxi Wu , Xiaotong Guan , Jiahui Zhang

Sketches are a natural and accessible medium for UI designers to conceptualize early-stage ideas. However, existing research on UI/UX automation often requires high-fidelity inputs like Figma designs or detailed screenshots, limiting…

Computation and Language · Computer Science 2024-10-22 Ryan Li , Yanzhe Zhang , Diyi Yang

Technological advances continue to redefine the dynamics of human-machine interactions, particularly in task execution. This proposal responds to the advancements in Generative AI by outlining a research plan that probes intent-AI…

Human-Computer Interaction · Computer Science 2024-05-03 Zijian Ding

Text-to-image models are showcasing the impressive ability to create high-quality and diverse generative images. Nevertheless, the transition from freehand sketches to complex scene images remains challenging using diffusion models. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Tianyu Zhang , Xiaoxuan Xie , Xusheng Du , Haoran Xie

Sketch and speech are intuitive interaction methods that convey complementary information and have been independently used for 3D model retrieval in virtual environments. While sketch has been shown to be an effective retrieval method, not…

Human-Computer Interaction · Computer Science 2021-05-06 Daniele Giunchi , Alejandro Sztrajman , Stuart James , Anthony Steed

Modeling 3D avatars benefits various application scenarios such as AR/VR, gaming, and filming. Character faces contribute significant diversity and vividity as a vital component of avatars. However, building 3D character face models usually…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Zhongjin Luo , Dong Du , Heming Zhu , Yizhou Yu , Hongbo Fu , Xiaoguang Han

The rise of AR/VR has led to an increased demand for 3D content. However, the traditional method of creating 3D content using Computer-Aided Design (CAD) is a labor-intensive and skill-demanding process, making it difficult to use for…

Human-Computer Interaction · Computer Science 2023-10-30 Ying Zang , Chaotao Ding , Tianrun Chen , Papa Mao , Wenjun Hu