English
Related papers

Related papers: Programmatic and Direct Manipulation, Together at …

200 papers

Sketch-based shape modeling aims to bridge the gap between 2D drawing and 3D modeling by providing an intuitive and accessible approach to create 3D shapes from 2D sketches. However, existing methods still suffer from limitations in…

Graphics · Computer Science 2023-09-13 Jie Zhou , Zhongjin Luo , Qian Yu , Xiaoguang Han , Hongbo Fu

This paper presents a novel free-hand sketch synthesis approach addressing explicit abstraction control in class-conditional and photo-to-sketch synthesis. Abstraction is a vital aspect of sketches, as it defines the fundamental distinction…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Dar-Yen Chen

Sketch-based image manipulation is an interactive image editing task to modify an image based on input sketches from users. Existing methods typically formulate this task as a conditional inpainting problem, which requires users to draw an…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Yu Zeng , Zhe Lin , Vishal M. Patel

To use assistive robots in everyday life, a remote control system with common devices, such as 2D devices, is helpful to control the robots anytime and anywhere as intended. Hand-drawn sketches are one of the intuitive ways to control…

In this paper, we investigate deep image synthesis guided by sketch, color, and texture. Previous image synthesis methods can be controlled by sketch and color strokes but we are the first to examine texture control. We allow a user to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Wenqi Xian , Patsorn Sangkloy , Varun Agrawal , Amit Raj , Jingwan Lu , Chen Fang , Fisher Yu , James Hays

We propose a novel image-to-pencil translation method that could not only generate high-quality pencil sketches but also offer the drawing process. Existing pencil sketch algorithms are based on texture rendering rather than the direct…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Zhengyan Tong , Xuanhong Chen , Bingbing Ni , Xiaohang Wang

Sketching and natural languages are effective communication media for interactive applications. We introduce Sketchforme, the first neural-network-based system that can generate sketches based on text descriptions specified by users.…

Human-Computer Interaction · Computer Science 2019-04-10 Forrest Huang , John F. Canny

Personalization techniques for large text-to-image (T2I) models allow users to incorporate new concepts from reference images. However, existing methods primarily rely on textual descriptions, leading to limited control over customized…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Chufeng Xiao , Hongbo Fu

We investigate direct manipulation of graphical encodings as a method for interacting with visualizations. There is an increasing interest in developing visualization tools that enable users to perform operations by directly manipulating…

Human-Computer Interaction · Computer Science 2019-08-05 Bahador Saket , Samuel Huron , Charles Perin , Alex Endert

Sketching serves as a versatile tool for externalizing ideas, enabling rapid exploration and visual communication that spans various disciplines. While artificial systems have driven substantial advances in content creation and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yael Vinker , Tamar Rott Shaham , Kristine Zheng , Alex Zhao , Judith E Fan , Antonio Torralba

Sketches are a natural and accessible medium for UI designers to conceptualize early-stage ideas. However, existing research on UI/UX automation often requires high-fidelity inputs like Figma designs or detailed screenshots, limiting…

Computation and Language · Computer Science 2024-10-22 Ryan Li , Yanzhe Zhang , Diyi Yang

Developing simple and expressive access controls -- interfaces to specify policies that define who should have access to resources and under what circumstances -- is a longstanding challenge in usable security. We present Sketch-based…

Human-Computer Interaction · Computer Science 2026-05-12 Kyzyl Monteiro , Sauvik Das

Recent deep image-to-image translation techniques allow fast generation of face images from freehand sketches. However, existing solutions tend to overfit to sketches, thus requiring professional sketches or even edge maps as input. To…

Graphics · Computer Science 2020-06-09 Shu-Yu Chen , Wanchao Su , Lin Gao , Shihong Xia , Hongbo Fu

Hand-drawn sketches are a natural and efficient medium for capturing and conveying ideas. Despite significant advancements in controllable natural image generation, translating freehand sketches into structured, machine-readable diagrams…

Artificial Intelligence · Computer Science 2025-08-05 Cheng Tan , Qi Chen , Jingxuan Wei , Gaowei Wu , Zhangyang Gao , Siyuan Li , Bihui Yu , Ruifeng Guo , Stan Z. Li

Sketch editing requires jointly handling high-level semantic changes and precise local redrawing, a combination that is particularly challenging for sparse, style-sensitive line art. Unlike natural images, sketches rely on minimal visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Han Zou , Yan Zhang , Ruiqi Yu , Cong Xie , Jie Huang , Zhenpeng Zhan

We present RealitySketch, an augmented reality interface for sketching interactive graphics and visualizations. In recent years, an increasing number of AR sketching tools enable users to draw and embed sketches in the real world. However,…

Human-Computer Interaction · Computer Science 2020-08-21 Ryo Suzuki , Rubaiat Habib Kazi , Li-Yi Wei , Stephen DiVerdi , Wilmot Li , Daniel Leithinger

3D Gaussian representations have emerged as a powerful paradigm for digital head modeling, achieving photorealistic quality with real-time rendering. However, intuitive and interactive creation or editing of 3D Gaussian head models remains…

Graphics · Computer Science 2026-04-22 Bo Li , Jiahao Kang , Yubo Ma , Feng-Lin Liu , Bin Liu , Fang-Lue Zhang , Lin Gao

High-dimensional data visualization has been attracting much attention. To fully test related software and algorithms, researchers require a diverse pool of data with known and desired features. Test data do not always provide this, or only…

Human-Computer Interaction · Computer Science 2013-08-06 Bing Wang , Puripant Ruchikachorn , Klaus Mueller

Many tasks can be easily solved using machine learning techniques. However, some tasks cannot readily be solved using statistical models, requiring a symbolic approach instead. Program induction is one of the ways that such tasks can be…

Machine Learning · Computer Science 2024-02-13 Ahmad Ayaz Amin

We introduce the concept of code shaping, an interaction paradigm for editing code using free-form sketch annotations directly on top of the code and console output. To evaluate this concept, we conducted a three-stage design study with 18…

Human-Computer Interaction · Computer Science 2025-02-11 Ryan Yen , Jian Zhao , Daniel Vogel