English
Related papers

Related papers: SketchDynamics: Exploring Free-Form Sketches for D…

200 papers

For creative tasks, programmers face a choice: Use a GUI and sacrifice flexibility, or write code and sacrifice ergonomics? To obtain both flexibility and ease of use, a number of systems have explored a workflow that we call…

Human-Computer Interaction · Computer Science 2019-08-13 Brian Hempel , Justin Lubin , Ravi Chugh

Sketching is a powerful tool for creating abstract images that are sparse but meaningful. Sketch understanding poses fundamental challenges for general-purpose vision algorithms because it requires robustness to the sparsity of sketches…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Kushin Mukherjee , Holly Huey , Xuanchen Lu , Yael Vinker , Rio Aguina-Kang , Ariel Shamir , Judith E. Fan

Direct manipulation interfaces provide intuitive and interactive features to a broad range of users, but they often exhibit two limitations: the built-in features cannot possibly cover all use cases, and the internal representation of the…

Human-Computer Interaction · Computer Science 2019-07-26 Brian Hempel , Ravi Chugh

We introduce the concept of a subjective camera to reconstruct meaningful moments that physical cameras fail to capture. We propose Subjective Camera 1.0, a framework for reconstructing real-world scenes from readily accessible subjective…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Haoyang Chen , Dongfang Sun , Caoyuan Ma , Shiqin Wang , Kewei Zhang , Zheng Wang , Zhixiang Wang

Predicting the dynamics of interacting objects is essential for both humans and intelligent systems. However, existing approaches are limited to simplified, toy settings and lack generalizability to complex, real-world environments. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Rick Akkerman , Haiwen Feng , Michael J. Black , Dimitrios Tzionas , Victoria Fernández Abrevaya

We contribute the first large-scale dataset of scene sketches, SketchyScene, with the goal of advancing research on sketch understanding at both the object and scene level. The dataset is created through a novel and carefully designed…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Changqing Zou , Qian Yu , Ruofei Du , Haoran Mo , Yi-Zhe Song , Tao Xiang , Chengying Gao , Baoquan Chen , Hao Zhang

We introduce SketchYourSeg, a novel framework that establishes freehand sketches as a powerful query modality for subjective image segmentation across entire galleries through a single exemplar sketch. Unlike text prompts that struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Subhadeep Koley , Viswanatha Reddy Gajjala , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Ayan Kumar Bhunia , Yi-Zhe Song

The emerging trend of AR/VR places great demands on 3D content. However, most existing software requires expertise and is difficult for novice users to use. In this paper, we aim to create sketch-based modeling tools for user-friendly 3D…

Human-Computer Interaction · Computer Science 2023-10-30 Tianrun Chen , Chaotao Ding , Lanyun Zhu , Ying Zang , Yiyi Liao , Zejian Li , Lingyun Sun

Humans draw to facilitate reasoning: we draw auxiliary lines when solving geometry problems; we mark and circle when reasoning on maps; we use sketches to amplify our ideas and relieve our limited-capacity working memory. However, such…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Yushi Hu , Weijia Shi , Xingyu Fu , Dan Roth , Mari Ostendorf , Luke Zettlemoyer , Noah A Smith , Ranjay Krishna

Sign languages are dynamic visual languages that involve hand gestures, in combination with non manual elements such as facial expressions. While video recordings of sign language are commonly used for education and documentation, the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Janna Bruner , Amit Moryossef , Lior Wolf

Free-hand sketches are appealing for humans as a universal tool to depict the visual world. Humans can recognize varied sketches of a category easily by identifying the concurrence and layout of the intrinsic semantic components of the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Guangming Zhu , Siyuan Wang , Tianci Wu , Liang Zhang

Sketches are the most abstract 2D representations of real-world objects. Although a sketch usually has geometrical distortion and lacks visual cues, humans can effortlessly envision a 3D object from it. This suggests that sketches encode…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Jiayun Wang , Jierui Lin , Qian Yu , Runtao Liu , Yubei Chen , Stella X. Yu

Animated visualization is becoming increasingly popular as a compelling way to illustrate changes in time series data. However, maintaining the viewer's focus throughout the entire animation is difficult because of its time-consuming…

Human-Computer Interaction · Computer Science 2020-09-09 Wenchao Li , Yun Wang , Haidong Zhang , Huamin Qu

Generating images from hand-drawings is a crucial and fundamental task in content creation. The translation is difficult as there exist infinite possibilities and the different users usually expect different outcomes. Therefore, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Shin-I Cheng , Yu-Jie Chen , Wei-Chen Chiu , Hung-Yu Tseng , Hsin-Ying Lee

Synthesizing natural interactions between virtual humans and their 3D environments is critical for numerous applications, such as computer games and AR/VR experiences. Our goal is to synthesize humans interacting with a given 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Kaifeng Zhao , Shaofei Wang , Yan Zhang , Thabo Beeler , Siyu Tang

Hand-drawn 2D animation workflow is typically initiated with the creation of sketch keyframes. Subsequent manual inbetweens are crafted for smoothness, which is a labor-intensive process and the prospect of automatic animation sketch…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Jiaming Shen , Kun Hu , Wei Bao , Chang Wen Chen , Zhiyong Wang

Animating hand-drawn sketches using traditional tools is challenging and complex. Sketches provide a visual basis for explanations, and animating these sketches offers an experience of real-time scenarios. We propose an approach for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Gaurav Rai , Ojaswa Sharma

Nonverbal visual symbols and displays play an important role in communication when humans and robots work collaboratively. However, few studies have investigated how different types of non-verbal cues affect objective task performance,…

Robotics · Computer Science 2025-12-15 Matthew Ebisu , Hang Yu , Reuben Aronson , Elaine Short

We present a novel system for sketch-based face image editing, enabling users to edit images intuitively by sketching a few strokes on a region of interest. Our interface features tools to express a desired image manipulation by providing…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Tiziano Portenier , Qiyang Hu , Attila Szabó , Siavash Arjomand Bigdeli , Paolo Favaro , Matthias Zwicker

Developing simple and expressive access controls -- interfaces to specify policies that define who should have access to resources and under what circumstances -- is a longstanding challenge in usable security. We present Sketch-based…

Human-Computer Interaction · Computer Science 2026-05-12 Kyzyl Monteiro , Sauvik Das