English
Related papers

Related papers: Sketch-to-Design: Context-based Part Assembly

200 papers

For designing a wide range of everyday objects, the design process should be aware of both the human body and the underlying semantics of the design specification. However, these two objectives present significant challenges to the current…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Michelle Guo , Mia Tang , Hannah Cha , Ruohan Zhang , C. Karen Liu , Jiajun Wu

Sketch and speech are intuitive interaction methods that convey complementary information and have been independently used for 3D model retrieval in virtual environments. While sketch has been shown to be an effective retrieval method, not…

Human-Computer Interaction · Computer Science 2021-05-06 Daniele Giunchi , Alejandro Sztrajman , Stuart James , Anthony Steed

Personalization techniques for large text-to-image (T2I) models allow users to incorporate new concepts from reference images. However, existing methods primarily rely on textual descriptions, leading to limited control over customized…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Chufeng Xiao , Hongbo Fu

In the early design stage of Japanese detached houses, the lack of a unified design representation among clients, sales representatives, and designers leads to design drift and inefficient feedback. Usually, sketches handed off by sales…

Graphics · Computer Science 2026-03-18 Zhengyang Wang , Nuttapong Rochanavibhata , Yuxiao Ren , Xusheng Du , Ye Zhang , Haoran Xie

Design prototyping involves creating mockups of products or concepts to gather feedback and iterate on ideas. While prototyping often requires specific parts of objects, such as when constructing a novel creature for a video game, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Mo Zhou , Josh Myers-Dean , Danna Gurari

We introduce a robotic assembly system that streamlines the design-to-make workflow for going from a CAD model of a product assembly to a fully programmed and adaptive assembly process. Our system captures (in the CAD tool) the intent of…

Robotics · Computer Science 2022-08-04 Yotto Koga , Heather Kerrick , Sachin Chitta

Sketch design concepts are recurring patterns found in parametric CAD sketches. Though rarely explicitly formalized by the CAD designers, these concepts are implicitly used in design for modularity and regularity. In this paper, we propose…

Machine Learning · Computer Science 2022-10-27 Yuezhi Yang , Hao Pan

We propose GroundUp, the first sketch-based ideation tool for 3D city massing of urban areas. We focus on early-stage urban design, where sketching is a common tool and the design starts from balancing building volumes (masses) and open…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Gizem Esra Unlu , Mohamed Sayed , Yulia Gryaditskaya , Gabriel Brostow

Developing fully parametric building models for performance-based generative design tasks often requires proficiency in many advanced 3D modeling and visual programming, limiting its use for many building designers. Moreover, iterations of…

Human-Computer Interaction · Computer Science 2020-09-02 Mohammad Keshavarzi , Clayton Hutson , Chin-Yi Cheng , Mehdi Nourbakhsh , Michael Bergin , Mohammad Rahmani Asl

Early-stage design ideation often relies on rough sketches created under time pressure, leaving much of the designer's intent implicit. In practice, designers frequently speak while sketching, verbally articulating functional goals and…

Human-Computer Interaction · Computer Science 2026-04-15 Weiyan Shi , Dorien Herremans , Kenny Tsu Wei Choo

Sketching serves as a versatile tool for externalizing ideas, enabling rapid exploration and visual communication that spans various disciplines. While artificial systems have driven substantial advances in content creation and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yael Vinker , Tamar Rott Shaham , Kristine Zheng , Alex Zhao , Judith E Fan , Antonio Torralba

Recent advances in 3D semantic scene understanding have shown impressive progress in 3D instance segmentation, enabling object-level reasoning about 3D scenes; however, a finer-grained understanding is required to enable interactions with…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Alexey Bokhovkin , Vladislav Ishimtsev , Emil Bogomolov , Denis Zorin , Alexey Artemov , Evgeny Burnaev , Angela Dai

Sketches are a natural and accessible medium for UI designers to conceptualize early-stage ideas. However, existing research on UI/UX automation often requires high-fidelity inputs like Figma designs or detailed screenshots, limiting…

Computation and Language · Computer Science 2024-10-22 Ryan Li , Yanzhe Zhang , Diyi Yang

Design mockups are essential instruments for visualizing and testing design ideas. However, the process of generating mockups can be time-consuming and challenging for designers. In this article, we present and evaluate two different…

Human-Computer Interaction · Computer Science 2023-03-23 Tommaso Calò , Luigi De Russis

User Interface (UI) prototyping is a necessary step in the early stages of application development. Transforming sketches of a Graphical User Interface (UI) into a coded UI application is an uninspired but time-consuming task performed by a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Vanita Jain , Piyush Agrawal , Subham Banga , Rishabh Kapoor , Shashwat Gulyani

Hatching is a common method used by artists to accentuate the third dimension of a sketch, and to illuminate the scene. Our system SHAD3S attempts to compete with a human at hatching generic three-dimensional (3D) shapes, and also tries to…

Graphics · Computer Science 2021-09-07 Raghav B. Venkataramaiyer , Abhishek Joshi , Saisha Narang , Vinay P. Namboodiri

As pretrained text-to-image diffusion models become increasingly powerful, recent efforts have been made to distill knowledge from these text-to-image pretrained models for optimizing a text-guided 3D model. Most of the existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Gege Gao , Weiyang Liu , Anpei Chen , Andreas Geiger , Bernhard Schölkopf

Modern machine learning models for scene understanding, such as depth estimation and object tracking, rely on large, high-quality datasets that mimic real-world deployment scenarios. To address data scarcity, we propose an end-to-end system…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Sonia Laguna , Alberto Garcia-Garcia , Marie-Julie Rakotosaona , Stylianos Moschoglou , Leonhard Helminger , Sergio Orts-Escolano

Assembling parts into an object is a combinatorial problem that arises in a variety of contexts in the real world and involves numerous applications in science and engineering. Previous related work tackles limited cases with identical unit…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Jinhwi Lee , Jungtaek Kim , Hyunsoo Chung , Jaesik Park , Minsu Cho

Background: Because of the difficulties involved in learning and using 3D modeling and rendering software, many scientists hire programmers or animators to create models and animations. This both slows the discovery process and provides…

Graphics · Computer Science 2014-07-14 Shawn M. Waldon , Peter M. Thompson , Patrick J. Hahn , Russell M. Taylor