English

Deep Sketch-Based 3D Modeling: A Survey

Graphics 2026-03-05 v1 Computer Vision and Pattern Recognition Human-Computer Interaction

Abstract

In the past decade, advances in artificial intelligence have revolutionized sketch-based 3D modeling, leading to a new paradigm known as Deep Sketch-Based 3D Modeling (DS-3DM). DS-3DM offers data-driven methods that address the long-standing challenges of sketch abstraction and ambiguity. DS-3DM keeps humans at the center of the creative process by enhancing the flexibility, usability, faithfulness, and adaptability of sketch-based 3D modeling interfaces. This paper contributes a comprehensive survey of the latest DS-3DM within a novel design space: MORPHEUS. Built upon the Input-Model-Output (IMO) framework, MORPHEUS categorizes Models outputting Options of 3D Representations and Parts, derived from Human inputs (varying in quantity and modality), and Evaluated across diverse User-views and Styles. Throughout MORPHEUS we highlight limitations and identify opportunities for interdisciplinary research in Computer Vision, Computer Graphics, and Human-Computer Interaction, revealing a need for controllability and information-rich outputs. These opportunities align design processes more closely with user' intent, responding to the growing importance of user-centered approaches.

Keywords

Cite

@article{arxiv.2603.03287,
  title  = {Deep Sketch-Based 3D Modeling: A Survey},
  author = {Alberto Tono and Jiajun Wu and Gordon Wetzstein and Iro Armeni and Hariharan Subramonyam and James Landay and Martin Fischer},
  journal= {arXiv preprint arXiv:2603.03287},
  year   = {2026}
}
R2 v1 2026-07-01T11:01:44.049Z