English

SHAD3S: A model to Sketch, Shade and Shadow

Graphics 2021-09-07 v3 Computer Vision and Pattern Recognition

Abstract

Hatching is a common method used by artists to accentuate the third dimension of a sketch, and to illuminate the scene. Our system SHAD3S attempts to compete with a human at hatching generic three-dimensional (3D) shapes, and also tries to assist her in a form exploration exercise. The novelty of our approach lies in the fact that we make no assumptions about the input other than that it represents a 3D shape, and yet, given a contextual information of illumination and texture, we synthesise an accurate hatch pattern over the sketch, without access to 3D or pseudo 3D. In the process, we contribute towards a) a cheap yet effective method to synthesise a sufficiently large high fidelity dataset, pertinent to task; b) creating a pipeline with conditional generative adversarial network (CGAN); and c) creating an interactive utility with GIMP, that is a tool for artists to engage with automated hatching or a form-exploration exercise. User evaluation of the tool suggests that the model performance does generalise satisfactorily over diverse input, both in terms of style as well as shape. A simple comparison of inception scores suggest that the generated distribution is as diverse as the ground truth.

Keywords

Cite

@article{arxiv.2011.06822,
  title  = {SHAD3S: A model to Sketch, Shade and Shadow},
  author = {Raghav B. Venkataramaiyer and Abhishek Joshi and Saisha Narang and Vinay P. Namboodiri},
  journal= {arXiv preprint arXiv:2011.06822},
  year   = {2021}
}

Comments

10 pages, 11 figures, 2 tables Accepted to WACV 2021. Project Page: https://bvraghav.com/shad3s/

R2 v1 2026-06-23T20:10:18.553Z