English

Drawing with AI -- Exploring Collaborative Inking Experiences Based on Mid-air Pointing and Reinforcement Learning

Human-Computer Interaction 2020-10-13 v1

Abstract

Digitalization is changing the nature of tools and materials, which are used in artistic practices in professional and non-professional settings. For example, today it is common that even children express their ideas and explore their creativity by drawing on tablets as digital canvases. While there are many software-based tools, which resemble traditional tools, such as various forms of virtual brushes, erasers, etc. in contrast to traditional materials there is potential in augmenting software-based tools and digital canvases with artificial intelligence. Curious about how it would feel to interact with a digital canvas, which would be in contrast to a traditional canvas dynamic, responsive, and potentially able to continuously adapt to its user's input, we developed a drawing application and conducted a qualitative study with 14 users. In this paper, we describe details of our design process, which lead up to using a k-armed bandit as a simple form of reinforcement learning and a LeapMotion sensor to allow people from all walks of like, old and young to draw on pervasive displays, small and large, positioned near or far.

Keywords

Cite

@article{arxiv.2010.05047,
  title  = {Drawing with AI -- Exploring Collaborative Inking Experiences Based on Mid-air Pointing and Reinforcement Learning},
  author = {Franziska Geiger and Michelle Martin and Monika Pichlmair and Ilhan Aslan and Hannes Ritschel and Björn Bittner and Elisabeth André},
  journal= {arXiv preprint arXiv:2010.05047},
  year   = {2020}
}

Comments

10 pages

R2 v1 2026-06-23T19:14:19.993Z