English

Interactive Machine Learning of Musical Gesture

Machine Learning 2020-11-30 v1 Human-Computer Interaction

Abstract

This chapter presents an overview of Interactive Machine Learning (IML) techniques applied to the analysis and design of musical gestures. We go through the main challenges and needs related to capturing, analysing, and applying IML techniques to human bodily gestures with the purpose of performing with sound synthesis systems. We discuss how different algorithms may be used to accomplish different tasks, including interacting with complex synthesis techniques and exploring interaction possibilities by means of Reinforcement Learning (RL) in an interaction paradigm we developed called Assisted Interactive Machine Learning (AIML). We conclude the chapter with a description of how some of these techniques were employed by the authors for the development of four musical pieces, thus outlining the implications that IML have for musical practice.

Keywords

Cite

@article{arxiv.2011.13487,
  title  = {Interactive Machine Learning of Musical Gesture},
  author = {Federico Ghelli Visi and Atau Tanaka},
  journal= {arXiv preprint arXiv:2011.13487},
  year   = {2020}
}

Comments

Author's accepted manuscript, to appear as a chapter in "Handbook of Artificial Intelligence for Music: Foundations, Advanced Approaches, and Developments for Creativity", edited by E. R. Miranda. Cham: Springer Nature, 2021

R2 v1 2026-06-23T20:32:19.655Z