English

Probabilistic Multimodal Modeling for Human-Robot Interaction Tasks

Robotics 2019-08-15 v1 Computer Vision and Pattern Recognition Human-Computer Interaction Machine Learning

Abstract

Human-robot interaction benefits greatly from multimodal sensor inputs as they enable increased robustness and generalization accuracy. Despite this observation, few HRI methods are capable of efficiently performing inference for multimodal systems. In this work, we introduce a reformulation of Interaction Primitives which allows for learning from demonstration of interaction tasks, while also gracefully handling nonlinearities inherent to multimodal inference in such scenarios. We also empirically show that our method results in more accurate, more robust, and faster inference than standard Interaction Primitives and other common methods in challenging HRI scenarios.

Keywords

Cite

@article{arxiv.1908.04955,
  title  = {Probabilistic Multimodal Modeling for Human-Robot Interaction Tasks},
  author = {Joseph Campbell and Simon Stepputtis and Heni Ben Amor},
  journal= {arXiv preprint arXiv:1908.04955},
  year   = {2019}
}

Comments

Project website: http://interactive-robotics.engineering.asu.edu/interaction-primitives Accompanying video: https://youtu.be/r5AqfxTDfLA

R2 v1 2026-06-23T10:47:03.390Z