English

Joint Prediction of Human Motions and Actions in Human-Robot Collaboration

Robotics 2026-04-06 v1

Abstract

Fluent human--robot collaboration requires robots to continuously estimate human behaviour and anticipate future intentions. This entails reasoning jointly about \emph{continuous movements} and \emph{discrete actions}, which are still largely modelled in isolation. In this paper, we introduce \textsf{MA-HERP}, a hierarchical and recursive probabilistic framework for the \emph{joint estimation and prediction} of human movements and actions. The model combines: (i) a hierarchical representation in which movements compose into actions through admissible Allen interval relations, (ii) a unified probabilistic factorisation coupling continuous dynamics, discrete labels, and durations, and (iii) a recursive inference scheme inspired by Bayesian filtering, alternating top-down action prediction with bottom-up sensory evidence. We present a preliminary experimental evaluation based on neural models trained on musculoskeletal simulations of reaching movements, showing accurate motion prediction, robust action inference under noise, and computational performance compatible with on-line human--robot collaboration.

Keywords

Cite

@article{arxiv.2604.03065,
  title  = {Joint Prediction of Human Motions and Actions in Human-Robot Collaboration},
  author = {Alessandra Bulanti and Alessandro Carfì and Fulvio Mastrogiovanni},
  journal= {arXiv preprint arXiv:2604.03065},
  year   = {2026}
}

Comments

8 pages, 6 figures. Submitted to IEEE AIM 2026