English

Real-Time Synchronized Interaction Framework for Emotion-Aware Humanoid Robots

Robotics 2026-01-27 v1

Abstract

As humanoid robots increasingly introduced into social scene, achieving emotionally synchronized multimodal interaction remains a significant challenges. To facilitate the further adoption and integration of humanoid robots into service roles, we present a real-time framework for NAO robots that synchronizes speech prosody with full-body gestures through three key innovations: (1) A dual-channel emotion engine where large language model (LLM) simultaneously generates context-aware text responses and biomechanically feasible motion descriptors, constrained by a structured joint movement library; (2) Duration-aware dynamic time warping for precise temporal alignment of speech output and kinematic motion keyframes; (3) Closed-loop feasibility verification ensuring gestures adhere to NAO's physical joint limits through real-time adaptation. Evaluations show 21% higher emotional alignment compared to rule-based systems, achieved by coordinating vocal pitch (arousal-driven) with upper-limb kinematics while maintaining lower-body stability. By enabling seamless sensorimotor coordination, this framework advances the deployment of context-aware social robots in dynamic applications such as personalized healthcare, interactive education, and responsive customer service platforms.

Keywords

Cite

@article{arxiv.2601.17287,
  title  = {Real-Time Synchronized Interaction Framework for Emotion-Aware Humanoid Robots},
  author = {Yanrong Chen and Xihan Bian},
  journal= {arXiv preprint arXiv:2601.17287},
  year   = {2026}
}

Comments

6 pages, 6 figures

R2 v1 2026-07-01T09:18:14.985Z