English

Reciprocal Learning of Intent Inferral with Augmented Visual Feedback for Stroke

Robotics 2024-12-12 v1 Artificial Intelligence Human-Computer Interaction Machine Learning

Abstract

Intent inferral, the process by which a robotic device predicts a user's intent from biosignals, offers an effective and intuitive way to control wearable robots. Classical intent inferral methods treat biosignal inputs as unidirectional ground truths for training machine learning models, where the internal state of the model is not directly observable by the user. In this work, we propose reciprocal learning, a bidirectional paradigm that facilitates human adaptation to an intent inferral classifier. Our paradigm consists of iterative, interwoven stages that alternate between updating machine learning models and guiding human adaptation with the use of augmented visual feedback. We demonstrate this paradigm in the context of controlling a robotic hand orthosis for stroke, where the device predicts open, close, and relax intents from electromyographic (EMG) signals and provides appropriate assistance. We use LED progress-bar displays to communicate to the user the predicted probabilities for open and close intents by the classifier. Our experiments with stroke subjects show reciprocal learning improving performance in a subset of subjects (two out of five) without negatively impacting performance on the others. We hypothesize that, during reciprocal learning, subjects can learn to reproduce more distinguishable muscle activation patterns and generate more separable biosignals.

Keywords

Cite

@article{arxiv.2412.07956,
  title  = {Reciprocal Learning of Intent Inferral with Augmented Visual Feedback for Stroke},
  author = {Jingxi Xu and Ava Chen and Lauren Winterbottom and Joaquin Palacios and Preethika Chivukula and Dawn M. Nilsen and Joel Stein and Matei Ciocarlie},
  journal= {arXiv preprint arXiv:2412.07956},
  year   = {2024}
}
R2 v1 2026-06-28T20:30:13.124Z