Markerless Motion Capture (MoCap) using smartphone cameras is a promising approach to making exergames more accessible and cost-effective for health and rehabilitation. Unlike traditional systems requiring specialized hardware, recent advancements in AI-powered pose estimation enable movement tracking using only a mobile device. For an upcoming study, a mobile application with real-time exergames including markerless motion capture is being developed. However, implementing such technology introduces key challenges, including balancing accuracy and real-time responsiveness, ensuring proper user interaction. Future research should explore optimizing AI models for realtime performance, integrating adaptive gamification, and refining user-centered design principles. By overcoming these challenges, smartphone-based exergames could become powerful tools for engaging users in physical activity and rehabilitation, extending their benefits to a broader audience.
@article{arxiv.2507.06669,
title = {Smartphone Exergames with Real-Time Markerless Motion Capture: Challenges and Trade-offs},
author = {Mathieu Phosanarack and Laura Wallard and Sophie Lepreux and Christophe Kolski and Eugénie Avril},
journal= {arXiv preprint arXiv:2507.06669},
year = {2025}
}
Comments
CHI '25 Workshop on Envisioning the Future of Interactive Health, Apr 2025, Yokohama, Japan