CyanKitten: AI-Driven Markerless Motion Capture for Improved Elderly Well-Being
Abstract
This paper introduces CyanKitten, an interactive virtual companion system tailored for elderly users, integrating advanced posture recognition, behavior recognition, and multimodal interaction capabilities. The system utilizes a three-tier architecture to process and interpret user movements and gestures, leveraging a dual-camera setup and a convolutional neural network trained explicitly on elderly movement patterns. The behavior recognition module identifies and responds to three key interactive gestures: greeting waves, petting motions, and heart-making gestures. A multimodal integration layer also combines visual and audio inputs to facilitate natural and intuitive interactions. This paper outlines the technical implementation of each component, addressing challenges such as elderly-specific movement characteristics, real-time processing demands, and environmental adaptability. The result is an engaging and accessible virtual interaction experience designed to enhance the quality of life for elderly users.
Cite
@article{arxiv.2503.19398,
title = {CyanKitten: AI-Driven Markerless Motion Capture for Improved Elderly Well-Being},
author = {Mengyao Guo and Yu Nie and Jinda Han and Zongxing Li and Ze Gao},
journal= {arXiv preprint arXiv:2503.19398},
year = {2025}
}
Comments
Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, April 26-May 1, 2025, Yokohama, Japan