English

CyanKitten: AI-Driven Markerless Motion Capture for Improved Elderly Well-Being

Human-Computer Interaction 2025-03-26 v1

Abstract

This paper introduces CyanKitten, an interactive virtual companion system tailored for elderly users, integrating advanced posture recognition, behavior recognition, and multimodal interaction capabilities. The system utilizes a three-tier architecture to process and interpret user movements and gestures, leveraging a dual-camera setup and a convolutional neural network trained explicitly on elderly movement patterns. The behavior recognition module identifies and responds to three key interactive gestures: greeting waves, petting motions, and heart-making gestures. A multimodal integration layer also combines visual and audio inputs to facilitate natural and intuitive interactions. This paper outlines the technical implementation of each component, addressing challenges such as elderly-specific movement characteristics, real-time processing demands, and environmental adaptability. The result is an engaging and accessible virtual interaction experience designed to enhance the quality of life for elderly users.

Cite

@article{arxiv.2503.19398,
  title  = {CyanKitten: AI-Driven Markerless Motion Capture for Improved Elderly Well-Being},
  author = {Mengyao Guo and Yu Nie and Jinda Han and Zongxing Li and Ze Gao},
  journal= {arXiv preprint arXiv:2503.19398},
  year   = {2025}
}

Comments

Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, April 26-May 1, 2025, Yokohama, Japan

R2 v1 2026-06-28T22:33:26.318Z