English

Leveraging Vision-Language Pre-training for Human Activity Recognition in Still Images

Computer Vision and Pattern Recognition 2025-06-17 v1 Computation and Language

Abstract

Recognising human activity in a single photo enables indexing, safety and assistive applications, yet lacks motion cues. Using 285 MSCOCO images labelled as walking, running, sitting, and standing, scratch CNNs scored 41% accuracy. Fine-tuning multimodal CLIP raised this to 76%, demonstrating that contrastive vision-language pre-training decisively improves still-image action recognition in real-world deployments.

Keywords

Cite

@article{arxiv.2506.13458,
  title  = {Leveraging Vision-Language Pre-training for Human Activity Recognition in Still Images},
  author = {Cristina Mahanta and Gagan Bhatia},
  journal= {arXiv preprint arXiv:2506.13458},
  year   = {2025}
}