English

Online Micro-gesture Recognition Using Data Augmentation and Spatial-Temporal Attention

Computer Vision and Pattern Recognition 2025-08-27 v2

Abstract

In this paper, we introduce the latest solution developed by our team, HFUT-VUT, for the Micro-gesture Online Recognition track of the IJCAI 2025 MiGA Challenge. The Micro-gesture Online Recognition task is a highly challenging problem that aims to locate the temporal positions and recognize the categories of multiple micro-gesture instances in untrimmed videos. Compared to traditional temporal action detection, this task places greater emphasis on distinguishing between micro-gesture categories and precisely identifying the start and end times of each instance. Moreover, micro-gestures are typically spontaneous human actions, with greater differences than those found in other human actions. To address these challenges, we propose hand-crafted data augmentation and spatial-temporal attention to enhance the model's ability to classify and localize micro-gestures more accurately. Our solution achieved an F1 score of 38.03, outperforming the previous state-of-the-art by 37.9%. As a result, our method ranked first in the Micro-gesture Online Recognition track.

Keywords

Cite

@article{arxiv.2507.09512,
  title  = {Online Micro-gesture Recognition Using Data Augmentation and Spatial-Temporal Attention},
  author = {Pengyu Liu and Kun Li and Fei Wang and Yanyan Wei and Junhui She and Dan Guo},
  journal= {arXiv preprint arXiv:2507.09512},
  year   = {2025}
}

Comments

11 pages, 4 figures

R2 v1 2026-07-01T03:58:23.444Z