English

Unsupervised Discovery of Long-Term Spatiotemporal Periodic Workflows in Human Activities

Computer Vision and Pattern Recognition 2025-11-21 v2

Abstract

Periodic human activities with implicit workflows are common in manufacturing, sports, and daily life. While short-term periodic activities -- characterized by simple structures and high-contrast patterns -- have been widely studied, long-term periodic workflows with low-contrast patterns remain largely underexplored. To bridge this gap, we introduce the first benchmark comprising 580 multimodal human activity sequences featuring long-term periodic workflows. The benchmark supports three evaluation tasks aligned with real-world applications: unsupervised periodic workflow detection, task completion tracking, and procedural anomaly detection. We also propose a lightweight, training-free baseline for modeling diverse periodic workflow patterns. Experiments show that: (i) our benchmark presents significant challenges to both unsupervised periodic detection methods and zero-shot approaches based on powerful large language models (LLMs); (ii) our baseline outperforms competing methods by a substantial margin in all evaluation tasks; and (iii) in real-world applications, our baseline demonstrates deployment advantages on par with traditional supervised workflow detection approaches, eliminating the need for annotation and retraining. Our project page is https://sites.google.com/view/periodicworkflow.

Keywords

Cite

@article{arxiv.2511.14945,
  title  = {Unsupervised Discovery of Long-Term Spatiotemporal Periodic Workflows in Human Activities},
  author = {Fan Yang and Quanting Xie and Atsunori Moteki and Shoichi Masui and Shan Jiang and Kanji Uchino and Yonatan Bisk and Graham Neubig},
  journal= {arXiv preprint arXiv:2511.14945},
  year   = {2025}
}

Comments

accepted to WACV 2026