English

Learning Cross-Joint Attention for Generalizable Video-Based Seizure Detection

Computer Vision and Pattern Recognition 2026-03-26 v1

Abstract

Automated seizure detection from long-term clinical videos can substantially reduce manual review time and enable real-time monitoring. However, existing video-based methods often struggle to generalize to unseen subjects due to background bias and reliance on subject-specific appearance cues. We propose a joint-centric attention model that focuses exclusively on body dynamics to improve cross-subject generalization. For each video segment, body joints are detected and joint-centered clips are extracted, suppressing background context. These joint-centered clips are tokenized using a Video Vision Transformer (ViViT), and cross-joint attention is learned to model spatial and temporal interactions between body parts, capturing coordinated movement patterns characteristic of seizure semiology. Extensive cross-subject experiments show that the proposed method consistently outperforms state-of-the-art CNN-, graph-, and transformer-based approaches on unseen subjects.

Keywords

Cite

@article{arxiv.2603.23757,
  title  = {Learning Cross-Joint Attention for Generalizable Video-Based Seizure Detection},
  author = {Omar Zamzam and Takfarinas Medani and Chinmay Chinara and Richard Leahy},
  journal= {arXiv preprint arXiv:2603.23757},
  year   = {2026}
}
R2 v1 2026-07-01T11:36:24.921Z