English

FALCON: Future-Aware Learning with Contextual Object-Centric Pretraining for UAV Action Recognition

Computer Vision and Pattern Recognition 2026-03-09 v2 Artificial Intelligence Machine Learning Robotics

Abstract

We introduce FALCON, a unified self-supervised video pretraining approach for UAV action recognition from raw RGB aerial footage, requiring no additional preprocessing at inference. UAV videos exhibit severe spatial imbalance: large, cluttered backgrounds dominate the field of view, causing reconstruction-based pretraining to waste capacity on uninformative regions and under-learn action-relevant human/object cues. FALCON addresses this by integrating object-aware masked autoencoding with object-centric dual-horizon future reconstruction. Using detections only during pretraining, we construct objectness priors that (i) enforce balanced token visibility during masking and (ii) concentrate reconstruction supervision on action-relevant regions, preventing learning from being dominated by background appearance. To promote temporal dynamics learning, we further reconstruct short- and long-horizon future content within an object-centric supervision region, injecting anticipatory temporal supervision that is robust to noisy aerial context. Across UAV benchmarks, FALCON improves top-1 accuracy by 2.9\% on NEC-Drone and 5.8\% on UAV-Human with a ViT-B backbone, while achieving 2×\times--5×\times faster inference than supervised approaches that rely on heavy test-time augmentation.

Keywords

Cite

@article{arxiv.2409.18300,
  title  = {FALCON: Future-Aware Learning with Contextual Object-Centric Pretraining for UAV Action Recognition},
  author = {Ruiqi Xian and Xiyang Wu and Tianrui Guan and Xijun Wang and Boqing Gong and Dinesh Manocha},
  journal= {arXiv preprint arXiv:2409.18300},
  year   = {2026}
}
R2 v1 2026-06-28T18:58:50.570Z