English

Geometry-Aware Semantic Reasoning for Training Free Video Anomaly Detection

Computer Vision and Pattern Recognition 2026-03-17 v1 Artificial Intelligence

Abstract

Training-free video anomaly detection (VAD) has recently emerged as a scalable alternative to supervised approaches, yet existing methods largely rely on static prompting and geometry-agnostic feature fusion. As a result, anomaly inference is often reduced to shallow similarity matching over Euclidean embeddings, leading to unstable predictions and limited interpretability, especially in complex or hierarchically structured scenes. We introduce MM-VAD, a geometry-aware semantic reasoning framework for training free VAD that reframes anomaly detection as adaptive test-time inference rather than fixed feature comparison. Our approach projects caption-derived scene representations into hyperbolic space to better preserve hierarchical structure and performs anomaly assessment through an adaptive question answering process over a frozen large language model. A lightweight, learnable prompt is optimised at test time using an unsupervised confidence-sparsity objective, enabling context-specific calibration without updating any backbone parameters. To further ground semantic predictions in visual evidence, we incorporate a covariance-aware Mahalanobis refinement that stabilises cross-modal alignment. Across four benchmarks, MM-VAD consistently improves over prior training-free methods, achieving 90.03% AUC on XD-Violence and 83.24%, 96.95%, and 98.81% on UCF-Crime, ShanghaiTech, and UCSD Ped2, respectively. Our results demonstrate that geometry-aware representation and adaptive semantic calibration provide a principled and effective alternative to static Euclidean matching in training-free VAD.

Keywords

Cite

@article{arxiv.2603.13374,
  title  = {Geometry-Aware Semantic Reasoning for Training Free Video Anomaly Detection},
  author = {Ali Zia and Usman Ali and Muhammad Umer Ramzan and Hamza Abid and Abdul Rehman and Wei Xiang},
  journal= {arXiv preprint arXiv:2603.13374},
  year   = {2026}
}
R2 v1 2026-07-01T11:19:06.672Z