English

Training-Free Zero-Shot Anomaly Detection in 3D Brain MRI with 2D Foundation Models

Computer Vision and Pattern Recognition 2026-02-18 v1 Machine Learning

Abstract

Zero-shot anomaly detection (ZSAD) has gained increasing attention in medical imaging as a way to identify abnormalities without task-specific supervision, but most advances remain limited to 2D datasets. Extending ZSAD to 3D medical images has proven challenging, with existing methods relying on slice-wise features and vision-language models, which fail to capture volumetric structure. In this paper, we introduce a fully training-free framework for ZSAD in 3D brain MRI that constructs localized volumetric tokens by aggregating multi-axis slices processed by 2D foundation models. These 3D patch tokens restore cubic spatial context and integrate directly with distance-based, batch-level anomaly detection pipelines. The framework provides compact 3D representations that are practical to compute on standard GPUs and require no fine-tuning, prompts, or supervision. Our results show that training-free, batch-based ZSAD can be effectively extended from 2D encoders to full 3D MRI volumes, offering a simple and robust approach for volumetric anomaly detection.

Keywords

Cite

@article{arxiv.2602.15315,
  title  = {Training-Free Zero-Shot Anomaly Detection in 3D Brain MRI with 2D Foundation Models},
  author = {Tai Le-Gia and Jaehyun Ahn},
  journal= {arXiv preprint arXiv:2602.15315},
  year   = {2026}
}

Comments

Accepted for MIDL 2026

R2 v1 2026-07-01T10:39:28.248Z