English

Convolutional Neural Nets vs Vision Transformers: A SpaceNet Case Study with Balanced vs Imbalanced Regimes

Computer Vision and Pattern Recognition 2025-10-07 v1 Artificial Intelligence Machine Learning

Abstract

We present a controlled comparison of a convolutional neural network (EfficientNet-B0) and a Vision Transformer (ViT-Base) on SpaceNet under two label-distribution regimes: a naturally imbalanced five-class split and a balanced-resampled split with 700 images per class (70:20:10 train/val/test). With matched preprocessing (224x224, ImageNet normalization), lightweight augmentations, and a 40-epoch budget on a single NVIDIA P100, we report accuracy, macro-F1, balanced accuracy, per-class recall, and deployment metrics (model size and latency). On the imbalanced split, EfficientNet-B0 reaches 93% test accuracy with strong macro-F1 and lower latency; ViT-Base is competitive at 93% with a larger parameter count and runtime. On the balanced split, both models are strong; EfficientNet-B0 reaches 99% while ViT-Base remains competitive, indicating that balancing narrows architecture gaps while CNNs retain an efficiency edge. We release manifests, logs, and per-image predictions to support reproducibility.

Keywords

Cite

@article{arxiv.2510.03297,
  title  = {Convolutional Neural Nets vs Vision Transformers: A SpaceNet Case Study with Balanced vs Imbalanced Regimes},
  author = {Akshar Gothi},
  journal= {arXiv preprint arXiv:2510.03297},
  year   = {2025}
}

Comments

5 pages, 1 figure, 9 tables. Code and artifacts: https://github.com/akshar27/spacenet-cnn-vs-vit (release v1.0.1)

R2 v1 2026-07-01T06:15:52.412Z