Adaptive Swin Transformer Partitioning over AI-RAN Networks
Abstract
This paper demonstrates the feasibility of transformer-based split inference for real-time video object detection over dynamic 5G AI-RAN networks. We extend throughput-aware adaptive splitting from CNNs to a Swin Transformer backbone and show that practical split execution is achievable for transformer-based vision models without retraining. To address the large intermediate activations inherent to transformers, we introduce an efficient, accuracy-preserving activation compression pipeline that substantially reduces uplink payload. The complete system -- including adaptive split selection, transformer inference, and compression -- is implemented and validated end-to-end on a real-time detection workload, with distributed UPF (dUPF) integration further reducing user-plane latency and improving runtime stability. Extensive measurements on an NVIDIA Aerial-based AI-RAN testbed jointly account for inference and 5G communication energy, quantifying the latency-energy-privacy trade-offs in realistic deployments.
Cite
@article{arxiv.2604.23554,
title = {Adaptive Swin Transformer Partitioning over AI-RAN Networks},
author = {Tam Thanh Nguyen and Yong Hao Pua and Tuan Van Ngo and Mao V. Ngo and Jihong Park and Binbin Chen and Tony Q. S. Quek},
journal= {arXiv preprint arXiv:2604.23554},
year = {2026}
}
Comments
6 pages. Accepted version for presentation at the 2026 IEEE Vehicular Technology Conference (VTC2026-Spring), Nice, France 9 - 12 June 2026. copyright 2026 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses