English

Universal Neural Architecture Space: Covering ConvNets, Transformers and Everything in Between

Computer Vision and Pattern Recognition 2025-10-08 v1

Abstract

We introduce Universal Neural Architecture Space (UniNAS), a generic search space for neural architecture search (NAS) which unifies convolutional networks, transformers, and their hybrid architectures under a single, flexible framework. Our approach enables discovery of novel architectures as well as analyzing existing architectures in a common framework. We also propose a new search algorithm that allows traversing the proposed search space, and demonstrate that the space contains interesting architectures, which, when using identical training setup, outperform state-of-the-art hand-crafted architectures. Finally, a unified toolkit including a standardized training and evaluation protocol is introduced to foster reproducibility and enable fair comparison in NAS research. Overall, this work opens a pathway towards systematically exploring the full spectrum of neural architectures with a unified graph-based NAS perspective.

Keywords

Cite

@article{arxiv.2510.06035,
  title  = {Universal Neural Architecture Space: Covering ConvNets, Transformers and Everything in Between},
  author = {Ondřej Týbl and Lukáš Neumann},
  journal= {arXiv preprint arXiv:2510.06035},
  year   = {2025}
}
R2 v1 2026-07-01T06:21:42.320Z