English

LEMUR 2: Unlocking Neural Network Diversity for AI

Machine Learning 2026-07-07 v1 Computer Vision and Pattern Recognition

Abstract

Existing NAS benchmarks (e.g., NAS-Bench, NATS-Bench) cover only narrow, task-specific regions of the architectural design space and lack cross-domain or deployment-aware evaluation. LEMUR 2 introduces a large-scale, extensible framework unifying generative, evaluative, and deployment pipelines to unlock neural-network diversity. It comprises over 14,000 distinct architectures and more than 750,000 structured training records documenting model performance, hyperparameters, and task outcomes. These models were produced through AST-based code mutation, genetic and reinforcement-learning evolution, generation of fractal architectures, and synthesis guided by a Large Language Model (LLM). This includes deep models generated with the retrieval-augmented system NN-RAG, which derived and used architectural motifs from over 900 PyTorch modules extracted from public repositories. LEMUR 2 further employs NN-VR and NN-Lite pipelines for automated deployment and latency benchmarking on heterogeneous mobile and Unity-based VR platforms, providing real-device performance metadata. It spans multimodal tasks, image captioning, text-to-image synthesis, and language modeling, supporting cross-domain analysis of architectural transferability. By linking diverse architectures, tasks, and deployment data, LEMUR 2 provides the data foundation for LLM fine-tuning and coupling diverse architectural origins with large-scale, cross-platform empirical validation. This dataset defines a new basis for reproducible and data-driven AI design, advancing the emerging paradigm of LLM-driven AutoML and architectural generalization across modalities and hardware.

Cite

@article{arxiv.2607.06839,
  title  = {LEMUR 2: Unlocking Neural Network Diversity for AI},
  author = {Tolgay Atinc Uzun and Waleed Khalid and Saif U Din and Sai Revanth Mulukuledu and Akashdeep Singh and Chandini Vysyaraju and Raghuvir Duvvuri and Avi Goyal and Yashkumar Rajeshbhai Lukhi and Muhammad A. Hussain and Krunal Jesani and Usha Shrestha and Yash Mittal and Roman Kochnev and Pritam Kadam and Mohsin Ikram and Harsh R. Moradiya and Alice Arslanian and Dmitry Ignatov and Radu Timofte},
  journal= {arXiv preprint arXiv:2607.06839},
  year   = {2026}
}

Comments

10 pages, 9 figures, 1 table

R2 v1 2026-07-22T20:29:53.219Z