English

MAGNET: Autonomous Expert Model Generation via Decentralized Autoresearch and BitNet Training

Machine Learning 2026-03-30 v1 Artificial Intelligence

Abstract

We present MAGNET (Model Autonomously Growing Network), a decentralized system for autonomous generation, training, and serving of domain-expert language models across commodity hardware. MAGNET integrates four components: (1) autoresearch, an autonomous ML research pipeline that automates dataset generation, hyperparameter exploration, evaluation, and error-driven iteration; (2) BitNet b1.58 ternary training, enabling CPU-native inference via bitnet.cpp without GPU hardware; (3) DiLoCo-based distributed merging for communication-efficient aggregation of domain specialists; and (4) on-chain contribution tracking on the HOOTi EVM chain. We validate autoresearch through three case studies: video safety classification (balanced accuracy 0.9287 to 0.9851), cryptocurrency directional prediction (41% to 54.9% hit rate), and BitNet hyperparameter optimization (10-phase sweep, -16.7% validation loss).

Keywords

Cite

@article{arxiv.2603.25813,
  title  = {MAGNET: Autonomous Expert Model Generation via Decentralized Autoresearch and BitNet Training},
  author = {Yongwan Kim and Sungchul Park},
  journal= {arXiv preprint arXiv:2603.25813},
  year   = {2026}
}

Comments

20 pages, 4 figures, 8 tables

R2 v1 2026-07-01T11:39:47.956Z