English

EntroRouter: Learning Efficient Model Routing via Entropy Regulation

Computation and Language 2026-06-28 v1

Abstract

Model routing balances solution accuracy and computational cost by selecting among models of varying capabilities. While recent multi-round frameworks interleave reasoning and planning, we identify a structural failure mode termed Trust Region Collapse. We demonstrate that the deep coupling of reasoning and routing, exacerbated by the dominance of strong pre-training priors under sparse supervision, leads to degenerate local optima where capable experts are systematically suppressed. To decouple these processes, we propose EntroRouter\textbf{EntroRouter}, a single-round routing framework that treats entropy regulation as a core objective. We first initialize the policy via Soft Supervision, fitting a distribution of suitable models to establish a high-entropy prior for exploration. Subsequently, we stabilize Reinforcement Learning using a Soft Anchor, which utilizes offline capability estimates to orchestrate controlled entropy contraction within a safe trust region. Extensive experiments demonstrate that EntroRouter retains 98.3% of the strongest expert's accuracy while reducing computational costs by 48.25%.

Cite

@article{arxiv.2606.29424,
  title  = {EntroRouter: Learning Efficient Model Routing via Entropy Regulation},
  author = {Kaiyi Zhang and Xueliang Zhao and Zhuocheng Gong and Wei Wu and Yankai Lin},
  journal= {arXiv preprint arXiv:2606.29424},
  year   = {2026}
}