English

SKYLENAGE Technical Report: Mathematical Reasoning and Contest-Innovation Benchmarks for Multi-Level Math Evaluation

Computation and Language 2025-10-03 v1

Abstract

Large language models (LLMs) now perform strongly on many public math suites, yet frontier separation within mathematics increasingly suffers from ceiling effects. We present two complementary benchmarks: SKYLENAGE-ReasoningMATH, a 100-item, structure-aware diagnostic set with per-item metadata on length, numeric density, and symbolic complexity; and SKYLENAGE-MATH, a 150-item contest-style suite spanning four stages from high school to doctoral under a seven-subject taxonomy. We evaluate fifteen contemporary LLM variants under a single setup and analyze subject x model and grade x model performance. On the contest suite, the strongest model reaches 44% while the runner-up reaches 37%; accuracy declines from high school to doctoral, and top systems exhibit a doctoral-to-high-school retention near 79%. On the reasoning set, the best model attains 81% overall, and hardest-slice results reveal clear robustness gaps between leaders and the mid-tier. In summary, we release SKYLENAGE-ReasoningMATH and report aggregate results for SKYLENAGE-MATH; together, SKYLENAGE provides a hard, reasoning-centered and broadly covering math benchmark with calibrated difficulty and rich metadata, serving as a reference benchmark for future evaluations of mathematical reasoning.

Keywords

Cite

@article{arxiv.2510.01241,
  title  = {SKYLENAGE Technical Report: Mathematical Reasoning and Contest-Innovation Benchmarks for Multi-Level Math Evaluation},
  author = {Hu Wei and Ze Xu and Boyu Yang and Linlin Miao and Weiqi Zhai and Yihan Li and Zixuan Li and Zhijun Wang and Boya Wang and Jianwei Yu and Jialing Yuan and Xiaoyue Zhang and Cheng He and Minglei Chen and Zifan Zhang and Qianhui Li and Wei Wang and Xiang Xu},
  journal= {arXiv preprint arXiv:2510.01241},
  year   = {2025}
}
R2 v1 2026-07-01T06:11:26.497Z