English

Aryabhata 2: Scaling Reinforcement Learning for Advanced STEM Reasoning

Computation and Language 2026-05-29 v1 Artificial Intelligence Computers and Society

Abstract

Competitive STEM examinations such as JEE and NEET require multi-step symbolic reasoning, precise numerical computation, and deep conceptual understanding across physics, chemistry, and mathematics. Recent large language models perform strongly on common reasoning benchmarks, yet they remain difficult to deploy at scale, where millions of student doubts demand domain-specific, consistently structured problem solving. We introduce Aryabhata 2, a reasoning-focused language model for competitive STEM examinations, trained via reinforcement-learning post-training. Using PhysicsWallah's internal question banks, we construct a high-quality training curriculum and post-train GPT-OSS-20B through reinforcement learning with verifiable rewards. Training combines prolonged reinforcement learning with broadened exploration via progressively larger rollout group sizes. We evaluate Aryabhata 2 on competitive examination benchmarks, including JEE Main, JEE Advanced, and NEET, as well as out-of-distribution reasoning datasets such as AIME, HMMT, MMLU-Pro, MMLU-Redux 2.0, and GPQA. Results show that Aryabhata 2 outperforms its base model GPT-OSS-20B on competitive STEM reasoning while requiring substantially fewer output tokens (up to 64\% fewer).

Cite

@article{arxiv.2605.28829,
  title  = {Aryabhata 2: Scaling Reinforcement Learning for Advanced STEM Reasoning},
  author = {Ritvik Rastogi and Vishal Singh and Tejas Chaudhari and Sandeep Varma},
  journal= {arXiv preprint arXiv:2605.28829},
  year   = {2026}
}
R2 v1 2026-07-22T07:37:50.255Z