English

OptProver: Bridging Olympiad and Optimization through Continual Training in Formal Theorem Proving

Machine Learning 2026-04-29 v2 Artificial Intelligence

Abstract

Recent advances in formal theorem proving have focused on Olympiad-level mathematics, leaving undergraduate domains largely unexplored. Optimization, fundamental to machine learning, operations research, and scientific computing, remains underserved by existing provers. Its reliance on domain-specific formalisms (convexity, optimality conditions, and algorithmic analysis) creates significant distribution shift, making naive domain transfer ineffective. We present OptProver, a trained model that achieves robust transfer from Olympiad to undergraduate optimization. Starting from a strong Olympiad-level prover, our pipeline mitigates distribution shift through two key innovations. First, we employ large-scale optimization-focused data curation via expert iteration. Second, we introduce a specialized preference learning objective that integrates perplexity-weighted optimization with a mechanism to penalize valid but non-progressing proof steps. This not only addresses distribution shifts but also guides the search toward efficient trajectories. To enable rigorous evaluation, we construct a novel benchmark in Lean 4 focused on optimization. On this benchmark, OptProver achieves state-of-the-art Pass@1 and Pass@32 among comparably sized models while maintaining competitive performance on general theorem-proving tasks, demonstrating effective domain transfer without catastrophic forgetting.

Keywords

Cite

@article{arxiv.2604.23712,
  title  = {OptProver: Bridging Olympiad and Optimization through Continual Training in Formal Theorem Proving},
  author = {Chenyi Li and Yanchen Nie and Zhenyu Ming and Gong Zhang and Kun Yuan and Zaiwen Wen},
  journal= {arXiv preprint arXiv:2604.23712},
  year   = {2026}
}
R2 v1 2026-07-01T12:35:46.915Z