English

TheoremForge: Scaling up Formal Data Synthesis with Low-Budget Agentic Workflow

Artificial Intelligence 2026-01-27 v1

Abstract

The high cost of agentic workflows in formal mathematics hinders large-scale data synthesis, exacerbating the scarcity of open-source corpora. To address this, we introduce \textbf{TheoremForge}, a cost-effective formal data synthesis pipeline that decomposes the formalization process into five sub-tasks, which are \textit{statement formalization}, \textit{proof generation}, \textit{premise selection}, \textit{proof correction} and \textit{proof sketching}. By implementing a \textit{Decoupled Extraction Strategy}, the workflow recovers valid training signals from globally failed trajectories, effectively utilizing wasted computation. Experiments on a 2,000-problem benchmark demonstrate that TheoremForge achieves a Verified Rate of 12.6\%, surpassing the 8.6\% baseline, at an average cost of only \textbf{$0.481} per successful trajectory using Gemini-3-Flash. Crucially, our strategy increases data yield by \textbf{1.6×\times} for proof generation compared to standard filtering. These results establish TheoremForge as a scalable framework for constructing a data flywheel to train future expert models. Our code is available \href{https://github.com/timechess/TheoremForge}{here}.

Keywords

Cite

@article{arxiv.2601.17332,
  title  = {TheoremForge: Scaling up Formal Data Synthesis with Low-Budget Agentic Workflow},
  author = {Yicheng Tao and Hongteng Xu},
  journal= {arXiv preprint arXiv:2601.17332},
  year   = {2026}
}
R2 v1 2026-07-01T09:18:19.369Z