English

FIMO: A Challenge Formal Dataset for Automated Theorem Proving

Artificial Intelligence 2023-12-06 v2

Abstract

We present FIMO, an innovative dataset comprising formal mathematical problem statements sourced from the International Mathematical Olympiad (IMO) Shortlisted Problems. Designed to facilitate advanced automated theorem proving at the IMO level, FIMO is currently tailored for the Lean formal language. It comprises 149 formal problem statements, accompanied by both informal problem descriptions and their corresponding LaTeX-based informal proofs. Through initial experiments involving GPT-4, our findings underscore the existing limitations in current methodologies, indicating a substantial journey ahead before achieving satisfactory IMO-level automated theorem proving outcomes.

Keywords

Cite

@article{arxiv.2309.04295,
  title  = {FIMO: A Challenge Formal Dataset for Automated Theorem Proving},
  author = {Chengwu Liu and Jianhao Shen and Huajian Xin and Zhengying Liu and Ye Yuan and Haiming Wang and Wei Ju and Chuanyang Zheng and Yichun Yin and Lin Li and Ming Zhang and Qun Liu},
  journal= {arXiv preprint arXiv:2309.04295},
  year   = {2023}
}

Comments

Added a hyperlink to the dataset made accessible on GitHub

R2 v1 2026-06-28T12:16:11.855Z