中文
相关论文

相关论文: MiniF2F: a cross-system benchmark for formal Olymp…

200 篇论文

Formal mathematics libraries are rapidly expanding, creating a growing need to refactor verified proofs for maintainability and to improve training data quality for neural provers. However, scalable proof optimization is hindered by…

人工智能 · 计算机科学 2026-05-25 Riyaz Ahuja , Tate Rowney , Jeremy Avigad , Sean Welleck

Automated formalization of mathematics enables mechanical verification but remains limited to isolated theorems and short snippets. Scaling to textbooks and research papers is largely unaddressed, as it requires managing cross-file…

人工智能 · 计算机科学 2026-02-20 Zichen Wang , Wanli Ma , Zhenyu Ming , Gong Zhang , Kun Yuan , Zaiwen Wen

In this work, we conduct an experiment using state-of-the-art LLMs to translate MiniF2F into Rocq. The translation task focuses on generating a Rocq theorem based on three sources: a natural language description, the Lean formalization, and…

计算机科学中的逻辑 · 计算机科学 2025-11-25 Jules Viennot , Guillaume Baudart , Emilio Jesùs Gallego Arias , Marc Lelarge

Proof assistants like Lean have revolutionized mathematical proof verification, ensuring high accuracy and reliability. Although large language models (LLMs) show promise in mathematical reasoning, their advancement in formal theorem…

人工智能 · 计算机科学 2024-05-24 Huajian Xin , Daya Guo , Zhihong Shao , Zhizhou Ren , Qihao Zhu , Bo Liu , Chong Ruan , Wenda Li , Xiaodan Liang

The math abilities of large language models can represent their abstract reasoning ability. In this paper, we introduce and open-source our math reasoning LLMs InternLM-Math which is continue pre-trained from InternLM2. We unify…

Neurosymbolic approaches leveraging Large Language Models (LLMs) with formal methods have recently achieved strong results on mathematics-oriented theorem-proving benchmarks. However, success on competition-style mathematics does not by…

编程语言 · 计算机科学 2026-04-21 Balaji Rao , John Harrison , Soonho Kong , Juneyoung Lee , Carlo Lipizzi

Computing olympiads contain some of the most challenging problems for humans, requiring complex algorithmic reasoning, puzzle solving, in addition to generating efficient code. However, it has been understudied as a domain to evaluate…

计算与语言 · 计算机科学 2024-04-18 Quan Shi , Michael Tang , Karthik Narasimhan , Shunyu Yao

Efficient and accurate autoformalization methods, which leverage large-scale datasets of extensive natural language mathematical problems to construct formal language datasets, are key to advancing formal mathematical reasoning. In this…

计算与语言 · 计算机科学 2025-07-16 Jiaxuan Xie , Chengwu Liu , Ye Yuan , Siqi Li , Zhiping Xiao , Ming Zhang

Formal theorem-proving benchmarks enable mechanically verifiable evaluation of mathematical reasoning in large language models. However, existing benchmarks mainly focus on Olympiad-style problems and algebraic domains, leaving…

人工智能 · 计算机科学 2026-05-19 Wentao Long , Yunfei Zhang , Chenyi Li , Li Zhou , Chumin Sun , Zaiwen Wen

Finding the right north-star metrics is highly critical for advancing the mathematical reasoning capabilities of foundation models, especially given that existing evaluations are either too easy or only focus on getting correct short…

Large language models (LLMs) can prove mathematical theorems formally by generating proof steps (\textit{a.k.a.} tactics) within a proof system. However, the space of possible tactics is vast and complex, while the available training data…

人工智能 · 计算机科学 2025-02-28 Zenan Li , Zhaoyu Li , Wen Tang , Xian Zhang , Yuan Yao , Xujie Si , Fan Yang , Kaiyu Yang , Xiaoxing Ma

Large vision-language models (LVLMs) have made substantial advances in reasoning tasks at the Olympiad level. Nevertheless, current Olympiad-level multimodal reasoning benchmarks for these models often emphasize single-image analysis and…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Qiguang Chen , Chengyu Luan , Jiajun Wu , Qiming Yu , Yi Yang , Yizhuo Li , Jingqi Tong , Xiachong Feng , Libo Qin , Wanxiang Che

Formally verifying properties of software code has been a highly desirable task, especially with the emergence of LLM-generated code. In the same vein, they provide an interesting avenue for the exploration of formal verification and…

人工智能 · 计算机科学 2025-10-02 Balaji Rao , William Eiers , Carlo Lipizzi

We propose ProofNet++, a neuro-symbolic framework that enhances automated theorem proving by combining large language models (LLMs) with formal proof verification and self-correction mechanisms. Current LLM-based systems suffer from…

人工智能 · 计算机科学 2025-06-02 Murari Ambati

Proprietary AI systems have recently demonstrated impressive capabilities on complex proof-based problems, with gold-level performance reported at the 2025 International Mathematical Olympiad (IMO). However, the training pipelines behind…

人工智能 · 计算机科学 2026-04-07 LM-Provers , Yuxiao Qu , Amrith Setlur , Jasper Dekoninck , Edward Beeching , Jia Li , Ian Wu , Lewis Tunstall , Aviral Kumar

Recent AI systems have achieved gold-medal-level performance on the International Mathematical Olympiad, demonstrating remarkable proficiency at competition-style problem solving. However, competition mathematics represents only a narrow…

人工智能 · 计算机科学 2026-04-09 Suhaas Garre , Erik Knutsen , Sushant Mehta , Edwin Chen

We introduce DeepSeek-Prover-V2, an open-source large language model designed for formal theorem proving in Lean 4, with initialization data collected through a recursive theorem proving pipeline powered by DeepSeek-V3. The cold-start…

Recent neuro-symbolic geometry theorem provers have made significant progress on Euclidean problems by coupling neural guidance with symbolic verification. However, most existing systems operate almost exclusively in a symbolic space,…

人工智能 · 计算机科学 2026-02-24 Minfeng Zhu , Zi Wang , Sizhe Ji , Zhengtong Du , Shengqiang Tai , Junming Ke , Xiao Deng , Zanlang Yin , Xiuqi Huang , Heyu Wang , Wei Chen

We present AMO-Bench, an Advanced Mathematical reasoning benchmark with Olympiad level or even higher difficulty, comprising 50 human-crafted problems. Existing benchmarks have widely leveraged high school math competitions for evaluating…

计算与语言 · 计算机科学 2025-10-31 Shengnan An , Xunliang Cai , Xuezhi Cao , Xiaoyu Li , Yehao Lin , Junlin Liu , Xinxuan Lv , Dan Ma , Xuanlin Wang , Ziwen Wang , Shuang Zhou

Autoformalization is the process of automatically translating from natural language mathematics to formal specifications and proofs. A successful autoformalization system could advance the fields of formal verification, program synthesis,…

机器学习 · 计算机科学 2022-05-26 Yuhuai Wu , Albert Q. Jiang , Wenda Li , Markus N. Rabe , Charles Staats , Mateja Jamnik , Christian Szegedy