English
Related papers

Related papers: MerLean-Prover: A Recursive Looping Harness for Le…

200 papers

Proof assistants like Lean have revolutionized mathematical proof verification, ensuring high accuracy and reliability. Although large language models (LLMs) show promise in mathematical reasoning, their advancement in formal theorem…

Artificial Intelligence · Computer Science 2024-05-24 Huajian Xin , Daya Guo , Zhihong Shao , Zhizhou Ren , Qihao Zhu , Bo Liu , Chong Ruan , Wenda Li , Xiaodan Liang

We present FormalProofBench, a private benchmark designed to evaluate whether AI models can produce formally verified mathematical proofs at the graduate level. Each task pairs a natural-language problem with a Lean~4 formal statement, and…

Artificial Intelligence · Computer Science 2026-03-31 Nikil Ravi , Kexing Ying , Vasilii Nesterov , Rayan Krishnan , Elif Uskuplu , Bingyu Xia , Janitha Aswedige , Langston Nashold

We present Lean Refactor, a plug-and-play retrieval-augmented agentic framework for multi-objective, controllable, and version-robust refactoring of Lean proofs. LLM-generated proofs are notoriously correct-but-verbose and brittle across…

Logic in Computer Science · Computer Science 2026-05-21 Jialin Lu , Soonho Kong , Rodrigo Stehling , Kaiyu Yang , Zhangyang Wang , Weiran Sun , Wuyang Chen

We present **Lean4PHYS**, a comprehensive reasoning framework for college-level physics problems in Lean4. **Lean4PHYS** includes *LeanPhysBench*, a college-level benchmark for formal physics reasoning in Lean4, which contains 200…

Artificial Intelligence · Computer Science 2025-10-31 Yuxin Li , Minghao Liu , Ruida Wang , Wenzhao Ji , Zhitao He , Rui Pan , Junming Huang , Tong Zhang , Yi R. Fung

As neural theorem provers become increasingly agentic, the ability to interpret and act on compiler feedback is critical. However, existing Lean datasets consist almost exclusively of correct proofs, offering little supervision for…

Machine Learning · Computer Science 2026-03-17 Evan Wang , Simon Chess , Daniel Lee , Siyuan Ge , Ajit Mallavarapu , Jarod Alper , Vasily Ilin

We introduce a proof recommender system for the HOL4 theorem prover. Our tool is built upon a transformer-based model [2] designed specifically to provide proof assistance in HOL4. The model is trained to discern theorem proving patterns…

Logic in Computer Science · Computer Science 2025-01-13 Nour Dekhil , Adnan Rashid , Sofiene Tahar

Solving mathematical problems using computer-verifiable languages like Lean has significantly impacted the mathematical and computer science communities. State-of-the-art methods utilize a single Large Language Model (LLM) to generate…

Computation and Language · Computer Science 2025-05-28 Ruida Wang , Rui Pan , Yuxin Li , Jipeng Zhang , Yizhen Jia , Shizhe Diao , Renjie Pi , Junjie Hu , Tong Zhang

Large language models have achieved striking results in interactive theorem proving, particularly in Lean. However, most benchmarks for LLM-based proof automation are drawn from mathematics in the Mathlib ecosystem, whereas proofs in…

Software Engineering · Computer Science 2026-02-23 Yutong Xin , Qiaochu Chen , Greg Durrett , Işil Dillig

Despite the success of large language models (LLMs), the task of theorem proving still remains one of the hardest reasoning tasks that is far from being fully solved. Prior methods using language models have demonstrated promising results,…

Large Language Models (LLMs) have emerged as powerful tools in mathematical theorem proving, particularly when utilizing formal languages such as LEAN. A prevalent proof method involves the LLM prover iteratively constructing the proof…

Artificial Intelligence · Computer Science 2025-10-22 Zijian Wu , Suozhi Huang , Zhejian Zhou , Huaiyuan Ying , Zheng Yuan , Wenwei Zhang , Dahua Lin , Kai Chen

Large language models (LLMs) have recently shown strong progress on scientific reasoning, yet two major bottlenecks remain. First, explicit retrieval fragments reasoning, imposing a hidden "tool tax" of extra tokens and steps. Second,…

We introduce Goedel-Prover, an open-source language model that achieves state-of-the-art (as of April 5 2025) performance in automated formal proof generation for mathematical problems. A key challenge in this field is the scarcity of…

Machine Learning · Computer Science 2025-04-22 Yong Lin , Shange Tang , Bohan Lyu , Jiayun Wu , Hongzhou Lin , Kaiyu Yang , Jia Li , Mengzhou Xia , Danqi Chen , Sanjeev Arora , Chi Jin

We present a framework for verifying the deterministic structured computations surrounding a large language model rather than the model itself, extending a Lean 4 trust-boundary architecture to the generic interfaces of modern LLM…

Logic in Computer Science · Computer Science 2026-05-19 George Koomullil

Current reasoning paradigms for LLMs include chain-of-thought, ReAct, and post-hoc self-critique. These paradigms rely on two assumptions that fail on long-horizon, multi-stage tasks. As a result, errors accumulate silently across reasoning…

Artificial Intelligence · Computer Science 2026-05-08 Fan Huang

Large language models (LLMs) can generate plausible code but offer limited guarantees of correctness. Formally verifying that implementations satisfy specifications requires constructing machine-checkable proofs, a task that remains beyond…

Software Engineering · Computer Science 2026-03-30 Zenan Li , Ziran Yang , Deyuan He , Haoyu Zhao , Andrew Zhao , Shange Tang , Kaiyu Yang , Aarti Gupta , Zhendong Su , Chi Jin

We present the Judge Reliability Harness, an open source library for constructing validation suites that test the reliability of LLM judges. As LLM based scoring is widely deployed in AI benchmarks, more tooling is needed to efficiently…

Artificial Intelligence · Computer Science 2026-03-06 Sunishchal Dev , Andrew Sloan , Joshua Kavner , Nicholas Kong , Morgan Sandler

We introduce DeepSeek-Prover-V2, an open-source large language model designed for formal theorem proving in Lean 4, with initialization data collected through a recursive theorem proving pipeline powered by DeepSeek-V3. The cold-start…

Recent advances in large language models (LLMs) have shown promise in formal theorem proving, yet evaluating semantic correctness remains challenging. Existing evaluations rely on indirect proxies such as lexical overlap with…

Computation and Language · Computer Science 2026-04-29 Jongyoon Kim , Hojae Han , Seung-won Hwang

Automated theorem proving is fundamental to formal methods, and the recent trend is to integrate large language models (LLMs) and proof assistants to form effective proof agents. While existing proof agents show promising performance, they…

Software Engineering · Computer Science 2026-04-22 Yican Sun , Chengwei Shi , Hangzhou Lyu , Yingfei Xiong

We present PBLean, a method for importing VeriPB pseudo-Boolean (PB) proof certificates into Lean 4. Key to our approach is reflection: a Boolean checker function whose soundness is fully proved in Lean and executed as compiled native code.…

Logic in Computer Science · Computer Science 2026-04-03 Stefan Szeider