English
Related papers

Related papers: OProver: A Unified Framework for Agentic Formal Th…

200 papers

Recent advances in formal theorem proving have focused on Olympiad-level mathematics, leaving undergraduate domains largely unexplored. Optimization, fundamental to machine learning, operations research, and scientific computing, remains…

Machine Learning · Computer Science 2026-04-29 Chenyi Li , Yanchen Nie , Zhenyu Ming , Gong Zhang , Kun Yuan , Zaiwen Wen

As neural theorem provers become increasingly agentic, the ability to interpret and act on compiler feedback is critical. However, existing Lean datasets consist almost exclusively of correct proofs, offering little supervision for…

Machine Learning · Computer Science 2026-03-17 Evan Wang , Simon Chess , Daniel Lee , Siyuan Ge , Ajit Mallavarapu , Jarod Alper , Vasily Ilin

We present an in-context learning agent for formal theorem-proving in environments like Lean and Coq. Current state-of-the-art models for the problem are finetuned on environment-specific proof data. By contrast, our approach, called COPRA,…

Machine Learning · Computer Science 2024-08-09 Amitayush Thakur , George Tsoukalas , Yeming Wen , Jimmy Xin , Swarat Chaudhuri

Recent neural theorem provers use reinforcement learning with verifiable rewards (RLVR), where proof assistants provide binary correctness signals. While verifiable rewards are cheap and scalable without reward hacking issues, they suffer…

Artificial Intelligence · Computer Science 2026-05-12 Zeynel A. Uluşan , Burak S. Akbudak , Can S. Erer , Gözde Gül Şahin

Proof engineering is notoriously labor-intensive: proofs that are straightforward on paper often require lengthy scripts in theorem provers. Recent advances in large language models (LLMs) create new opportunities for proof automation:…

Programming Languages · Computer Science 2026-01-08 Yichen Xu , Martin Odersky

Recent advances in large language models (LLMs) and LLM-based agents have substantially improved the capabilities of automated theorem proving. However, for problems requiring complex mathematical reasoning, current systems rarely succeed…

Computation and Language · Computer Science 2026-03-26 Ruichen Qiu , Yichuan Cao , Junqi Liu , Dakai Guo , Xiao-Shan Gao , Lihong Zhi , Ruyong Feng

We introduce Kimina-Prover Preview, a large language model that pioneers a novel reasoning-driven exploration paradigm for formal theorem proving, as showcased in this preview release. Trained with a large-scale reinforcement learning…

We introduce a proof recommender system for the HOL4 theorem prover. Our tool is built upon a transformer-based model [2] designed specifically to provide proof assistance in HOL4. The model is trained to discern theorem proving patterns…

Logic in Computer Science · Computer Science 2025-01-13 Nour Dekhil , Adnan Rashid , Sofiene Tahar

Large language models (LLMs) have demonstrated significant potential in formal theorem proving, yet state-of-the-art performance often necessitates prohibitive test-time compute via massive roll-outs or extended context windows. In this…

Machine Learning · Computer Science 2026-04-22 Guchan Li , Rui Tian , Hongning Wang

Large Language Models (LLMs) have demonstrated significant potential in generating mathematical proofs. However, a persistent challenge is that LLMs occasionally make mistakes, while even a minor mistake can invalidate an entire proof.…

Logic in Computer Science · Computer Science 2025-03-10 David Yin , Jing Gao

We present FormalProofBench, a private benchmark designed to evaluate whether AI models can produce formally verified mathematical proofs at the graduate level. Each task pairs a natural-language problem with a Lean~4 formal statement, and…

Artificial Intelligence · Computer Science 2026-03-31 Nikil Ravi , Kexing Ying , Vasilii Nesterov , Rayan Krishnan , Elif Uskuplu , Bingyu Xia , Janitha Aswedige , Langston Nashold

Large Language Models (LLMs) have shown significant promise in automated theorem proving, yet progress is often constrained by the scarcity of diverse and high-quality formal language data. To address this issue, we introduce…

Computation and Language · Computer Science 2025-12-02 Xinyuan Zhou , Yi Lei , Xiaoyu Zhou , Jingyi Sun , Yu Zhu , Zhongyi Ye , Weitai Zhang , Quan Liu , Si Wei , Cong Liu

Despite the success of large language models (LLMs), the task of theorem proving still remains one of the hardest reasoning tasks that is far from being fully solved. Prior methods using language models have demonstrated promising results,…

LLMs have demonstrated strong mathematical reasoning abilities by leveraging reinforcement learning with long chain-of-thought, yet they continue to struggle with theorem proving due to the lack of clear supervision signals when solely…

Recent advances in large language models have demonstrated impressive capabilities in mathematical formalization. However, existing benchmarks focus on logical verification of declarative propositions, often neglecting the task of…

Logic in Computer Science · Computer Science 2026-02-03 Bowen Yang , Yi Yuan , Chenyi Li , Ziyu Wang , Liangqi Li , Bo Zhang , Zhe Li , Zaiwen Wen

We introduce DeepSeek-Prover-V2, an open-source large language model designed for formal theorem proving in Lean 4, with initialization data collected through a recursive theorem proving pipeline powered by DeepSeek-V3. The cold-start…

Formally verifying properties of software code has been a highly desirable task, especially with the emergence of LLM-generated code. In the same vein, they provide an interesting avenue for the exploration of formal verification and…

Artificial Intelligence · Computer Science 2025-10-02 Balaji Rao , William Eiers , Carlo Lipizzi

Mathematical theorem proving is an important testbed for large language models' deep and abstract reasoning capability. This paper focuses on improving LLMs' ability to write proofs in formal languages that permit automated proof…

Machine Learning · Computer Science 2024-11-05 Kefan Dong , Arvind Mahankali , Tengyu Ma

Automated theorem proving is fundamental to formal methods, and the recent trend is to integrate large language models (LLMs) and proof assistants to form effective proof agents. While existing proof agents show promising performance, they…

Software Engineering · Computer Science 2026-04-22 Yican Sun , Chengwei Shi , Hangzhou Lyu , Yingfei Xiong

Formal mathematics libraries are rapidly expanding, creating a growing need to refactor verified proofs for maintainability and to improve training data quality for neural provers. However, scalable proof optimization is hindered by…

Artificial Intelligence · Computer Science 2026-05-25 Riyaz Ahuja , Tate Rowney , Jeremy Avigad , Sean Welleck