English
Related papers

Related papers: OProver: A Unified Framework for Agentic Formal Th…

200 papers

Verifiers have been demonstrated to enhance LLM reasoning via test-time scaling (TTS). Yet, they face significant challenges in complex domains. Error propagation from incorrect intermediate reasoning can lead to false positives for…

This paper considers the development of an AI-based provably-correct mathematical proof tutor. While Large Language Models (LLMs) allow seamless communication in natural language, they are error prone. Theorem provers such as Lean allow for…

Machine Learning · Computer Science 2026-03-05 Manooshree Patel , Rayna Bhattacharyya , Thomas Lu , Arnav Mehta , Niels Voss , Narges Norouzi , Gireeja Ranade

This paper considers the development of an AI-based provably-correct mathematical proof tutor. While Large Language Models (LLMs) allow seamless communication in natural language, they are error prone. Theorem provers such as Lean allow for…

Artificial Intelligence · Computer Science 2026-03-05 Manooshree Patel , Rayna Bhattacharyya , Thomas Lu , Arnav Mehta , Niels Voss , Narges Norouzi , Gireeja Ranade

Labeled data for imitation learning of theorem proving in large libraries of formalized mathematics is scarce as such libraries require years of concentrated effort by human specialists to be built. This is particularly challenging when…

Artificial Intelligence · Computer Science 2022-03-17 Jesse Michael Han , Jason Rute , Yuhuai Wu , Edward W. Ayers , Stanislas Polu

Interactive Theorem Provers (ITPs) are an indispensable tool in the arsenal of formal method experts as a platform for construction and (formal) verification of proofs. The complexity of the proofs in conjunction with the level of expertise…

Logic in Computer Science · Computer Science 2023-04-21 Eric Yeh , Briland Hitaj , Sam Owre , Maena Quemener , Natarajan Shankar

We introduce Goedel-Prover, an open-source language model that achieves state-of-the-art (as of April 5 2025) performance in automated formal proof generation for mathematical problems. A key challenge in this field is the scarcity of…

Machine Learning · Computer Science 2025-04-22 Yong Lin , Shange Tang , Bohan Lyu , Jiayun Wu , Hongzhou Lin , Kaiyu Yang , Jia Li , Mengzhou Xia , Danqi Chen , Sanjeev Arora , Chi Jin

Large language models (LLMs) have shown promise in proving formal theorems using proof assistants such as Lean. However, existing methods are difficult to reproduce or build on, due to private code, data, and large compute requirements.…

Machine Learning · Computer Science 2023-10-30 Kaiyu Yang , Aidan M. Swope , Alex Gu , Rahul Chalamala , Peiyang Song , Shixing Yu , Saad Godil , Ryan Prenger , Anima Anandkumar

Formal verification via theorem proving enables the expressive specification and rigorous proof of software correctness, but it is difficult to scale due to the significant manual effort and expertise required. While Large Language Models…

Software Engineering · Computer Science 2025-10-30 Minghai Lu , Zhe Zhou , Danning Xie , Songlin Jia , Benjamin Delaware , Tianyi Zhang

Large language models (LLMs) often struggle with complex logical reasoning due to logical inconsistencies and the inherent difficulty of such reasoning. We use Lean, a theorem proving framework, to address these challenges. By formalizing…

Computation and Language · Computer Science 2024-03-21 Dongwei Jiang , Marcio Fonseca , Shay B. Cohen

Undergraduate students of artificial intelligence often struggle with representing knowledge as logical sentences. This is a skill that seems to require extensive practice to obtain, suggesting a teaching strategy that involves the…

Computers and Society · Computer Science 2015-07-15 Angelo Kyrilov , David Noelle

In recent months, large language models (LLMs) have made significant progress in mathematical proof generation, but further advancement is hindered by the lack of a large-scale, high-quality dataset of human-evaluated proofs. While…

Automated theorem provers and formal proof assistants are general reasoning systems that are in theory capable of proving arbitrarily hard theorems, thus solving arbitrary problems reducible to mathematics and logical reasoning. In…

Artificial Intelligence · Computer Science 2025-06-23 Lasse Blaauwbroek , David Cerna , Thibault Gauthier , Jan Jakubův , Cezary Kaliszyk , Martin Suda , Josef Urban

We propose a minimal agentic baseline that enables systematic comparison across different AI-based theorem prover architectures. This design implements the core features shared among state-of-the-art systems: iterative proof refinement,…

Artificial Intelligence · Computer Science 2026-05-15 Borja Requena , Austin Letson , Krystian Nowakowski , Izan Beltran-Ferreiro , Leopoldo Sarra

Large language models (LLMs) increasingly excel at mathematical reasoning, but their unreliability limits their utility in mathematics research. A mitigation is using LLMs to generate formal proofs in languages like Lean. We perform the…

Proving mathematical theorems using computer-verifiable formal languages like Lean significantly impacts mathematical reasoning. One approach to formal theorem proving involves generating complete proofs using Large Language Models (LLMs)…

Formal Languages and Automata Theory · Computer Science 2024-10-07 Ruida Wang , Jipeng Zhang , Yizhen Jia , Rui Pan , Shizhe Diao , Renjie Pi , Tong Zhang

Formal methods (FM) are reliable but costly to apply, often requiring years of expert effort in industrial-scale projects such as seL4, especially for theorem proving. Recent advances in large language models (LLMs) have made automated…

Cryptography and Security · Computer Science 2026-02-10 Jianyu Zhang , Fuyuan Zhang , Jiayi Lu , Jilin Hu , Xiaoyi Yin , Long Zhang , Feng Yang , Yongwang Zhao

Large language models (LLMs) have evolved into agentic systems capable of autonomous tool use and multi-step reasoning for complex problem-solving. However, post-training approaches building upon general-purpose foundation models…

Large Language Models (LLMs) have been successful in mathematical reasoning tasks such as formal theorem proving when integrated with interactive proof assistants like Lean. Existing approaches involve training or fine-tuning an LLM on a…

Machine Learning · Computer Science 2025-03-07 Adarsh Kumarappan , Mo Tiwari , Peiyang Song , Robert Joseph George , Chaowei Xiao , Anima Anandkumar

Suppose we have been sold on the idea that formalised proofs in an LCF system should resemble their written counterparts, and so consist of formulas that only provide signposts for a fully verified proof. To be practical, most of the fully…

Logic in Computer Science · Computer Science 2017-03-17 Phil Scott , Steven Obua , Jacques Fleuriot

Agentic search enables language models to solve knowledge-intensive tasks by adaptively acquiring external evidence over multiple steps. Reinforcement learning with verifiable rewards (RLVR) has emerged as a widely adopted training paradigm…

Artificial Intelligence · Computer Science 2026-05-26 Erhan Zhang , Yiqun Chen , Zechun Niu , Wei Yang , Xiaochi Wei , Yan Gao , Yi Wu , Yao Hu , Jiaxin Mao