English
Related papers

Related papers: MINIF2F-DAFNY: LLM-Guided Mathematical Theorem Pro…

200 papers

Large language model (LLM)-based reasoning systems have recently achieved gold medal-level performance in the IMO 2025 competition, writing mathematical proofs where, to receive full credit, each step must be not only correct but also…

Artificial Intelligence · Computer Science 2025-10-16 Shrey Pandit , Austin Xu , Xuan-Phi Nguyen , Yifei Ming , Caiming Xiong , Shafiq Joty

Outcome-rewarded Large Language Models (LLMs) have demonstrated remarkable success in mathematical problem-solving. However, this success often masks a critical issue: models frequently achieve correct answers through fundamentally unsound…

Computation and Language · Computer Science 2025-06-25 Jiaxing Guo , Wenjie Yang , Shengzhong Zhang , Tongshan Xu , Lun Du , Da Zheng , Zengfeng Huang

Large language models (LLMs) have recently shown strong performance on mathematical benchmarks. At the same time, they are prone to hallucination and sycophancy, often providing convincing but flawed proofs for incorrect mathematical…

Artificial Intelligence · Computer Science 2025-10-07 Ivo Petrov , Jasper Dekoninck , Martin Vechev

Automated Theorem Proving (ATP) in formal languages remains a formidable challenge in AI, demanding rigorous logical deduction and navigating vast search spaces. While large language models (LLMs) have shown promising performance, existing…

Artificial Intelligence · Computer Science 2025-05-19 Zhenwen Liang , Linfeng Song , Yang Li , Tao Yang , Feng Zhang , Haitao Mi , Dong Yu

Large language models (LLMs) for formal theorem proving have become a prominent research focus. At present, the proving ability of these LLMs is mainly evaluated through proof pass rates on datasets such as miniF2F. However, this evaluation…

Artificial Intelligence · Computer Science 2025-02-04 Jianyu Zhang , Yongwang Zhao , Long Zhang , Jilin Hu , Xiaokun Luan , Zhiwei Xu , Feng Yang

Natural language explanations play a fundamental role in Natural Language Inference (NLI) by revealing how premises logically entail hypotheses. Recent work has shown that the interaction of large language models (LLMs) with theorem provers…

Computation and Language · Computer Science 2025-06-02 Xin Quan , Marco Valentino , Louise A. Dennis , André Freitas

Automated theorem provers and formal proof assistants are general reasoning systems that are in theory capable of proving arbitrarily hard theorems, thus solving arbitrary problems reducible to mathematics and logical reasoning. In…

Artificial Intelligence · Computer Science 2025-06-23 Lasse Blaauwbroek , David Cerna , Thibault Gauthier , Jan Jakubův , Cezary Kaliszyk , Martin Suda , Josef Urban

Formal theorem proving (FTP) has emerged as a critical foundation for evaluating the reasoning capabilities of large language models, enabling automated verification of mathematical proofs at scale. However, progress has been constrained by…

Logic in Computer Science · Computer Science 2026-05-19 Terry Jingchen Zhang , Wenyuan Jiang , Rongchuan Liu , Yisong Wang , Junran Yang , Ning Wang , Nicole Ni , Yinya Huang , Mrinmaya Sachan

Large Language Models (LLMs) demonstrate impressive mathematical reasoning abilities, but their solutions frequently contain errors that cannot be automatically checked. Formal theorem proving systems such as Lean 4 offer automated…

Artificial Intelligence · Computer Science 2026-03-18 Sumanth Varambally , Thomas Voice , Yanchao Sun , Zhifeng Chen , Rose Yu , Ke Ye

The combination of verifiable languages and LLMs has significantly influenced both the mathematical and computer science communities because it provides a rigorous foundation for theorem proving. Recent advancements in the field provide…

Artificial Intelligence · Computer Science 2026-01-23 Hanning Zhang , Ruida Wang , Rui Pan , Wenyuan Wang , Bingxu Meng , Tong Zhang

Proof engineering is notoriously labor-intensive: proofs that are straightforward on paper often require lengthy scripts in theorem provers. Recent advances in large language models (LLMs) create new opportunities for proof automation:…

Programming Languages · Computer Science 2026-01-08 Yichen Xu , Martin Odersky

Large language models (LLMs) have recently achieved remarkable success in generating rigorous mathematical proofs, with "AI for Math" emerging as a vibrant field of research (Ju et al., 2026). While these models have mastered…

Artificial Intelligence · Computer Science 2026-03-10 Lve Meng , Weilong Zhao , Yanzhi Zhang , Haoxiang Guan , Jiyan He

Mathematical theorem proving is an important testbed for large language models' deep and abstract reasoning capability. This paper focuses on improving LLMs' ability to write proofs in formal languages that permit automated proof…

Machine Learning · Computer Science 2024-11-05 Kefan Dong , Arvind Mahankali , Tengyu Ma

Formal verification via theorem proving enables the expressive specification and rigorous proof of software correctness, but it is difficult to scale due to the significant manual effort and expertise required. While Large Language Models…

Software Engineering · Computer Science 2025-10-30 Minghai Lu , Zhe Zhou , Danning Xie , Songlin Jia , Benjamin Delaware , Tianyi Zhang

Despite the success of large language models (LLMs), the task of theorem proving still remains one of the hardest reasoning tasks that is far from being fully solved. Prior methods using language models have demonstrated promising results,…

While statement autoformalization has advanced rapidly, full-theorem autoformalization remains largely unexplored. Existing iterative refinement methods in statement autoformalization typically improve isolated aspects of formalization,…

Computation and Language · Computer Science 2026-05-08 Lan Zhang , Marco Valentino , André Freitas

Neural theorem proving combines large language models (LLMs) with proof assistants such as Lean, where the correctness of formal proofs can be rigorously verified, leaving no room for hallucination. With existing neural theorem provers…

Artificial Intelligence · Computer Science 2025-05-13 Peiyang Song , Kaiyu Yang , Anima Anandkumar

Large Language Models (LLMs) have emerged as powerful tools in mathematical theorem proving, particularly when utilizing formal languages such as LEAN. A prevalent proof method involves the LLM prover iteratively constructing the proof…

Artificial Intelligence · Computer Science 2025-10-22 Zijian Wu , Suozhi Huang , Zhejian Zhou , Huaiyuan Ying , Zheng Yuan , Wenwei Zhang , Dahua Lin , Kai Chen

Verifiers are auxiliary models that assess the correctness of outputs generated by base large language models (LLMs). They play a crucial role in many strategies for solving reasoning-intensive problems with LLMs. Typically, verifiers are…

Artificial Intelligence · Computer Science 2025-04-24 Bartosz Piotrowski , Witold Drzewakowski , Konrad Staniszewski , Piotr Miłoś

With the growing popularity of Large Reasoning Models and their results in solving mathematical problems, it becomes crucial to measure their capabilities. We introduce a pipeline for both automatic and interactive verification as a more…

Artificial Intelligence · Computer Science 2026-02-25 Varvara Sazonova , Dmitri Shmelkin , Stanislav Kikot , Vasily Motolygin