English
Related papers

Related papers: NaturalProver: Grounded Mathematical Proof Generat…

200 papers

Large Language Models (LLMs) have demonstrated significant potential in generating mathematical proofs. However, a persistent challenge is that LLMs occasionally make mistakes, while even a minor mistake can invalidate an entire proof.…

Logic in Computer Science · Computer Science 2025-03-10 David Yin , Jing Gao

Reasoning is a fundamental substrate for solving novel and complex problems. Deliberate efforts in learning and developing frameworks around System 2 reasoning have made great strides, yet problems of sufficient complexity remain largely…

Computation and Language · Computer Science 2024-10-18 Matthew Ho , Vincent Zhu , Xiaoyin Chen , Moksh Jain , Nikolay Malkin , Edwin Zhang

We present StepFun-Prover Preview, a large language model designed for formal theorem proving through tool-integrated reasoning. Using a reinforcement learning pipeline that incorporates tool-based interactions, StepFun-Prover can achieve…

Artificial Intelligence · Computer Science 2025-08-14 Shijie Shang , Ruosi Wan , Yue Peng , Yutong Wu , Xiong-hui Chen , Jie Yan , Xiangyu Zhang

Proof assistants like Lean have revolutionized mathematical proof verification, ensuring high accuracy and reliability. Although large language models (LLMs) show promise in mathematical reasoning, their advancement in formal theorem…

Artificial Intelligence · Computer Science 2024-05-24 Huajian Xin , Daya Guo , Zhihong Shao , Zhizhou Ren , Qihao Zhu , Bo Liu , Chong Ruan , Wenda Li , Xiaodan Liang

In settings from fact-checking to question answering, we frequently want to know whether a collection of evidence (premises) entails a hypothesis. Existing methods primarily focus on the end-to-end discriminative version of this task, but…

Computation and Language · Computer Science 2022-10-31 Kaj Bostrom , Zayne Sprague , Swarat Chaudhuri , Greg Durrett

Mechanical reasoning is a key area of research that lies at the crossroads of mathematical logic and artificial intelligence. The main aim to develop mechanical reasoning systems (also known as theorem provers) was to enable mathematicians…

Software Engineering · Computer Science 2019-12-09 M. Saqib Nawaz , Moin Malik , Yi Li , Meng Sun , M. Ikram Ullah Lali

Large language models have achieved remarkable success on final-answer mathematical problems, largely due to the ease of applying reinforcement learning with verifiable rewards. However, the reasoning underlying these solutions is often…

The combination of verifiable languages and LLMs has significantly influenced both the mathematical and computer science communities because it provides a rigorous foundation for theorem proving. Recent advancements in the field provide…

Artificial Intelligence · Computer Science 2026-01-23 Hanning Zhang , Ruida Wang , Rui Pan , Wenyuan Wang , Bingxu Meng , Tong Zhang

Logical reasoning is a fundamental aspect of human intelligence and a key component of tasks like problem-solving and decision-making. Recent advancements have enabled Large Language Models (LLMs) to potentially exhibit reasoning…

Computation and Language · Computer Science 2023-11-13 Jiazhan Feng , Ruochen Xu , Junheng Hao , Hiteshi Sharma , Yelong Shen , Dongyan Zhao , Weizhu Chen

Recent advances in large language models (LLMs) for mathematical reasoning have largely focused on tasks with easily verifiable final answers while generating and verifying natural language math proofs remains an open challenge. We identify…

Computation and Language · Computer Science 2026-03-03 Wenjie Ma , Andrei Cojocaru , Neel Kolhe , Bradley Louie , Robin Said Sharif , Haihan Zhang , Vincent Zhuang , Matei Zaharia , Sewon Min

Interactive Theorem Provers (ITPs) are an indispensable tool in the arsenal of formal method experts as a platform for construction and (formal) verification of proofs. The complexity of the proofs in conjunction with the level of expertise…

Logic in Computer Science · Computer Science 2023-04-21 Eric Yeh , Briland Hitaj , Sam Owre , Maena Quemener , Natarajan Shankar

Formally verifying properties of software code has been a highly desirable task, especially with the emergence of LLM-generated code. In the same vein, they provide an interesting avenue for the exploration of formal verification and…

Artificial Intelligence · Computer Science 2025-10-02 Balaji Rao , William Eiers , Carlo Lipizzi

Large language models have demonstrated remarkable capabilities in natural language processing tasks requiring multi-step logical reasoning capabilities, such as automated theorem proving. However, challenges persist within theorem proving,…

Computation and Language · Computer Science 2026-05-26 Vincent Li , Tim Knappe , Yule Fu , Kevin Han , Kevin Zhu

Inductive reasoning is a core component of human intelligence. In the past research of inductive reasoning within computer science, formal language is used as representations of knowledge (facts and rules, more specifically). However,…

Computation and Language · Computer Science 2024-02-06 Zonglin Yang , Li Dong , Xinya Du , Hao Cheng , Erik Cambria , Xiaodong Liu , Jianfeng Gao , Furu Wei

Mathematical reasoning demands two critical, complementary skills: constructing rigorous proofs for true statements and discovering counterexamples that disprove false ones. However, current AI efforts in mathematics focus almost…

Artificial Intelligence · Computer Science 2026-03-23 Zenan Li , Zhaoyu Li , Kaiyu Yang , Xiaoxing Ma , Zhendong Su

A step-by-step presentation of the code for a small theorem prover introduces theorem-proving techniques. The programming language used is Standard ML. The prover operates on a sequent calculus formulation of first-order logic, which is…

Logic in Computer Science · Computer Science 2016-08-31 Lawrence C. Paulson

The demand for synthetic data in mathematical reasoning has increased due to its potential to enhance the mathematical capabilities of large language models (LLMs). However, ensuring the validity of intermediate reasoning steps remains a…

Artificial Intelligence · Computer Science 2026-01-19 Joshua Ong Jun Leang , Giwon Hong , Wenda Li , Shay B. Cohen

Large Language Models (LLMs) have demonstrated significant promise in formal theorem proving. In this study, we investigate the ability of LLMs to discover novel theorems and produce verified proofs. We propose a pipeline called…

Machine Learning · Computer Science 2026-05-07 Kazumi Kasaura , Naoto Onda , Yuta Oriike , Masaya Taniguchi , Akiyoshi Sannai , Sho Sonoda

Nowadays, formal theorem provers have made monumental progress on high-school and competition-level mathematics, but few of them generalize to more advanced mathematics. In this paper, we present REAL-Prover, a new open-source stepwise…

Computation and Language · Computer Science 2025-11-25 Ziju Shen , Naohao Huang , Fanyi Yang , Yutong Wang , Guoxiong Gao , Tianyi Xu , Jiedong Jiang , Wanyi He , Pu Yang , Mengzhou Sun , Haocheng Ju , Peihao Wu , Bryan Dai , Bin Dong

Undergraduate students of artificial intelligence often struggle with representing knowledge as logical sentences. This is a skill that seems to require extensive practice to obtain, suggesting a teaching strategy that involves the…

Computers and Society · Computer Science 2015-07-15 Angelo Kyrilov , David Noelle