中文
相关论文

相关论文: Alchemy: Amplifying Theorem-Proving Capability thr…

200 篇论文

LLM-based formal proof assistants (e.g., in Lean) hold great promise for automating mathematical discovery. But beyond syntactic correctness, do these systems truly understand mathematical structure as humans do? We investigate this…

人工智能 · 计算机科学 2025-10-21 Haoyu Zhao , Yihan Geng , Shange Tang , Yong Lin , Bohan Lyu , Hongzhou Lin , Chi Jin , Sanjeev Arora

One important approach to software verification is interactive theorem proving. However, writing formal proofs often requires substantial human effort, making proof automation highly important. Traditionally, proof automation has relied on…

计算机科学中的逻辑 · 计算机科学 2026-03-05 Jian Fang , Yican Sun , Yingfei Xiong

Large language models (LLMs) for formal theorem proving have become a prominent research focus. At present, the proving ability of these LLMs is mainly evaluated through proof pass rates on datasets such as miniF2F. However, this evaluation…

人工智能 · 计算机科学 2025-02-04 Jianyu Zhang , Yongwang Zhao , Long Zhang , Jilin Hu , Xiaokun Luan , Zhiwei Xu , Feng Yang

This paper investigates the logical reasoning capabilities of large language models (LLMs). For a precisely defined yet tractable formulation, we choose the conceptually simple but technically complex task of constructing proofs in Boolean…

机器学习 · 计算机科学 2025-04-30 Yuan Xia , Akanksha Atrey , Fadoua Khmaissia , Kedar S. Namjoshi

Large Language Models frequently generate outputs that appear scientifically reasonable yet violate fundamental principles--a phenomenon we characterize as the "plausibility-validity gap." This challenge proves especially acute in…

机器学习 · 计算机科学 2026-01-07 Malikussaid , Hilal Hudan Nuha , Isman Kurniawan

Interactive theorem provers (ITPs) require manual formalization, which is labor-intensive and demands expert knowledge. While automated formalization offers a potential solution, it faces two major challenges: model hallucination (e.g.,…

人工智能 · 计算机科学 2026-03-24 Wangyue Lu , Lun Du , Sirui Li , Ke Weng , Haozhe Sun , Hengyu Liu , Minghe Yu , Tiancheng Zhang , Ge Yu

While the ecosystem of Lean and Mathlib has enjoyed celebrated success in formal mathematical reasoning with the help of large language models (LLMs), the absence of many folklore lemmas in Mathlib remains a persistent barrier that limits…

计算机科学中的逻辑 · 计算机科学 2026-05-28 Xinyu Liu , Zixuan Xie , Amir Moeini , Claire Chen , Shuze Daniel Liu , Yu Meng , Aidong Zhang , Shangtong Zhang

Automated theorem proving (ATP) has become an appealing domain for exploring the reasoning ability of the recent successful generative language models. However, current ATP benchmarks mainly focus on symbolic inference, but rarely involve…

In mathematical reasoning tasks, the advancement of Large Language Models (LLMs) relies heavily on high-quality training data with clearly defined and well-graded difficulty levels. However, existing data synthesis methods often suffer from…

机器学习 · 计算机科学 2026-01-27 Xuchen Li , Jing Chen , Xuzhao Li , Hao Liang , Xiaohuan Zhou , Taifeng Wang , Wentao Zhang

Theorem proving in natural mathematical language - the mixture of symbolic and natural language used by humans - plays a central role in mathematical advances and education, and tests aspects of reasoning that are core to intelligence. Yet…

计算与语言 · 计算机科学 2022-11-02 Sean Welleck , Jiacheng Liu , Ximing Lu , Hannaneh Hajishirzi , Yejin Choi

Natural language explanations represent a proxy for evaluating explanation-based and multi-step Natural Language Inference (NLI) models. However, assessing the validity of explanations for NLI is challenging as it typically involves the…

计算与语言 · 计算机科学 2024-10-14 Xin Quan , Marco Valentino , Louise A. Dennis , André Freitas

Formal mathematical reasoning remains a critical challenge for artificial intelligence, hindered by limitations of existing benchmarks in scope and scale. To address this, we present FormalMATH, a large-scale Lean4 benchmark comprising…

Inductive reasoning is a core problem-solving capacity: humans can identify underlying principles from a few examples, which robustly generalize to novel scenarios. Recent work evaluates large language models (LLMs) on inductive reasoning…

机器学习 · 计算机科学 2024-06-03 Ruocheng Wang , Eric Zelikman , Gabriel Poesia , Yewen Pu , Nick Haber , Noah D. Goodman

Enhancing the mathematical reasoning of large language models (LLMs) demands high-quality training data, yet conventional methods face critical challenges in scalability, cost, and data reliability. To address these limitations, we propose…

计算与语言 · 计算机科学 2025-08-27 Sirui Chen , Changxin Tian , Binbin Hu , Kunlong Chen , Ziqi Liu , Zhiqiang Zhang , Jun Zhou

Although traditional symbolic reasoning methods are highly interpretable, their application in knowledge graphs link prediction has been limited due to their computational inefficiency. A new RNNNTP method is proposed in this paper, using a…

机器学习 · 计算机科学 2022-03-15 Yu-hao Wu , Hou-biao Li

Formal verification via interactive theorem proving is increasingly used to ensure the correctness of critical systems, yet constructing large proof scripts remains highly manual and limits scalability. Advances in large language models…

人工智能 · 计算机科学 2026-05-08 Baoding He , Zenan Li , Wei Sun , Yuan Yao , Taolue Chen , Xiaoxing Ma , Zhendong Su

We introduce LeanConjecturer, a pipeline for automatically generating university-level mathematical conjectures in Lean 4 using Large Language Models (LLMs). Our hybrid approach combines rule-based context extraction with LLM-based theorem…

人工智能 · 计算机科学 2025-06-30 Naoto Onda , Kazumi Kasaura , Yuta Oriike , Masaya Taniguchi , Akiyoshi Sannai , Sho Sonoda

In interactive theorem provers (ITPs), extensible syntax is not only crucial to lower the cognitive burden of manipulating complex mathematical objects, but plays a critical role in developing reusable abstractions in libraries. Most ITPs…

编程语言 · 计算机科学 2023-06-22 Sebastian Ullrich , Leonardo de Moura

We introduce MorphNLI, a modular step-by-step approach to natural language inference (NLI). When classifying the premise-hypothesis pairs into {entailment, contradiction, neutral}, we use a language model to generate the necessary edits to…

计算与语言 · 计算机科学 2026-02-16 Vlad Andrei Negru , Robert Vacareanu , Camelia Lemnaru , Mihai Surdeanu , Rodica Potolea

A major challenge in applying machine learning to automated theorem proving is the scarcity of training data, which is a key ingredient in training successful deep learning models. To tackle this problem, we propose an approach that relies…