English

LLMSTEP: LLM proofstep suggestions in Lean

Artificial Intelligence 2023-10-31 v1 Machine Learning

Abstract

We present LLMSTEP, a tool for integrating a language model into the Lean proof assistant. LLMSTEP is a Lean 4 tactic that sends a user's proof state to a server hosting a language model. The language model generates suggestions, which are checked in Lean and displayed to a user in their development environment. We provide a baseline language model, along with code for fine-tuning and evaluation to support further development. We provide server implementations that run on CPU, a CUDA GPU, or a Google Colab notebook, as a step towards fast, effective language model suggestions for any user.

Keywords

Cite

@article{arxiv.2310.18457,
  title  = {LLMSTEP: LLM proofstep suggestions in Lean},
  author = {Sean Welleck and Rahul Saha},
  journal= {arXiv preprint arXiv:2310.18457},
  year   = {2023}
}
R2 v1 2026-06-28T13:04:17.261Z