English
Related papers

Related papers: Autoformalization in the Wild: Assessing LLMs on R…

200 papers

Autoformalization is the process of automatically translating from natural language mathematics to formal specifications and proofs. A successful autoformalization system could advance the fields of formal verification, program synthesis,…

Machine Learning · Computer Science 2022-05-26 Yuhuai Wu , Albert Q. Jiang , Wenda Li , Markus N. Rabe , Charles Staats , Mateja Jamnik , Christian Szegedy

Autoformalization, the process of transforming informal mathematical propositions into verifiable formal representations, is a foundational task in automated theorem proving, offering a new perspective on the use of mathematics in both…

Artificial Intelligence · Computer Science 2025-07-04 Ke Weng , Lun Du , Sirui Li , Wangyue Lu , Haozhe Sun , Hengyu Liu , Tiancheng Zhang

Autoformalization is the task of automatically translating mathematical content written in natural language to a formal language expression. The growing language interpretation capabilities of Large Language Models (LLMs), including in…

Computation and Language · Computer Science 2025-06-16 Lan Zhang , Xin Quan , Andre Freitas

Autoformalization has emerged as a term referring to the automation of formalization - specifically, the formalization of mathematics using interactive theorem provers (proof assistants). Its rapid development has been driven by progress in…

Artificial Intelligence · Computer Science 2025-12-16 Agnieszka Mensfelt , David Tena Cucala , Santiago Franco , Angeliki Koutsoukou-Argyraki , Vince Trencsenyi , Kostas Stathis

Autoformalization, the task of automatically translating natural language descriptions into a formal language, poses a significant challenge across various domains, especially in mathematics. Recent advancements in large language models…

Computation and Language · Computer Science 2024-12-09 Zenan Li , Yifan Wu , Zhaoyu Li , Xinming Wei , Xian Zhang , Fan Yang , Xiaoxing Ma

Autoformalization is the task of translating natural language materials into machine-verifiable formalisations. Progress in autoformalization research is hindered by the lack of a sizeable dataset consisting of informal-formal pairs…

Computation and Language · Computer Science 2023-11-10 Albert Q. Jiang , Wenda Li , Mateja Jamnik

Mathematical optimization is fundamental to decision-making across diverse domains, from operations research to healthcare. Yet, translating real-world problems into optimization models remains a difficult task, often demanding specialized…

Machine Learning · Computer Science 2025-06-06 Nicolás Astorga , Tennison Liu , Yuanzhang Xiao , Mihaela van der Schaar

Autoformalization aims to translate natural-language mathematical statements into a formal language. While LLMs have accelerated progress in this area, existing methods still suffer from low accuracy. We identify two key abilities for…

Computation and Language · Computer Science 2025-12-29 Yutong Wu , Di Huang , Ruosi Wan , Yue Peng , Shijie Shang , Chenrui Cao , Lei Qi , Rui Zhang , Zidong Du , Jie Yan , Xing Hu

Autoformalization, the process of translating informal statements into formal logic, has gained renewed interest with the emergence of powerful Large Language Models (LLMs). While LLMs show promise in generating structured outputs from…

Computation and Language · Computer Science 2025-11-18 Mihir Gupte , Ramesh S

Verifying mathematical proofs is difficult, but can be automated with the assistance of a computer. Autoformalization is the task of automatically translating natural language mathematics into a formal language that can be verified by a…

Computation and Language · Computer Science 2024-07-11 Nilay Patel , Rahul Saha , Jeffrey Flanigan

Automating the formalization of mathematical statements for theorem proving remains a major challenge for Large Language Models (LLMs). LLMs struggle to identify and utilize the prerequisite mathematical knowledge and its corresponding…

Artificial Intelligence · Computer Science 2026-04-08 Meiru Zhang , Philipp Borchert , Milan Gritta , Gerasimos Lampouras

Autoformalization, the process of transforming informal mathematical language into formal specifications and proofs remains a difficult task for state-of-the-art (large) language models. Existing works point to competing explanations for…

Artificial Intelligence · Computer Science 2025-02-25 Willy Chan , Michael Souliman , Jakob Nordhagen , Brando Miranda , Elyas Obbad , Kai Fronsdal Sanmi Koyejo

Efficient and accurate autoformalization methods, which leverage large-scale datasets of extensive natural language mathematical problems to construct formal language datasets, are key to advancing formal mathematical reasoning. In this…

Computation and Language · Computer Science 2025-07-16 Jiaxuan Xie , Chengwu Liu , Ye Yuan , Siqi Li , Zhiping Xiao , Ming Zhang

Autoformalization plays a crucial role in formal mathematical reasoning by enabling the automatic translation of natural language statements into formal languages. While recent advances using large language models (LLMs) have shown…

Computation and Language · Computer Science 2025-06-13 Lan Zhang , Marco Valentino , Andre Freitas

Autoformalization, the conversion of natural language mathematics into formal languages, offers significant potential for advancing mathematical reasoning. However, existing efforts are limited to formal languages with substantial online…

Formal mathematical reasoning remains a critical challenge for artificial intelligence, hindered by limitations of existing benchmarks in scope and scale. To address this, we present FormalMATH, a large-scale Lean4 benchmark comprising…

Autoformalization, the automatic translation of mathematical content from natural language into machine-verifiable formal languages, has seen significant progress driven by advances in large language models (LLMs). Nonetheless, a primary…

Computation and Language · Computer Science 2025-10-02 Xiaoyang Liu , Kangjie Bao , Jiashuo Zhang , Yunqi Liu , Yu Chen , Yuntian Liu , Yang Jiao , Tao Luo

Large Language Models (LLMs) have recently emerged as powerful tools for autoformalization. Despite their impressive performance, these models can still struggle to produce grounded and verifiable formalizations. Recent work in text-to-SQL,…

Computation and Language · Computer Science 2025-12-05 Hayden Moore , Asfahan Shah

Interactive theorem provers (ITPs) require manual formalization, which is labor-intensive and demands expert knowledge. While automated formalization offers a potential solution, it faces two major challenges: model hallucination (e.g.,…

Artificial Intelligence · Computer Science 2026-03-24 Wangyue Lu , Lun Du , Sirui Li , Ke Weng , Haozhe Sun , Hengyu Liu , Minghe Yu , Tiancheng Zhang , Ge Yu

This paper investigates the capabilities of large language models (LLMs) in formulating and solving decision-making problems using mathematical programming. We first conduct a systematic review and meta-analysis of recent literature to…

Artificial Intelligence · Computer Science 2025-08-26 Mohammad J. Abdel-Rahman , Yasmeen Alslman , Dania Refai , Amro Saleh , Malik A. Abu Loha , Mohammad Yahya Hamed
‹ Prev 1 2 3 10 Next ›