English
Related papers

Related papers: Autoformalizer with Tool Feedback

200 papers

Autoformalization aims to translate natural-language mathematical statements into a formal language. While LLMs have accelerated progress in this area, existing methods still suffer from low accuracy. We identify two key abilities for…

Computation and Language · Computer Science 2025-12-29 Yutong Wu , Di Huang , Ruosi Wan , Yue Peng , Shijie Shang , Chenrui Cao , Lei Qi , Rui Zhang , Zidong Du , Jie Yan , Xing Hu

Large language models (LLMs) for table-based reasoning often struggle with large tables due to input length limits. We propose ATF (Adaptive Table Filtering Framework), a modular and question-aware filtering pipeline that prunes…

Computation and Language · Computer Science 2025-08-05 WonJune Jang

The demand for synthetic data in mathematical reasoning has increased due to its potential to enhance the mathematical capabilities of large language models (LLMs). However, ensuring the validity of intermediate reasoning steps remains a…

Artificial Intelligence · Computer Science 2026-01-19 Joshua Ong Jun Leang , Giwon Hong , Wenda Li , Shay B. Cohen

Autoformalization has emerged as a term referring to the automation of formalization - specifically, the formalization of mathematics using interactive theorem provers (proof assistants). Its rapid development has been driven by progress in…

Artificial Intelligence · Computer Science 2025-12-16 Agnieszka Mensfelt , David Tena Cucala , Santiago Franco , Angeliki Koutsoukou-Argyraki , Vince Trencsenyi , Kostas Stathis

Autoformalization is the task of automatically translating mathematical content written in natural language to a formal language expression. The growing language interpretation capabilities of Large Language Models (LLMs), including in…

Computation and Language · Computer Science 2025-06-16 Lan Zhang , Xin Quan , Andre Freitas

Efficient and accurate autoformalization methods, which leverage large-scale datasets of extensive natural language mathematical problems to construct formal language datasets, are key to advancing formal mathematical reasoning. In this…

Computation and Language · Computer Science 2025-07-16 Jiaxuan Xie , Chengwu Liu , Ye Yuan , Siqi Li , Zhiping Xiao , Ming Zhang

Autoformalization is the process of automatically translating from natural language mathematics to formal specifications and proofs. A successful autoformalization system could advance the fields of formal verification, program synthesis,…

Machine Learning · Computer Science 2022-05-26 Yuhuai Wu , Albert Q. Jiang , Wenda Li , Markus N. Rabe , Charles Staats , Mateja Jamnik , Christian Szegedy

Autoformalization, the automatic translation of mathematical content from natural language into machine-verifiable formal languages, has seen significant progress driven by advances in large language models (LLMs). Nonetheless, a primary…

Computation and Language · Computer Science 2025-10-02 Xiaoyang Liu , Kangjie Bao , Jiashuo Zhang , Yunqi Liu , Yu Chen , Yuntian Liu , Yang Jiao , Tao Luo

Autoformalization, the process of transforming informal mathematical language into formal specifications and proofs remains a difficult task for state-of-the-art (large) language models. Existing works point to competing explanations for…

Artificial Intelligence · Computer Science 2025-02-25 Willy Chan , Michael Souliman , Jakob Nordhagen , Brando Miranda , Elyas Obbad , Kai Fronsdal Sanmi Koyejo

Autoformalization, the process of translating informal statements into formal logic, has gained renewed interest with the emergence of powerful Large Language Models (LLMs). While LLMs show promise in generating structured outputs from…

Computation and Language · Computer Science 2025-11-18 Mihir Gupte , Ramesh S

Supervised fine-tuning (SFT) is a common method to enhance the tool calling capabilities of Large Language Models (LLMs), with the training data often being synthesized. The current data synthesis process generally involves sampling a set…

Computation and Language · Computer Science 2025-03-18 Zezhong Wang , Xingshan Zeng , Weiwen Liu , Liangyou Li , Yasheng Wang , Lifeng Shang , Xin Jiang , Qun Liu , Kam-Fai Wong

Autoformalization aims to convert informal mathematical proofs into machine-verifiable formats, bridging the gap between natural and formal languages. However, ensuring semantic alignment between the informal and formalized statements…

Computation and Language · Computer Science 2024-10-15 Jianqiao Lu , Yingjia Wan , Yinya Huang , Jing Xiong , Zhengying Liu , Zhijiang Guo

Autoformalization, the task of automatically translating natural language descriptions into a formal language, poses a significant challenge across various domains, especially in mathematics. Recent advancements in large language models…

Computation and Language · Computer Science 2024-12-09 Zenan Li , Yifan Wu , Zhaoyu Li , Xinming Wei , Xian Zhang , Fan Yang , Xiaoxing Ma

Autoformalization, the process of transforming informal mathematical propositions into verifiable formal representations, is a foundational task in automated theorem proving, offering a new perspective on the use of mathematics in both…

Artificial Intelligence · Computer Science 2025-07-04 Ke Weng , Lun Du , Sirui Li , Wangyue Lu , Haozhe Sun , Hengyu Liu , Tiancheng Zhang

Autoformalization is the task of translating natural language materials into machine-verifiable formalisations. Progress in autoformalization research is hindered by the lack of a sizeable dataset consisting of informal-formal pairs…

Computation and Language · Computer Science 2023-11-10 Albert Q. Jiang , Wenda Li , Mateja Jamnik

While statement autoformalization has advanced rapidly, full-theorem autoformalization remains largely unexplored. Existing iterative refinement methods in statement autoformalization typically improve isolated aspects of formalization,…

Computation and Language · Computer Science 2026-05-08 Lan Zhang , Marco Valentino , André Freitas

One core capability of large language models (LLMs) is to follow natural language instructions. However, the issue of automatically constructing high-quality training data to enhance the complex instruction-following abilities of LLMs…

Computation and Language · Computer Science 2024-07-19 Guanting Dong , Keming Lu , Chengpeng Li , Tingyu Xia , Bowen Yu , Chang Zhou , Jingren Zhou

Autoformalization - automatically translating natural language mathematical texts into formal proof language such as Lean4 - can help accelerate AI-assisted mathematical research, be it via proof verification or proof search. I fine-tune…

Computation and Language · Computer Science 2026-03-26 Arsen Shebzukhov

Verifying mathematical proofs is difficult, but can be automated with the assistance of a computer. Autoformalization is the task of automatically translating natural language mathematics into a formal language that can be verified by a…

Computation and Language · Computer Science 2024-07-11 Nilay Patel , Rahul Saha , Jeffrey Flanigan

Fine-tuning Large Language Models (LLMs) adapts a trained model to specific downstream tasks, significantly improving task-specific performance. Supervised Fine-Tuning (SFT) is a common approach, where an LLM is trained to produce desired…

Machine Learning · Computer Science 2024-01-03 Qianxi Li , Yingyue Cao , Jikun Kang , Tianpei Yang , Xi Chen , Jun Jin , Matthew E. Taylor
‹ Prev 1 2 3 10 Next ›