English
Related papers

Related papers: The Open Proof Corpus: A Large-Scale Study of LLM-…

200 papers

Providing effective feedback is important for student learning in programming problem-solving. In this sense, Large Language Models (LLMs) have emerged as potential tools to automate feedback generation. However, their reliability and…

Software Engineering · Computer Science 2025-03-20 Priscylla Silva , Evandro Costa

Background: Manual testing is vital for detecting issues missed by automated tests, but specifying accurate verifications is challenging. Aims: This study aims to explore the use of Large Language Models (LLMs) to produce verifications for…

The evaluation of Large Language Models (LLMs) on mathematical reasoning has largely focused on elementary problems, competition-style questions, or formal theorem proving, leaving graduate-level and computational mathematics relatively…

Computation and Language · Computer Science 2026-03-05 Bianca Raimondi , Francesco Pivi , Davide Evangelista , Maurizio Gabbrielli

The automated generation of design RTL based on large language model (LLM) and natural language instructions has demonstrated great potential in agile circuit design. However, the lack of datasets and benchmarks in the public domain…

Hardware Architecture · Computer Science 2025-03-20 Shang Liu , Yao Lu , Wenji Fang , Mengming Li , Zhiyao Xie

Large language models (LLMs) have shown increasing competence in solving mathematical reasoning problems. However, many open-source LLMs still struggle with errors in calculation and semantic understanding during intermediate reasoning…

Computation and Language · Computer Science 2024-12-18 Vernon Y. H. Toh , Deepanway Ghosal , Soujanya Poria

Inequality proving, crucial across diverse scientific and mathematical fields, tests advanced reasoning skills such as discovering tight bounds and strategic theorem application. This makes it a distinct, demanding frontier for large…

Artificial Intelligence · Computer Science 2025-12-16 Pan Lu , Jiayi Sheng , Luna Lyu , Jikai Jin , Tony Xia , Alex Gu , James Zou

Recent studies have suggested that large language models (LLMs) underperform on mathematical and computer science tasks when these problems are translated from Romanian into English, compared to their original Romanian format. Accurate…

This paper considers the development of an AI-based provably-correct mathematical proof tutor. While Large Language Models (LLMs) allow seamless communication in natural language, they are error prone. Theorem provers such as Lean allow for…

Machine Learning · Computer Science 2026-03-05 Manooshree Patel , Rayna Bhattacharyya , Thomas Lu , Arnav Mehta , Niels Voss , Narges Norouzi , Gireeja Ranade

This paper considers the development of an AI-based provably-correct mathematical proof tutor. While Large Language Models (LLMs) allow seamless communication in natural language, they are error prone. Theorem provers such as Lean allow for…

Artificial Intelligence · Computer Science 2026-03-05 Manooshree Patel , Rayna Bhattacharyya , Thomas Lu , Arnav Mehta , Niels Voss , Narges Norouzi , Gireeja Ranade

Large language models (LLMs) increasingly help people solve problems, from debugging code to repairing machinery. This process requires generating plausible hypotheses from partial descriptions, then updating them as more information…

Machine Learning · Computer Science 2026-05-08 Hua-Dong Xiong

The rapid advancement of large language models (LLMs) has led to significant breakthroughs in automated mathematical reasoning and scientific discovery. Georgiev, G${\'o}$mez-Serrano, Tao, and Wagner [GGSTW+25] demonstrate that AI systems…

Artificial Intelligence · Computer Science 2025-12-17 Yang Cao , Yubin Chen , Xuyang Guo , Zhao Song , Song Yue , Jiahao Zhang , Jiale Zhao

Enhancing the mathematical reasoning of large language models (LLMs) demands high-quality training data, yet conventional methods face critical challenges in scalability, cost, and data reliability. To address these limitations, we propose…

Computation and Language · Computer Science 2025-08-27 Sirui Chen , Changxin Tian , Binbin Hu , Kunlong Chen , Ziqi Liu , Zhiqiang Zhang , Jun Zhou

Recent work has shown the immense potential of synthetically generated datasets for training large language models (LLMs), especially for acquiring targeted skills. Current large-scale math instruction tuning datasets such as MetaMathQA (Yu…

Computation and Language · Computer Science 2024-11-05 Shubham Toshniwal , Ivan Moshkov , Sean Narenthiran , Daria Gitman , Fei Jia , Igor Gitman

The rise of reasoning models necessitates large-scale verifiable data, for which programming tasks serve as an ideal source. However, while competitive programming platforms provide abundant problems and solutions, high-quality test cases…

Software Engineering · Computer Science 2026-01-21 Jianfeng Cai , Jinhua Zhu , Ruopei Sun , Kangwen Zhao , Dongyun Xue , Mingxiao Feng , Wengang Zhou , Houqiang Li

Competitive programming problems increasingly serve as valuable benchmarks to evaluate the coding capabilities of large language models (LLMs) due to their complexity and ease of verification. Yet, current coding benchmarks face limitations…

Artificial Intelligence · Computer Science 2025-12-23 Kaijian Zou , Aaron Xiong , Yunxiang Zhang , Frederick Zhang , Yueqi Ren , Jirong Yang , Ayoung Lee , Shitanshu Bhushan , Lu Wang

Neural theorem proving combines large language models (LLMs) with proof assistants such as Lean, where the correctness of formal proofs can be rigorously verified, leaving no room for hallucination. With existing neural theorem provers…

Artificial Intelligence · Computer Science 2025-05-13 Peiyang Song , Kaiyu Yang , Anima Anandkumar

Mathematical theorem proving is an important testbed for large language models' deep and abstract reasoning capability. This paper focuses on improving LLMs' ability to write proofs in formal languages that permit automated proof…

Machine Learning · Computer Science 2024-11-05 Kefan Dong , Arvind Mahankali , Tengyu Ma

Large Language Models (LLMs) are pre-trained on large amounts of data from different sources and domains. Such datasets often contain trillions of tokens, including large portions of copyrighted or proprietary content, which raises…

Proof-oriented programming languages (POPLs) empower developers to write code alongside formal correctness proofs, providing formal guarantees that the code adheres to specified requirements. Despite their powerful capabilities, POPLs…

Software Engineering · Computer Science 2025-08-06 Rijul Jain , Shraddha Barke , Gabriel Ebner , Md Rakib Hossain Misu , Shan Lu , Sarah Fakhoury

Neural networks are increasingly used to support decision-making. To verify their reliability and adaptability, researchers and practitioners have proposed a variety of tools and methods for tasks such as NN code verification, refactoring,…

Machine Learning · Computer Science 2026-02-05 Nadia Daoudi , Jordi Cabot