English
Related papers

Related papers: PutnamBench: Evaluating Neural Theorem-Provers on …

200 papers

Large language models (LLMs) have recently demonstrated remarkable progress in formal theorem proving. Yet their ability to serve as practical assistants for mathematicians, filling in missing steps within complex proofs, remains…

Computation and Language · Computer Science 2025-10-06 Xiao-Wen Yang , Zihao Zhang , Jianuo Cao , Zhi Zhou , Zenan Li , Lan-Zhe Guo , Yuan Yao , Taolue Chen , Yu-Feng Li , Xiaoxing Ma

Competitive programming problems increasingly serve as valuable benchmarks to evaluate the coding capabilities of large language models (LLMs) due to their complexity and ease of verification. Yet, current coding benchmarks face limitations…

Artificial Intelligence · Computer Science 2025-12-23 Kaijian Zou , Aaron Xiong , Yunxiang Zhang , Frederick Zhang , Yueqi Ren , Jirong Yang , Ayoung Lee , Shitanshu Bhushan , Lu Wang

As LLMs advance their reasoning capabilities about the physical world, the absence of rigorous benchmarks for evaluating their ability to generate scientifically valid physical models has become a critical gap. Computational mechanics,…

Machine Learning · Computer Science 2025-12-25 Saeed Mohammadzadeh , Erfan Hamdi , Joel Shor , Emma Lejeune

Recent AI systems have achieved gold-medal-level performance on the International Mathematical Olympiad, demonstrating remarkable proficiency at competition-style problem solving. However, competition mathematics represents only a narrow…

Artificial Intelligence · Computer Science 2026-04-09 Suhaas Garre , Erik Knutsen , Sushant Mehta , Edwin Chen

Existing benchmarks for evaluating mathematical reasoning in large language models (LLMs) rely primarily on competition problems, formal proofs, or artificially challenging questions -- failing to capture the nature of mathematics…

Artificial Intelligence · Computer Science 2025-10-21 Jie Zhang , Cezara Petrui , Kristina Nikolić , Florian Tramèr

Large Language Models (LLMs) have demonstrated impressive capabilities in natural language processing tasks, such as text generation and semantic understanding. However, their performance on numerical reasoning tasks, such as basic…

Computation and Language · Computer Science 2025-06-04 Haoyang Li , Xuejia Chen , Zhanchao XU , Darian Li , Nicole Hu , Fei Teng , Yiming Li , Luyu Qiu , Chen Jason Zhang , Qing Li , Lei Chen

Training certifiably robust neural networks is an important but challenging task. While many algorithms for (deterministic) certified training have been proposed, they are often evaluated on different training schedules, certification…

Machine Learning · Computer Science 2025-05-29 Yuhao Mao , Stefan Balauca , Martin Vechev

Most of the existing Large Language Model (LLM) benchmarks on scientific problem reasoning focus on problems grounded in high-school subjects and are confined to elementary algebraic operations. To systematically examine the reasoning…

Computation and Language · Computer Science 2024-07-01 Xiaoxuan Wang , Ziniu Hu , Pan Lu , Yanqiao Zhu , Jieyu Zhang , Satyen Subramaniam , Arjun R. Loomba , Shichang Zhang , Yizhou Sun , Wei Wang

Neural theorem proving has advanced rapidly in the past year, reaching IMO gold-medalist capabilities and producing formal proofs that span thousands of lines. Although such proofs are mechanically verified by formal systems like Lean,…

Machine Learning · Computer Science 2025-10-20 Alex Gu , Bartosz Piotrowski , Fabian Gloeckle , Kaiyu Yang , Aram H. Markosyan

The evaluation of mathematical reasoning capabilities is essential for advancing Artificial General Intelligence (AGI). While Large Language Models (LLMs) have shown impressive performance in solving mathematical problems, existing…

Computation and Language · Computer Science 2025-01-15 Bo Yang , Qingping Yang , Yingwei Ma , Runtao Liu

Reasoning remains a challenging task for large language models (LLMs), especially within the logically constrained environment of automated theorem proving (ATP), due to sparse rewards and the vast scale of proofs. These challenges are…

Artificial Intelligence · Computer Science 2025-07-04 Matthieu Zimmer , Xiaotong Ji , Rasul Tutunov , Anthony Bordg , Jun Wang , Haitham Bou Ammar

Test-time scaling has significantly improved large language model performance, enabling deeper reasoning to solve complex problems. However, this increased reasoning capability also leads to excessive token generation and unnecessary…

Recent progress in LLMs, such as reasoning models, has demonstrated strong abilities to solve complex competitive programming problems, often rivaling top human competitors. However, it remains underexplored whether these abilities…

Computation and Language · Computer Science 2025-07-22 Jierui Li , Raymond Mooney

Large language models (LLMs) have manifested strong ability to generate codes for productive activities. However, current benchmarks for code synthesis, such as HumanEval, MBPP, and DS-1000, are predominantly oriented towards introductory…

Computation and Language · Computer Science 2024-05-08 Shudan Zhang , Hanlin Zhao , Xiao Liu , Qinkai Zheng , Zehan Qi , Xiaotao Gu , Xiaohan Zhang , Yuxiao Dong , Jie Tang

Solving financial problems demands complex reasoning, multimodal data processing, and a broad technical understanding, presenting unique challenges for current large language models (LLMs). We introduce XFinBench, a novel benchmark with…

Computation and Language · Computer Science 2025-08-25 Zhihan Zhang , Yixin Cao , Lizi Liao

Large language models (LLMs) achieve impressive scores on standard benchmarks yet routinely fail questions that any human would answer correctly in seconds. We introduce BrainBench, a benchmark of 100 brainteaser questions spanning 20…

Artificial Intelligence · Computer Science 2026-03-18 Yuzhe Tang

Thinking LLMs solve complex tasks at the expense of increased compute and overthinking on simpler problems, while non-thinking LLMs are faster and cheaper but underthink on harder reasoning problems. This has led to the development of…

Computation and Language · Computer Science 2025-10-07 Pranjal Aggarwal , Seungone Kim , Jack Lanchantin , Sean Welleck , Jason Weston , Ilia Kulikov , Swarnadeep Saha

Mathematical problem solving remains a challenging test of reasoning for large language and multimodal models, yet existing benchmarks are limited in size, language coverage, and task diversity. We introduce MathNet, a high-quality,…

Artificial Intelligence · Computer Science 2026-04-21 Shaden Alshammari , Kevin Wen , Abrar Zainal , Mark Hamilton , Navid Safaei , Sultan Albarakati , William T. Freeman , Antonio Torralba

Evaluating statement autoformalization, translating natural language mathematics into formal languages like Lean 4, remains a significant challenge, with few metrics, datasets, and standards to robustly measure progress. In this work, we…

Computation and Language · Computer Science 2025-10-30 Auguste Poiroux , Gail Weiss , Viktor Kunčak , Antoine Bosselut

Despite the remarkable advancements and widespread applications of deep neural networks, their ability to perform reasoning tasks remains limited, particularly in domains requiring structured, abstract thought. In this paper, we investigate…

Computation and Language · Computer Science 2025-09-16 Satyam Goyal , Soham Dan