English
Related papers

Related papers: PutnamBench: Evaluating Neural Theorem-Provers on …

200 papers

Recent advancements in large language models (LLMs) have showcased significant improvements in mathematics. However, traditional math benchmarks like GSM8k offer a unidimensional perspective, falling short in providing a holistic assessment…

Computation and Language · Computer Science 2024-05-21 Hongwei Liu , Zilong Zheng , Yuxuan Qiao , Haodong Duan , Zhiwei Fei , Fengzhe Zhou , Wenwei Zhang , Songyang Zhang , Dahua Lin , Kai Chen

We present TuringQ, the first benchmark designed to evaluate the reasoning capabilities of large language models (LLMs) in the theory of computation. TuringQ consists of 4,006 undergraduate and graduate-level question-answer pairs,…

Computation and Language · Computer Science 2024-10-10 Pardis Sadat Zahraei , Ehsaneddin Asgari

Large Language Models (LLMs) have recently achieved impressive performance in math and reasoning benchmarks. However, they often struggle with logic problems and puzzles that are relatively easy for humans. To further investigate this, we…

Artificial Intelligence · Computer Science 2025-09-16 Nasim Borazjanizadeh , Roei Herzig , Trevor Darrell , Rogerio Feris , Leonid Karlinsky

Algorithmic reasoning is a fundamental cognitive ability that plays a pivotal role in problem-solving and decision-making processes. Reinforcement Learning (RL) has demonstrated remarkable proficiency in tasks such as motor control,…

Machine Learning · Computer Science 2024-07-02 Benjamin Estermann , Luca A. Lanzendörfer , Yannick Niedermayr , Roger Wattenhofer

Mathematical reasoning is a hallmark of human intelligence, and whether large language models (LLMs) can meaningfully perform it remains a central question in artificial intelligence and cognitive science. As LLMs are increasingly…

Computation and Language · Computer Science 2026-04-03 Linyang He , Qiyao Yu , Hanze Dong , Baohao Liao , Xinxing Xu , Micah Goldblum , Jiang Bian , Nima Mesgarani

Reasoning stands as a cornerstone of intelligence, enabling the synthesis of existing knowledge to solve complex problems. Despite remarkable progress, existing reasoning benchmarks often fail to rigorously evaluate the nuanced reasoning…

As automated reasoning systems advance rapidly, there is a growing need for research-level formal mathematical problems to accurately evaluate their capabilities. To address this, we present Formal Conjectures, an evolving benchmark of…

Recent advances in large language models (LLMs) for mathematical reasoning have largely focused on tasks with easily verifiable final answers while generating and verifying natural language math proofs remains an open challenge. We identify…

Computation and Language · Computer Science 2026-03-03 Wenjie Ma , Andrei Cojocaru , Neel Kolhe , Bradley Louie , Robin Said Sharif , Haihan Zhang , Vincent Zhuang , Matei Zaharia , Sewon Min

As language models master existing reasoning benchmarks, we need new challenges to evaluate their cognitive frontiers. Puzzle-solving events are rich repositories of challenging multimodal problems that test a wide range of advanced…

Artificial Intelligence · Computer Science 2025-02-17 Clinton J. Wang , Dean Lee , Cristina Menghini , Johannes Mols , Jack Doughty , Adam Khoja , Jayson Lynch , Sean Hendryx , Summer Yue , Dan Hendrycks

Large Language Models have demonstrated strong performance on many established reasoning benchmarks. However, these benchmarks primarily evaluate structured skills like quantitative problem-solving, leaving a gap in assessing flexible,…

Computation and Language · Computer Science 2025-10-30 Deepon Halder , Alan Saji , Thanmay Jayakumar , Ratish Puduppully , Anoop Kunchukuttan , Raj Dabre

We present a new approach for benchmarking Large Language Model (LLM) capabilities on research-level mathematics. Existing benchmarks largely rely on static, hand-curated sets of contest or textbook-style problems as proxies for…

Artificial Intelligence · Computer Science 2026-03-02 Antoine Peyronnet , Fabian Gloeckle , Amaury Hayat

We present FormalProofBench, a private benchmark designed to evaluate whether AI models can produce formally verified mathematical proofs at the graduate level. Each task pairs a natural-language problem with a Lean~4 formal statement, and…

Artificial Intelligence · Computer Science 2026-03-31 Nikil Ravi , Kexing Ying , Vasilii Nesterov , Rayan Krishnan , Elif Uskuplu , Bingyu Xia , Janitha Aswedige , Langston Nashold

Mathematical reasoning is central to artificial intelligence, with applications in education, code generation, and research-level mathematical discovery. Mathematical competitions highlight two problem types: theorem proving, requiring…

Artificial Intelligence · Computer Science 2025-10-21 Jialiang Sun , Yuzhi Tang , Ao Li , Chris J. Maddison , Kuldeep S. Meel

Existing tabular reasoning benchmarks mostly test models on small, uniform tables, underrepresenting the complexity of real-world data and giving an incomplete view of Large Language Models' (LLMs) reasoning abilities. Real tables are long,…

Computation and Language · Computer Science 2025-11-07 Nikhil Abhyankar , Purvi Chaurasia , Sanchit Kabra , Ananya Srivastava , Vivek Gupta , Chandan K. Reddy

Recent neural theorem provers use reinforcement learning with verifiable rewards (RLVR), where proof assistants provide binary correctness signals. While verifiable rewards are cheap and scalable without reward hacking issues, they suffer…

Artificial Intelligence · Computer Science 2026-05-12 Zeynel A. Uluşan , Burak S. Akbudak , Can S. Erer , Gözde Gül Şahin

Solving topological grid puzzles requires reasoning over global spatial invariants such as connectivity, loop closure, and region symmetry and remains challenging for even the most powerful large language models (LLMs). To study these…

Artificial Intelligence · Computer Science 2026-03-13 Mayug Maniparambil , Nils Hoehing , Janak Kapuriya , Arjun Karuvally , Ellen Rushe , Anthony Ventresque , Noel O'Connor , Fergal Reid

Formal mathematical reasoning remains a critical challenge for artificial intelligence, hindered by limitations of existing benchmarks in scope and scale. To address this, we present FormalMATH, a large-scale Lean4 benchmark comprising…

Despite recent progress in systematic evaluation frameworks, benchmarking the uncertainty of large language models (LLMs) remains a highly challenging task. Existing methods for benchmarking the uncertainty of LLMs face three key…

Computation and Language · Computer Science 2025-06-05 Xunzhi Wang , Zhuowei Zhang , Gaonan Chen , Qiongyu Li , Bitong Luo , Zhixin Han , Haotian Wang , Zhiyu li , Hang Gao , Mengting Hu

The rapid advancement of reasoning capabilities in large language models (LLMs) has led to notable improvements on mathematical benchmarks. However, many of the most commonly used evaluation datasets (e.g., AIME 2024) are widely available…

Artificial Intelligence · Computer Science 2026-01-16 Mislav Balunović , Jasper Dekoninck , Ivo Petrov , Nikola Jovanović , Martin Vechev

Proof assistants like Lean have revolutionized mathematical proof verification, ensuring high accuracy and reliability. Although large language models (LLMs) show promise in mathematical reasoning, their advancement in formal theorem…

Artificial Intelligence · Computer Science 2024-05-24 Huajian Xin , Daya Guo , Zhihong Shao , Zhizhou Ren , Qihao Zhu , Bo Liu , Chong Ruan , Wenda Li , Xiaodan Liang