English
Related papers

Related papers: CAM-Bench: A Benchmark for Computational and Appli…

200 papers

We introduce seqBench, a parametrized benchmark for probing sequential reasoning limits in Large Language Models (LLMs) through precise, multi-dimensional control over several key complexity dimensions. seqBench allows systematic variation…

Artificial Intelligence · Computer Science 2025-09-23 Mohammad Ramezanali , Mo Vazifeh , Paolo Santi

While existing benchmarks probe the reasoning abilities of large language models (LLMs) across diverse domains, they predominantly assess passive reasoning, providing models with all the information needed to reach a solution. By contrast,…

Machine Learning · Computer Science 2025-06-11 Zhanke Zhou , Xiao Feng , Zhaocheng Zhu , Jiangchao Yao , Sanmi Koyejo , Bo Han

Recent benchmarks have probed factual consistency and rhetorical robustness in Large Language Models (LLMs). However, a knowledge gap exists regarding how directional framing of factually true statements influences model agreement, a common…

Computation and Language · Computer Science 2025-06-16 Jaeho Lee , Atharv Chowdhary

Large Language Models (LLMs) have been successful in mathematical reasoning tasks such as formal theorem proving when integrated with interactive proof assistants like Lean. Existing approaches involve training or fine-tuning an LLM on a…

Machine Learning · Computer Science 2025-03-07 Adarsh Kumarappan , Mo Tiwari , Peiyang Song , Robert Joseph George , Chaowei Xiao , Anima Anandkumar

The research in AI-based formal mathematical reasoning has shown an unstoppable growth trend. These studies have excelled in mathematical competitions like IMO and have made significant progress. This paper focuses on formal verification,…

Artificial Intelligence · Computer Science 2025-06-10 Jialun Cao , Yaojie Lu , Meiziniu Li , Haoyang Ma , Haokun Li , Mengda He , Cheng Wen , Le Sun , Hongyu Zhang , Shengchao Qin , Shing-Chi Cheung , Cong Tian

The interactive theorem prover Lean enables the verification of formal mathematical proofs and is backed by an expanding community. Central to this ecosystem is its mathematical library, mathlib4, which lays the groundwork for the…

Information Retrieval · Computer Science 2025-02-05 Guoxiong Gao , Haocheng Ju , Jiedong Jiang , Zihan Qin , Bin Dong

Large language models (LLMs) are becoming increasingly capable mathematical collaborators, but static benchmarks are no longer sufficient for evaluating progress: they are often narrow in scope, quickly saturated, and rarely updated. This…

Computation and Language · Computer Science 2026-05-18 Jasper Dekoninck , Nikola Jovanović , Tim Gehrunger , Kári Rögnvaldsson , Ivo Petrov , Chenhao Sun , Martin Vechev

Recent advances in reinforcement learning (RL) have led to substantial improvements in the mathematical reasoning abilities of LLMs, as measured by standard benchmarks. Yet these gains often persist even when models are trained with flawed…

Artificial Intelligence · Computer Science 2026-01-06 Jian Yao , Ran Cheng , Kay Chen Tan

Mathematics formalisation is the task of writing mathematics (i.e., definitions, theorem statements, proofs) in natural language, as found in books and papers, into a formal language that can then be checked for correctness by a program. It…

Computation and Language · Computer Science 2022-11-15 Ayush Agrawal , Siddhartha Gadgil , Navin Goyal , Ashvni Narayanan , Anand Tadipatri

We present Ax-Prover, a multi-agent system for automated theorem proving in Lean that can solve problems across diverse scientific domains and operate either autonomously or collaboratively with human experts. To achieve this, Ax-Prover…

Using AI to write formal proofs for mathematical problems is a challenging task that has seen some advancements in recent years. Automated systems such as Lean can verify the correctness of proofs written in formal language, yet writing the…

Machine Learning · Computer Science 2025-03-04 Roozbeh Yousefzadeh , Xuenan Cao , Azim Ospanov

The rapid proliferation of benchmarks for evaluating large language models (LLMs) has created an urgent need for systematic methods to assess benchmark quality itself. We propose Benchmark^2, a comprehensive framework comprising three…

Recent advancements in Language Models (LMs) have catalyzed the creation of multiple benchmarks, designed to assess these models' general capabilities. A crucial task, however, is assessing the validity of the benchmarks themselves. This is…

Computation and Language · Computer Science 2024-09-13 Yotam Perlitz , Ariel Gera , Ofir Arviv , Asaf Yehudai , Elron Bandel , Eyal Shnarch , Michal Shmueli-Scheuer , Leshem Choshen

Informal mathematics has been central to modern large language model (LLM) reasoning, offering flexibility and enabling efficient construction of arguments. However, purely informal reasoning is prone to logical gaps and subtle errors that…

Artificial Intelligence · Computer Science 2025-11-25 Azim Ospanov , Zijin Feng , Jiacheng Sun , Haoli Bai , Xin Shen , Farzan Farnia

Proving mathematical theorems using computer-verifiable formal languages like Lean significantly impacts mathematical reasoning. One approach to formal theorem proving involves generating complete proofs using Large Language Models (LLMs)…

Formal Languages and Automata Theory · Computer Science 2024-10-07 Ruida Wang , Jipeng Zhang , Yizhen Jia , Rui Pan , Shizhe Diao , Renjie Pi , Tong Zhang

Autoformalization, the conversion of natural language mathematics into formal languages, offers significant potential for advancing mathematical reasoning. However, existing efforts are limited to formal languages with substantial online…

As large language models (LLMs) are increasingly integrated into educational tools, current evaluations on standardized tests predominantly focus on binary outcome accuracy. Instead, an effective AI tutor must exhibit faithful reasoning,…

Computation and Language · Computer Science 2026-05-01 Luoxi Tang , Tharunya Sundar , Yuqiao Meng , Shuai Yang , Ankita Patra , Lakshmi Manohar Chippada , Jiqian Zhao , Yi Li , Weicheng Ma , Zhaohan Xi

Large Language Models (LLMs) are increasingly being used in education, yet their correctness alone does not capture the quality, reliability, or pedagogical validity of their problem-solving behavior, especially in mathematics, where…

Computers and Society · Computer Science 2025-10-22 Sagnik Dakshit , Sushmita Sinha Roy

Evaluating progress in large language models (LLMs) is often constrained by the challenge of verifying responses, limiting assessments to tasks like mathematics, programming, and short-form question-answering. However, many real-world…

Computation and Language · Computer Science 2026-05-19 Zhilin Wang , Jaehun Jung , Ximing Lu , Shizhe Diao , Ellie Evans , Jiaqi Zeng , Pavlo Molchanov , Yejin Choi , Jan Kautz , Yi Dong

Autonomous language-model agents are increasingly evaluated on long-horizon tool-use tasks, but existing benchmarks rarely capture the complexity and nuance of real scientific work. To address this gap, we introduce Collider-Bench, a…

Machine Learning · Computer Science 2026-05-15 Darius A. Faroughy , Sofia Palacios Schweitzer , Ian Pang , Siddharth Mishra-Sharma , David Shih