English
Related papers

Related papers: Benchmarking Large Language Models for Math Reason…

200 papers

Despite the recent success of large language models (LLMs) in reasoning such as DeepSeek, we for the first time identify a key dilemma in reasoning robustness and generalization: significant performance degradation on novel or incomplete…

Artificial Intelligence · Computer Science 2025-03-07 Tong Yu , Yongcheng Jing , Xikun Zhang , Wentao Jiang , Wenjie Wu , Yingjie Wang , Wenbin Hu , Bo Du , Dacheng Tao

Recent advancements in Large Language Models (LLMs) have brought them closer to matching human cognition across a variety of tasks. How well do these models align with human performance in detecting and mapping analogies? Prior research has…

Computation and Language · Computer Science 2025-07-16 Kalit Inani , Keshav Kabra , Vijay Marupudi , Sashank Varma

Sorting is a tedious but simple task for human intelligence and can be solved fairly easily algorithmically. However, for Large Language Models (LLMs) this task is surprisingly hard, as some properties of sorting are among known weaknesses…

Machine Learning · Computer Science 2025-04-14 Steffen Herbold

Large language models (LLMs) have shown remarkable progress in coding and math problem-solving, but evaluation on advanced research-level problems in hard sciences remains scarce. To fill this gap, we present CMT-Benchmark, a dataset of 50…

Recent math benchmarks for large language models (LLMs) such as MathArena indicate that state-of-the-art reasoning models achieve impressive performance on mathematical competitions like AIME, with the leading model, Gemini-2.5-Pro,…

Large Language Models (LLMs) have been shown to achieve breakthrough performance on complex logical reasoning tasks. Nevertheless, most existing research focuses on employing formal language to guide LLMs to derive reliable reasoning paths,…

Computation and Language · Computer Science 2025-05-23 Jin Jiang , Jianing Wang , Yuchen Yan , Yang Liu , Jianhua Zhu , Mengdi Zhang , Xunliang Cai , Liangcai Gao

Large language models (LLMs) have achieved strong results in mathematical reasoning, and are increasingly deployed as tutoring and learning support tools in educational settings. However, their reliability for students working in…

Computation and Language · Computer Science 2026-04-20 Sukumar Kishanthan , Kumar Thushalika , Buddhi Jayasekara , Asela Hevapathige

Artificial intelligence (AI) is widely deployed to solve problems related to marketing attribution and budget optimization. However, AI models can be quite complex, and it can be difficult to understand model workings and insights without…

Computation and Language · Computer Science 2024-04-23 Yilin Gao , Sai Kumar Arava , Yancheng Li , James W. Snyder

Advances in large language models (LLMs) have spurred research into enhancing their reasoning capabilities, particularly in math-rich STEM (Science, Technology, Engineering, and Mathematics) documents. While LLMs can generate equations or…

Computation and Language · Computer Science 2025-06-03 Jiaru Zou , Qing Wang , Pratyush Thakur , Nickvash Kani

Recent advancements in large language models have led to significant improvements across various tasks, including mathematical reasoning, which is used to assess models' intelligence in logical reasoning and problem-solving. Models are…

Artificial Intelligence · Computer Science 2026-04-27 Erez Yosef , Oron Anschel , Shunit Haviv Hakimi , Asaf Gendler , Adam Botach , Nimrod Berman , Igor Kviatkovsky

Given the rapid ascent of large language models (LLMs), we study the question: (How) can large language models help in reviewing of scientific papers or proposals? We first conduct some pilot studies where we find that (i) GPT-4 outperforms…

Computation and Language · Computer Science 2023-06-02 Ryan Liu , Nihar B. Shah

Mathematical reasoning is an important capability of large language models~(LLMs) for real-world applications. To enhance this capability, existing work either collects large-scale math-related texts for pre-training, or relies on stronger…

Computation and Language · Computer Science 2024-05-24 Kun Zhou , Beichen Zhang , Jiapeng Wang , Zhipeng Chen , Wayne Xin Zhao , Jing Sha , Zhichao Sheng , Shijin Wang , Ji-Rong Wen

Providing effective feedback is important for student learning in programming problem-solving. In this sense, Large Language Models (LLMs) have emerged as potential tools to automate feedback generation. However, their reliability and…

Software Engineering · Computer Science 2025-03-20 Priscylla Silva , Evandro Costa

Students' handwritten math work provides a rich resource for diagnosing cognitive skills, as it captures intermediate reasoning beyond final answers. We investigate how current large language models (LLMs) perform in diagnosing cognitive…

Artificial Intelligence · Computer Science 2026-02-05 Yoonsu Kim , Hyoungwook Jin , Hayeon Doh , Eunhye Kim , Dongyun Jung , Seungju Kim , Kiyoon Choi , Jinho Son , Juho Kim

Recently developed large language models (LLMs) have been shown to perform remarkably well on a wide range of language understanding tasks. But, can they really "reason" over the natural language? This question has been receiving…

Computation and Language · Computer Science 2024-06-07 Mihir Parmar , Nisarg Patel , Neeraj Varshney , Mutsumi Nakamura , Man Luo , Santosh Mashetty , Arindam Mitra , Chitta Baral

The use of large language models (LLMs) is expanding rapidly, and open-source versions are becoming available, offering users safer and more adaptable options. These models enable users to protect data privacy by eliminating the need to…

Machine Learning · Computer Science 2024-08-06 Hui Yin , Amir Aryani , Nakul Nambiar

As the mathematical capabilities of large language models (LLMs) improve, it becomes increasingly important to evaluate their performance on research-level tasks at the frontier of mathematical knowledge. However, existing benchmarks are…

This paper explores the spatial reasoning capability of large language models (LLMs) over textual input through a suite of five tasks aimed at probing their spatial understanding and computational abilities. The models were tested on both…

Computation and Language · Computer Science 2025-10-24 Maggie Bai , Ava Kim Cohen , Eleanor Koss , Charlie Lichtenbaum

We introduce FinanceMath, a novel benchmark designed to evaluate LLMs' capabilities in solving knowledge-intensive math reasoning problems. Compared to prior works, this study features three core advancements. First, FinanceMath includes…

Computation and Language · Computer Science 2024-08-09 Yilun Zhao , Hongjun Liu , Yitao Long , Rui Zhang , Chen Zhao , Arman Cohan

Understanding the limitations of Large Language Models, or LLMs, in mathematical reasoning has been the focus of several recent studies. However, the majority of these studies use the same datasets for benchmarking, which limits the…

Artificial Intelligence · Computer Science 2026-01-01 Samuel Golladay , Majid Bani-Yaghoub