Computation and Language · Computer Science
FineMath: A Fine-Grained Mathematical Evaluation Benchmark for Chinese Large Language Models
Yan Liu, Renren Jin, Ling Shi, Zheng Yao +1
2024-09-09
Artificial Intelligence · Computer Science
RealMath: A Continuous Benchmark for Evaluating Language Models on Research-Level Mathematics
Jie Zhang, Cezara Petrui, Kristina Nikolić, Florian Tramèr
2025-10-21
Artificial Intelligence · Computer Science
SenseMath: Do LLMs Have Number Sense? Evaluating Shortcut Use, Judgment, and Generation
Haomin Zhuang, Xiangqi Wang, Yili Shen, Ying Cheng +1
2026-04-03
Artificial Intelligence · Computer Science
Small Language Models are Good Too: An Empirical Study of Zero-Shot Classification
Pierre Lepagnol, Thomas Gerald, Sahar Ghannay, Christophe Servan +1
2024-04-18
Computation and Language · Computer Science
SAS-Bench: A Fine-Grained Benchmark for Evaluating Short Answer Scoring with Large Language Models
Peichao Lai, Kexuan Zhang, Yi Lin, Linyihan Zhang +7
2025-05-16
Computation and Language · Computer Science
AnyMatch -- Efficient Zero-Shot Entity Matching with a Small Language Model
Zeyu Zhang, Paul Groth, Iacer Calixto, Sebastian Schelter
2024-09-10
Computation and Language · Computer Science
ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large Language Models
Yanan Wu, Jie Liu, Xingyuan Bu, Jiaheng Liu +9
2024-02-26
Computation and Language · Computer Science
UTMath: Math Evaluation with Unit Test via Reasoning-to-Coding Thoughts
Bo Yang, Qingping Yang, Yingwei Ma, Runtao Liu
2025-01-15
Computation and Language · Computer Science
Large Language Models are Zero-Shot Reasoners
Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo +1
2023-01-31
Computation and Language · Computer Science
Reasoning Capabilities and Invariability of Large Language Models
Alessandro Raganato, Rafael Peñaloza, Marco Viviani, Gabriella Pasi
2025-05-05
Computation and Language · Computer Science
MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models
Longhui Yu, Weisen Jiang, Han Shi, Jincheng Yu +6
2024-05-06
Computation and Language · Computer Science
Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models
Bofei Gao, Feifan Song, Zhe Yang, Zefan Cai +16
2024-12-25
Computation and Language · Computer Science
Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data
Haolong Li, Yu Ma, Yinqi Zhang, Chen Ye +1
2024-06-05
Artificial Intelligence · Computer Science
Large Language Models Are Better Logical Fallacy Reasoners with Counterargument, Explanation, and Goal-Aware Prompt Formulation
Jiwon Jeong, Hyeju Jang, Hogun Park
2025-04-01
Computation and Language · Computer Science
MM-MATH: Advancing Multimodal Math Evaluation with Process Evaluation and Fine-grained Classification
Kai Sun, Yushi Bai, Ji Qi, Lei Hou +1
2024-07-03
Computation and Language · Computer Science
Do LLMs Overthink Basic Math Reasoning? Benchmarking the Accuracy-Efficiency Tradeoff in Language Models
Gaurav Srivastava, Aafiya Hussain, Sriram Srinivasan, Xuan Wang
2026-04-24
Computation and Language · Computer Science
U-MATH: A University-Level Benchmark for Evaluating Mathematical Skills in LLMs
Konstantin Chernyshev, Vitaliy Polshkov, Ekaterina Artemova, Alex Myasnikov +3
2026-02-03
Artificial Intelligence · Computer Science
FormalMATH: Benchmarking Formal Mathematical Reasoning of Large Language Models
Zhouliang Yu, Ruotian Peng, Keyi Ding, Yizhe Li +9
2025-05-06
Computation and Language · Computer Science
Zero-Shot Question Answering over Financial Documents using Large Language Models
Karmvir Singh Phogat, Chetan Harsha, Sridhar Dasaratha, Shashishekar Ramakrishna +1
2023-11-28
Computers and Society · Computer Science
BanglaMATH : A Bangla benchmark dataset for testing LLM mathematical reasoning at grades 6, 7, and 8
Tabia Tanzin Prama, Christopher M. Danforth, Peter Sheridan Dodds
2025-10-16
Machine Learning · Computer Science
HARDMath: A Benchmark Dataset for Challenging Problems in Applied Mathematics
Jingxuan Fan, Sarah Martinson, Erik Y. Wang, Kaylie Hausknecht +5
2024-12-17