English
Related papers

Related papers: Mathify: Evaluating Large Language Models on Mathe…

200 papers

Mathematical reasoning remains a challenging area for large language models (LLMs), prompting the development of math-specific LLMs such as LLEMMA, DeepSeekMath, and Qwen2-Math, among others. These models typically follow a two-stage…

Computation and Language · Computer Science 2025-03-25 Zui Chen , Tianqiao Liu , Mi Tian , Qing Tong , Weiqi Luo , Zitao Liu

Large language models (LLMs) with billions of parameters exhibit in-context learning abilities, enabling few-shot learning on tasks that the model was not specifically trained for. Traditional models achieve breakthrough performance on…

Artificial Intelligence · Computer Science 2025-11-04 Aske Plaat , Annie Wong , Suzan Verberne , Joost Broekens , Niki van Stein , Thomas Back

Recent developments in large language models (LLMs) have shown promise in enhancing the capabilities of natural language processing (NLP). Despite these successes, there remains a dearth of research dedicated to the NLP problem-solving…

Computation and Language · Computer Science 2023-10-20 Linxin Song , Jieyu Zhang , Lechao Cheng , Pengyuan Zhou , Tianyi Zhou , Irene Li

Large language models (LLMs) have demonstrated remarkable capabilities in problem-solving. However, their proficiency in solving mathematical problems remains inadequate. We propose MathScale, a simple and scalable method to create…

Computation and Language · Computer Science 2024-03-06 Zhengyang Tang , Xingxing Zhang , Benyou Wang , Furu Wei

With the development of artificial intelligence (AI), large language models (LLM) are widely used in many fields. However, the reasoning ability of LLM is still very limited when it comes to mathematical reasoning. Mathematics plays an…

Computation and Language · Computer Science 2024-08-06 Wenbei Xie , Donglin Liu , Haoran Yan , Wenjie Wu , Zongyang Liu

This paper investigates the mathematical reasoning capabilities of large language models (LLMs) using 50 newly constructed high-school-level word problems. Unlike prior studies that focus solely on answer correctness, we rigorously analyze…

Artificial Intelligence · Computer Science 2025-02-24 Johan Boye , Birger Moell

The performance of large language models (LLMs) on existing reasoning benchmarks has significantly improved over the past years. In response, we present JEEBench, a considerably more challenging benchmark dataset for evaluating the problem…

Computation and Language · Computer Science 2023-10-24 Daman Arora , Himanshu Gaurav Singh , Mausam

Large language models (LLMs) have shown great potential to solve varieties of natural language processing (NLP) tasks, including mathematical reasoning. In this work, we present SkyMath, a large language model for mathematics with 13…

Computation and Language · Computer Science 2023-10-27 Liu Yang , Haihua Yang , Wenjun Cheng , Lei Lin , Chenxia Li , Yifu Chen , Lunan Liu , Jianfei Pan , Tianwen Wei , Biye Li , Liang Zhao , Lijie Wang , Bo Zhu , Guoliang Li , Xuejie Wu , Xilin Luo , Rui Hu

In recent years, there has been remarkable progress in leveraging Language Models (LMs), encompassing Pre-trained Language Models (PLMs) and Large-scale Language Models (LLMs), within the domain of mathematics. This paper conducts a…

Computation and Language · Computer Science 2025-01-03 Wentao Liu , Hanglei Hu , Jie Zhou , Yuyang Ding , Junsong Li , Jiayi Zeng , Mengliang He , Qin Chen , Bo Jiang , Aimin Zhou , Liang He

Large Language Models (LLMs) are increasingly utilized in AI-driven educational instruction and assessment, particularly within mathematics education. The capability of LLMs to generate accurate answers and detailed solutions for math…

Artificial Intelligence · Computer Science 2025-08-15 Liang Zhang , Edith Aurora Graf

Existing research predominantly focuses on developing powerful language learning models (LLMs) for mathematical reasoning within monolingual languages, with few explorations in preserving efficacy in a multilingual context. To bridge this…

Computation and Language · Computer Science 2024-10-17 Nuo Chen , Zinan Zheng , Ning Wu , Ming Gong , Dongmei Zhang , Jia Li

Large language models (LLMs)-based chatbots are increasingly being adopted in the financial domain, particularly in digital banking, to handle customer inquiries about products such as deposits, savings, and loans. However, these models…

Computation and Language · Computer Science 2026-02-27 Yunseung Lee , Subin Kim , Youngjun Kwak , Jaegul Choo

There is a substantial body of literature examining the mathematical reasoning capabilities of large language models (LLMs), particularly their performance on precise arithmetic operations in autoregressive architectures. However, their…

Computation and Language · Computer Science 2025-10-31 Chiung-Yi Tseng , Somshubhra Roy , Maisha Thasin , Danyang Zhang , Blessing Effiong

Mathematical reasoning and optimization are fundamental to artificial intelligence and computational problem-solving. Recent advancements in Large Language Models (LLMs) have significantly improved AI-driven mathematical reasoning, theorem…

Artificial Intelligence · Computer Science 2025-03-25 Ali Forootani

To thoroughly assess the mathematical reasoning abilities of Large Language Models (LLMs), we need to carefully curate evaluation datasets covering diverse mathematical concepts and mathematical problems at different difficulty levels. In…

Computation and Language · Computer Science 2024-09-09 Yan Liu , Renren Jin , Ling Shi , Zheng Yao , Deyi Xiong

This report aims to evaluate the performance of large language models (LLMs) in solving high school science questions and to explore their potential applications in the educational field. With the rapid development of LLMs in the field of…

Computation and Language · Computer Science 2025-05-02 Zhu Jiawei , Chen Wei

Mathematical reasoning is regarded as a necessary ability for Language Models (LMs). Recent works demonstrate large LMs' impressive performance in solving math problems. The success is attributed to their Chain-of-Thought (CoT) reasoning…

Computation and Language · Computer Science 2023-06-08 Tianduo Wang , Wei Lu

Advanced applied mathematics problems are underrepresented in existing Large Language Model (LLM) benchmark datasets. To address this, we introduce HARDMath, a dataset inspired by a graduate course on asymptotic methods, featuring…

Large language models (LLMs) have seen considerable advancements in natural language understanding tasks, yet there remains a gap to bridge before attaining true artificial general intelligence, especially concerning shortcomings in…

Computation and Language · Computer Science 2024-02-23 Minpeng Liao , Wei Luo , Chengxi Li , Jing Wu , Kai Fan

Large language models (LLMs) have demonstrated impressive capabilities in mathematical problem solving, particularly in single turn question answering formats. However, real world scenarios often involve mathematical question answering that…

Artificial Intelligence · Computer Science 2024-05-31 Zhenwen Liang , Dian Yu , Wenhao Yu , Wenlin Yao , Zhihan Zhang , Xiangliang Zhang , Dong Yu