中文
相关论文

相关论文: Mathify: Evaluating Large Language Models on Mathe…

200 篇论文

Mathematical reasoning remains a challenging area for large language models (LLMs), prompting the development of math-specific LLMs such as LLEMMA, DeepSeekMath, and Qwen2-Math, among others. These models typically follow a two-stage…

计算与语言 · 计算机科学 2025-03-25 Zui Chen , Tianqiao Liu , Mi Tian , Qing Tong , Weiqi Luo , Zitao Liu

Large language models (LLMs) with billions of parameters exhibit in-context learning abilities, enabling few-shot learning on tasks that the model was not specifically trained for. Traditional models achieve breakthrough performance on…

人工智能 · 计算机科学 2025-11-04 Aske Plaat , Annie Wong , Suzan Verberne , Joost Broekens , Niki van Stein , Thomas Back

Recent developments in large language models (LLMs) have shown promise in enhancing the capabilities of natural language processing (NLP). Despite these successes, there remains a dearth of research dedicated to the NLP problem-solving…

计算与语言 · 计算机科学 2023-10-20 Linxin Song , Jieyu Zhang , Lechao Cheng , Pengyuan Zhou , Tianyi Zhou , Irene Li

Large language models (LLMs) have demonstrated remarkable capabilities in problem-solving. However, their proficiency in solving mathematical problems remains inadequate. We propose MathScale, a simple and scalable method to create…

计算与语言 · 计算机科学 2024-03-06 Zhengyang Tang , Xingxing Zhang , Benyou Wang , Furu Wei

With the development of artificial intelligence (AI), large language models (LLM) are widely used in many fields. However, the reasoning ability of LLM is still very limited when it comes to mathematical reasoning. Mathematics plays an…

计算与语言 · 计算机科学 2024-08-06 Wenbei Xie , Donglin Liu , Haoran Yan , Wenjie Wu , Zongyang Liu

This paper investigates the mathematical reasoning capabilities of large language models (LLMs) using 50 newly constructed high-school-level word problems. Unlike prior studies that focus solely on answer correctness, we rigorously analyze…

人工智能 · 计算机科学 2025-02-24 Johan Boye , Birger Moell

The performance of large language models (LLMs) on existing reasoning benchmarks has significantly improved over the past years. In response, we present JEEBench, a considerably more challenging benchmark dataset for evaluating the problem…

计算与语言 · 计算机科学 2023-10-24 Daman Arora , Himanshu Gaurav Singh , Mausam

Large language models (LLMs) have shown great potential to solve varieties of natural language processing (NLP) tasks, including mathematical reasoning. In this work, we present SkyMath, a large language model for mathematics with 13…

In recent years, there has been remarkable progress in leveraging Language Models (LMs), encompassing Pre-trained Language Models (PLMs) and Large-scale Language Models (LLMs), within the domain of mathematics. This paper conducts a…

计算与语言 · 计算机科学 2025-01-03 Wentao Liu , Hanglei Hu , Jie Zhou , Yuyang Ding , Junsong Li , Jiayi Zeng , Mengliang He , Qin Chen , Bo Jiang , Aimin Zhou , Liang He

Large Language Models (LLMs) are increasingly utilized in AI-driven educational instruction and assessment, particularly within mathematics education. The capability of LLMs to generate accurate answers and detailed solutions for math…

人工智能 · 计算机科学 2025-08-15 Liang Zhang , Edith Aurora Graf

Existing research predominantly focuses on developing powerful language learning models (LLMs) for mathematical reasoning within monolingual languages, with few explorations in preserving efficacy in a multilingual context. To bridge this…

计算与语言 · 计算机科学 2024-10-17 Nuo Chen , Zinan Zheng , Ning Wu , Ming Gong , Dongmei Zhang , Jia Li

Large language models (LLMs)-based chatbots are increasingly being adopted in the financial domain, particularly in digital banking, to handle customer inquiries about products such as deposits, savings, and loans. However, these models…

计算与语言 · 计算机科学 2026-02-27 Yunseung Lee , Subin Kim , Youngjun Kwak , Jaegul Choo

There is a substantial body of literature examining the mathematical reasoning capabilities of large language models (LLMs), particularly their performance on precise arithmetic operations in autoregressive architectures. However, their…

计算与语言 · 计算机科学 2025-10-31 Chiung-Yi Tseng , Somshubhra Roy , Maisha Thasin , Danyang Zhang , Blessing Effiong

Mathematical reasoning and optimization are fundamental to artificial intelligence and computational problem-solving. Recent advancements in Large Language Models (LLMs) have significantly improved AI-driven mathematical reasoning, theorem…

人工智能 · 计算机科学 2025-03-25 Ali Forootani

To thoroughly assess the mathematical reasoning abilities of Large Language Models (LLMs), we need to carefully curate evaluation datasets covering diverse mathematical concepts and mathematical problems at different difficulty levels. In…

计算与语言 · 计算机科学 2024-09-09 Yan Liu , Renren Jin , Ling Shi , Zheng Yao , Deyi Xiong

This report aims to evaluate the performance of large language models (LLMs) in solving high school science questions and to explore their potential applications in the educational field. With the rapid development of LLMs in the field of…

计算与语言 · 计算机科学 2025-05-02 Zhu Jiawei , Chen Wei

Mathematical reasoning is regarded as a necessary ability for Language Models (LMs). Recent works demonstrate large LMs' impressive performance in solving math problems. The success is attributed to their Chain-of-Thought (CoT) reasoning…

计算与语言 · 计算机科学 2023-06-08 Tianduo Wang , Wei Lu

Advanced applied mathematics problems are underrepresented in existing Large Language Model (LLM) benchmark datasets. To address this, we introduce HARDMath, a dataset inspired by a graduate course on asymptotic methods, featuring…

Large language models (LLMs) have seen considerable advancements in natural language understanding tasks, yet there remains a gap to bridge before attaining true artificial general intelligence, especially concerning shortcomings in…

计算与语言 · 计算机科学 2024-02-23 Minpeng Liao , Wei Luo , Chengxi Li , Jing Wu , Kai Fan

Large language models (LLMs) have demonstrated impressive capabilities in mathematical problem solving, particularly in single turn question answering formats. However, real world scenarios often involve mathematical question answering that…

人工智能 · 计算机科学 2024-05-31 Zhenwen Liang , Dian Yu , Wenhao Yu , Wenlin Yao , Zhihan Zhang , Xiangliang Zhang , Dong Yu