English
Related papers

Related papers: Mathify: Evaluating Large Language Models on Mathe…

200 papers

Advances in large language models (LLMs) have spurred research into enhancing their reasoning capabilities, particularly in math-rich STEM (Science, Technology, Engineering, and Mathematics) documents. While LLMs can generate equations or…

Computation and Language · Computer Science 2025-06-03 Jiaru Zou , Qing Wang , Pratyush Thakur , Nickvash Kani

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen

To advance the mathematical proficiency of large language models (LLMs), the DeepMath team has launched an open-source initiative aimed at developing an open mathematical LLM and systematically evaluating its mathematical creativity. This…

Large language models (LLMs) have shown excellent mastering of human language, but still struggle in real-world applications that require mathematical problem-solving. While many strategies and datasets to enhance LLMs' mathematics are…

Computation and Language · Computer Science 2024-04-04 Yifan Xu , Xiao Liu , Xinghan Liu , Zhenyu Hou , Yueyan Li , Xiaohan Zhang , Zihan Wang , Aohan Zeng , Zhengxiao Du , Wenyi Zhao , Jie Tang , Yuxiao Dong

To advance the evaluation of multimodal math reasoning in large multimodal models (LMMs), this paper introduces a novel benchmark, MM-MATH. MM-MATH consists of 5,929 open-ended middle school math problems with visual contexts, with…

Computation and Language · Computer Science 2024-07-03 Kai Sun , Yushi Bai , Ji Qi , Lei Hou , Juanzi Li

To ensure that math curriculum is grade-appropriate and aligns with critical skills or concepts in accordance with educational standards, pedagogical experts can spend months carefully reviewing published math problems. Drawing inspiration…

Computation and Language · Computer Science 2024-10-08 Li Lucy , Tal August , Rose E. Wang , Luca Soldaini , Courtney Allison , Kyle Lo

Pretrained Large Language Models (LLMs) have achieved remarkable success across diverse domains, with education and research emerging as particularly impactful areas. Among current state-of-the-art LLMs, ChatGPT and DeepSeek exhibit strong…

Artificial Intelligence · Computer Science 2025-12-10 Md Mostafizer Rahman , Ariful Islam Shiplu , Md Faizul Ibne Amin , Yutaka Watanobe , Lu Peng

With the great success of ChatGPT, the research of large language models has become increasingly popular. However, the models have several limitations, such as toxicity and pool performance of arithmetic solving. Meanwhile, LLM may have…

Computation and Language · Computer Science 2023-12-01 Yingdi Guo

The field of machine learning (ML) has gained widespread adoption, leading to significant demand for adapting ML to specific scenarios, which is yet expensive and non-trivial. The predominant approaches towards the automation of solving ML…

Machine Learning · Computer Science 2024-02-20 Lei Zhang , Yuge Zhang , Kan Ren , Dongsheng Li , Yuqing Yang

Recent advances in large language models (LLMs) and multimodal LLMs (MLLMs) have led to strong reasoning ability across a wide range of tasks. However, their ability to perform mathematical reasoning from spoken input remains underexplored.…

Computation and Language · Computer Science 2025-05-22 Chengwei Wei , Bin Wang , Jung-jae Kim , Nancy F. Chen

Large Language Models (LLMs) excel at various tasks, including problem-solving and question-answering. However, LLMs often find Math Word Problems (MWPs) challenging because solving them requires a range of reasoning and mathematical…

Artificial Intelligence · Computer Science 2025-09-24 Mitchell Piehl , Dillon Wilson , Ananya Kalita , Jugal Kalita

In this paper, we explore how to leverage large language models (LLMs) to solve mathematical problems efficiently and accurately. Specifically, we demonstrate the effectiveness of classifying problems into distinct categories and employing…

Computation and Language · Computer Science 2024-12-24 Amogh Akella

Language models have steadily increased in size over the past few years. They achieve a high level of performance on various natural language processing (NLP) tasks such as question answering and summarization. Large language models (LLMs)…

Computation and Language · Computer Science 2023-01-31 Jessica Huynh , Cathy Jiao , Prakhar Gupta , Shikib Mehri , Payal Bajaj , Vishrav Chaudhary , Maxine Eskenazi

Large Language Models (LLMs) excel in solving mathematical problems, yet their performance is often limited by the availability of high-quality, diverse training data. Existing methods focus on augmenting datasets through rephrasing or…

Computation and Language · Computer Science 2025-08-05 Yue Chen , Minghua He , Fangkai Yang , Pu Zhao , Lu Wang , Yu Kang , Yifei Dong , Yuefeng Zhan , Hao Sun , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang

Large language models (LLMs) present an opportunity to scale high-quality personalized education to all. A promising approach towards this means is to build dialog tutoring models that scaffold students' problem-solving. However, even…

Computation and Language · Computer Science 2024-07-15 Nico Daheim , Jakub Macina , Manu Kapur , Iryna Gurevych , Mrinmaya Sachan

Large language models excel on math benchmarks, but their math reasoning robustness to linguistic variation is underexplored. While recent work increasingly treats high-difficulty competitions like the IMO as the gold standard for…

Computation and Language · Computer Science 2025-10-09 Neeraja Kirtane , Yuvraj Khanna , Peter Relan

Students' handwritten math work provides a rich resource for diagnosing cognitive skills, as it captures intermediate reasoning beyond final answers. We investigate how current large language models (LLMs) perform in diagnosing cognitive…

Artificial Intelligence · Computer Science 2026-02-05 Yoonsu Kim , Hyoungwook Jin , Hayeon Doh , Eunhye Kim , Dongyun Jung , Seungju Kim , Kiyoon Choi , Jinho Son , Juho Kim

Large language models (LLMs) such as ChatGPT have received immense interest for their general-purpose language understanding and, in particular, their ability to generate high-quality text or computer code. For many professions, LLMs…

Computation and Language · Computer Science 2024-04-03 Simon Frieder , Julius Berner , Philipp Petersen , Thomas Lukasiewicz

Large language models (LLMs) demonstrate extraordinary abilities in a wide range of natural language processing (NLP) tasks. In this paper, we show that, beyond text understanding capability, LLMs are capable of processing text layouts that…

Computation and Language · Computer Science 2024-08-29 Weiming Li , Manni Duan , Dong An , Yan Shao

In recent years, Large Language Models (LLMs) have demonstrated remarkable versatility across various applications, including natural language understanding, domain-specific knowledge tasks, etc. However, applying LLMs to complex,…

Computation and Language · Computer Science 2024-11-12 Xinqi Yang , Scott Zang , Yong Ren , Dingjie Peng , Zheng Wen
‹ Prev 1 3 4 5 6 7 10 Next ›