English
Related papers

Related papers: Why are NLP Models Fumbling at Elementary Math? A …

200 papers

Mathematical reasoning is a fundamental aspect of human intelligence and is applicable in various fields, including science, engineering, finance, and everyday life. The development of artificial intelligence (AI) systems capable of solving…

Artificial Intelligence · Computer Science 2023-06-23 Pan Lu , Liang Qiu , Wenhao Yu , Sean Welleck , Kai-Wei Chang

The enhancement of mathematical capabilities in large language models (LLMs) fosters new developments in mathematics education within primary and secondary schools, particularly as they relate to intelligent tutoring systems. However, LLMs…

Computation and Language · Computer Science 2025-07-08 Zhenquan Shen , Xinguo Yu , Xiaotian Cheng , Rao Peng , Hao Ming

Math Word Problems (MWPs) in online assessments help test the ability of the learner to make critical inferences by interpreting the linguistic information in them. To test the mathematical reasoning capabilities of the learners, sometimes…

Information Retrieval · Computer Science 2023-07-06 Mayank Goel , Venktesh V , Vikram Goyal

Large Language Models (LLMs) have demonstrated remarkable capabilities across various domains. Math Word Problems (MWPs) serve as a crucial benchmark for evaluating LLMs' reasoning abilities. While most research primarily focuses on…

Computation and Language · Computer Science 2025-09-09 Yuhong Sun , Zhangyue Yin , Xuanjing Huang , Xipeng Qiu , Hui Zhao

Existing Math Word Problem (MWP) solvers have achieved high accuracy on benchmark datasets. However, prior works have shown that such solvers do not generalize well and rely on superficial cues to achieve high performance. In this paper, we…

Computation and Language · Computer Science 2022-05-03 Vivek Kumar , Rishabh Maheshwary , Vikram Pudi

Large language models (LLMs) have revolutionized NLP by solving downstream tasks with little to no labeled data. Despite their versatile abilities, the larger question of their ability to reason remains ill-understood. This paper addresses…

Computation and Language · Computer Science 2023-08-04 Vedant Gaur , Nikunj Saunshi

Automatically generating high-quality step-by-step solutions to math word problems has many applications in education. Recently, combining large language models (LLMs) with external tools to perform complex reasoning and calculation has…

Computation and Language · Computer Science 2023-04-19 Joy He-Yueya , Gabriel Poesia , Rose E. Wang , Noah D. Goodman

Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art results in many domains. Recently, a variety of model designs and methods have blossomed in the context…

Computation and Language · Computer Science 2018-11-27 Tom Young , Devamanyu Hazarika , Soujanya Poria , Erik Cambria

Deep learning models continuously break new records across different NLP tasks. At the same time, their success exposes weaknesses of model evaluation. Here, we compile several key pitfalls of evaluation of sentence embeddings, a currently…

Computation and Language · Computer Science 2019-06-05 Steffen Eger , Andreas Rücklé , Iryna Gurevych

Large language models (LLMs) with billions of parameters exhibit in-context learning abilities, enabling few-shot learning on tasks that the model was not specifically trained for. Traditional models achieve breakthrough performance on…

Artificial Intelligence · Computer Science 2025-11-04 Aske Plaat , Annie Wong , Suzan Verberne , Joost Broekens , Niki van Stein , Thomas Back

The art of mathematical reasoning stands as a fundamental pillar of intellectual progress and is a central catalyst in cultivating human ingenuity. Researchers have recently published a plethora of works centered around the task of solving…

Computation and Language · Computer Science 2023-06-27 Syed Rifat Raiyan , Md. Nafis Faiyaz , Shah Md. Jawad Kabir , Mohsinul Kabir , Hasan Mahmud , Md Kamrul Hasan

Solving math word problem (MWP) with AI techniques has recently made great progress with the success of deep neural networks (DNN), but it is far from being solved. We argue that the ability of learning by analogy is essential for an MWP…

Computation and Language · Computer Science 2023-06-16 Zihao Zhou , Maizhen Ning , Qiufeng Wang , Jie Yao , Wei Wang , Xiaowei Huang , Kaizhu Huang

Large Language Models (LLMs) have been applied to Math Word Problems (MWPs) with transformative impacts, revolutionizing how these complex problems are approached and solved in various domains including educational settings. However, the…

Computation and Language · Computer Science 2024-06-18 Joykirat Singh , Akshay Nambi , Vibhav Vineet

With the recent rise of widely successful deep learning models, there is emerging interest among professionals in various math and science communities to see and evaluate the state-of-the-art models' abilities to collaborate on finding or…

Computation and Language · Computer Science 2023-10-18 Sophia Gu

We study the problem of generating arithmetic math word problems (MWPs) given a math equation that specifies the mathematical computation and a context that specifies the problem scenario. Existing approaches are prone to generating MWPs…

Computation and Language · Computer Science 2021-09-13 Zichao Wang , Andrew S. Lan , Richard G. Baraniuk

Meta-embedding (ME) learning is an emerging approach that attempts to learn more accurate word embeddings given existing (source) word embeddings as the sole input. Due to their ability to incorporate semantics from multiple source…

Computation and Language · Computer Science 2022-04-26 Danushka Bollegala , James O'Neill

Creating learning models that can exhibit sophisticated reasoning skills is one of the greatest challenges in deep learning research, and mathematics is rapidly becoming one of the target domains for assessing scientific progress in this…

Artificial Intelligence · Computer Science 2025-07-29 Alberto Testolin

We explore contemporary, data-driven techniques for solving math word problems over recent large-scale datasets. We show that well-tuned neural equation classifiers can outperform more sophisticated models such as sequence to sequence and…

Artificial Intelligence · Computer Science 2018-05-01 Benjamin Robaidek , Rik Koncel-Kedziorski , Hannaneh Hajishirzi

Digital learning platforms enable students to learn on a flexible and individual schedule as well as providing instant feedback mechanisms. The field of STEM education requires students to solve numerous training exercises to grasp…

Computation and Language · Computer Science 2021-10-01 Stanley Uros Keller

Large Language Models (LLMs) have shown remarkable success on a wide range of math and reasoning benchmarks. However, we observe that they often struggle when faced with unreasonable math problems. Instead of recognizing these issues,…

Computation and Language · Computer Science 2025-06-03 Jingyuan Ma , Damai Dai , Zihang Yuan , Rui li , Weilin Luo , Bin Wang , Qun Liu , Lei Sha , Zhifang Sui