English
Related papers

Related papers: Are NLP Models really able to Solve Simple Math Wo…

200 papers

Math Word Problems (MWPs) in online assessments help test the ability of the learner to make critical inferences by interpreting the linguistic information in them. To test the mathematical reasoning capabilities of the learners, sometimes…

Information Retrieval · Computer Science 2023-07-06 Mayank Goel , Venktesh V , Vikram Goyal

Math word problem (MWP) solving faces a dilemma in number representation learning. In order to avoid the number representation issue and reduce the search space of feasible solutions, existing works striving for MWP solving usually replace…

Artificial Intelligence · Computer Science 2022-05-12 Zhenwen Liang , Jipeng Zhang , Lei Wang , Wei Qin , Yunshi Lan , Jie Shao , Xiangliang Zhang

Math word problem (MWP) solving is an important task in question answering which requires human-like reasoning ability. Analogical reasoning has long been used in mathematical education, as it enables students to apply common relational…

Computation and Language · Computer Science 2022-12-05 Zhenwen Liang , Jipeng Zhang , Xiangliang Zhang

The enhancement of mathematical capabilities in large language models (LLMs) fosters new developments in mathematics education within primary and secondary schools, particularly as they relate to intelligent tutoring systems. However, LLMs…

Computation and Language · Computer Science 2025-07-08 Zhenquan Shen , Xinguo Yu , Xiaotian Cheng , Rao Peng , Hao Ming

Solving math word problem (MWP) with AI techniques has recently made great progress with the success of deep neural networks (DNN), but it is far from being solved. We argue that the ability of learning by analogy is essential for an MWP…

Computation and Language · Computer Science 2023-06-16 Zihao Zhou , Maizhen Ning , Qiufeng Wang , Jie Yao , Wei Wang , Xiaowei Huang , Kaizhu Huang

The art of mathematical reasoning stands as a fundamental pillar of intellectual progress and is a central catalyst in cultivating human ingenuity. Researchers have recently published a plethora of works centered around the task of solving…

Computation and Language · Computer Science 2023-06-27 Syed Rifat Raiyan , Md. Nafis Faiyaz , Shah Md. Jawad Kabir , Mohsinul Kabir , Hasan Mahmud , Md Kamrul Hasan

With the boom of Large Language Models (LLMs), the research of solving Math Word Problem (MWP) has recently made great progress. However, there are few studies to examine the security of LLMs in math solving ability. Instead of attacking…

Computation and Language · Computer Science 2023-09-06 Zihao Zhou , Qiufeng Wang , Mingyu Jin , Jie Yao , Jianan Ye , Wei Liu , Wei Wang , Xiaowei Huang , Kaizhu Huang

Recently, deep learning models have made great progress in MWP solving on answer accuracy. However, they are uninterpretable since they mainly rely on shallow heuristics to achieve high performance without understanding and reasoning the…

Artificial Intelligence · Computer Science 2022-10-25 Zhicheng Yang , Jinghui Qin , Jiaqi Chen , Liang Lin , Xiaodan Liang

Large Language Models (LLMs) have demonstrated remarkable capabilities across various domains. Math Word Problems (MWPs) serve as a crucial benchmark for evaluating LLMs' reasoning abilities. While most research primarily focuses on…

Computation and Language · Computer Science 2025-09-09 Yuhong Sun , Zhangyue Yin , Xuanjing Huang , Xipeng Qiu , Hui Zhao

Large language models (LLMs) are highly effective in various natural language processing (NLP) tasks. However, they are susceptible to producing unreliable conjectures in ambiguous contexts called hallucination. This paper presents a new…

Computation and Language · Computer Science 2024-03-07 Yuhong Sun , Zhangyue Yin , Qipeng Guo , Jiawen Wu , Xipeng Qiu , Hui Zhao

Large language models (LLMs) are known to struggle with complicated reasoning tasks such as math word problems (MWPs). In this paper, we present how analogy from similarly structured questions can improve LLMs' problem-solving capabilities…

Computation and Language · Computer Science 2024-11-26 Xiaocong Yang , Jiacheng Lin , Ziqi Wang , Chengxiang Zhai

Large Language Models (LLMs) have shown remarkable success on a wide range of math and reasoning benchmarks. However, we observe that they often struggle when faced with unreasonable math problems. Instead of recognizing these issues,…

Computation and Language · Computer Science 2025-06-03 Jingyuan Ma , Damai Dai , Zihang Yuan , Rui li , Weilin Luo , Bin Wang , Qun Liu , Lei Sha , Zhifang Sui

Math word problem (MWP) is a challenging and critical task in natural language processing. Many recent studies formalize MWP as a generation task and have adopted sequence-to-sequence models to transform problem descriptions to mathematical…

Computation and Language · Computer Science 2021-09-08 Jianhao Shen , Yichun Yin , Lin Li , Lifeng Shang , Xin Jiang , Ming Zhang , Qun Liu

A math word problem (MWP) is a coherent narrative which reflects the underlying logic of math equations. Successful MWP generation can automate the writing of mathematics questions. Previous methods mainly generate MWP text based on…

Artificial Intelligence · Computer Science 2022-04-12 Tianyang Cao , Shuang Zeng , Xiaodan Xu , Mairgup Mansur , Baobao Chang

Large language models (LLMs) have demonstrated strong performance on coding tasks such as generation, completion and repair, but their ability to handle complex symbolic reasoning over code still remains underexplored. We introduce the task…

Software Engineering · Computer Science 2025-09-17 Daniel Koh , Yannic Noller , Corina S. Pasareanu , Adrians Skapars , Youcheng Sun

Large language models (LLMs) can solve arithmetic word problems with high accuracy, but little is known about how well they generalize to more complex problems. This is difficult to study, as (i) much of the available evaluation data has…

Machine Learning · Computer Science 2025-02-17 Andreas Opedal , Haruki Shirakami , Bernhard Schölkopf , Abulhair Saparov , Mrinmaya Sachan

We study the performance of a commercially available large language model (LLM) known as ChatGPT on math word problems (MWPs) from the dataset DRAW-1K. To our knowledge, this is the first independent evaluation of ChatGPT. We found that…

Computation and Language · Computer Science 2023-03-01 Paulo Shakarian , Abhinav Koyyalamudi , Noel Ngu , Lakshmivihari Mareedu

The rapid progress in the field of natural language processing (NLP) systems and the expansion of large language models (LLMs) have opened up numerous opportunities in the field of education and instructional methods. These advancements…

Computation and Language · Computer Science 2024-04-23 Avinash Anand , Mohit Gupta , Kritarth Prasad , Navya Singla , Sanjana Sanjeev , Jatin Kumar , Adarsh Raj Shivam , Rajiv Ratn Shah

Automatically generating high-quality step-by-step solutions to math word problems has many applications in education. Recently, combining large language models (LLMs) with external tools to perform complex reasoning and calculation has…

Computation and Language · Computer Science 2023-04-19 Joy He-Yueya , Gabriel Poesia , Rose E. Wang , Noah D. Goodman

We present ASDiv (Academia Sinica Diverse MWP Dataset), a diverse (in terms of both language patterns and problem types) English math word problem (MWP) corpus for evaluating the capability of various MWP solvers. Existing MWP corpora for…

Artificial Intelligence · Computer Science 2021-07-01 Shen-Yun Miao , Chao-Chun Liang , Keh-Yih Su