English
Related papers

Related papers: MWP-BERT: Numeracy-Augmented Pre-training for Math…

200 papers

The problem of designing NLP solvers for math word problems (MWP) has seen sustained research activity and steady gains in the test accuracy. Since existing solvers achieve high performance on the benchmark datasets for elementary level…

Computation and Language · Computer Science 2021-04-16 Arkil Patel , Satwik Bhattamishra , Navin Goyal

Math Word Problems (MWPs) in online assessments help test the ability of the learner to make critical inferences by interpreting the linguistic information in them. To test the mathematical reasoning capabilities of the learners, sometimes…

Information Retrieval · Computer Science 2023-07-06 Mayank Goel , Venktesh V , Vikram Goyal

Math word problem (MWP) is a challenging and critical task in natural language processing. Many recent studies formalize MWP as a generation task and have adopted sequence-to-sequence models to transform problem descriptions to mathematical…

Computation and Language · Computer Science 2021-09-08 Jianhao Shen , Yichun Yin , Lin Li , Lifeng Shang , Xin Jiang , Ming Zhang , Qun Liu

Automatically generating high-quality step-by-step solutions to math word problems has many applications in education. Recently, combining large language models (LLMs) with external tools to perform complex reasoning and calculation has…

Computation and Language · Computer Science 2023-04-19 Joy He-Yueya , Gabriel Poesia , Rose E. Wang , Noah D. Goodman

Though achieving impressive results on many NLP tasks, the BERT-like masked language models (MLM) encounter the discrepancy between pre-training and inference. In light of this gap, we investigate the contextual representation of…

Computation and Language · Computer Science 2022-05-16 Yu Lin , Zhecheng An , Peihao Wu , Zejun Ma

From the latter half of the last decade, there has been a growing interest in developing algorithms for automatically solving mathematical word problems (MWP). It is a challenging and unique task that demands blending surface level text…

Computation and Language · Computer Science 2022-06-01 Sowmya S Sundaram , Sairam Gurajada , Marco Fisichella , Deepak P , Savitha Sam Abraham

Large language models (LLMs) still grapple with complex tasks like mathematical reasoning. Despite significant efforts invested in improving prefix prompts or reasoning process, the crucial role of problem context might have been neglected.…

Computation and Language · Computer Science 2024-03-28 Haoran Liao , Jidong Tian , Shaohua Hu , Hao He , Yaohui Jin

Bidirectional Encoder Representations from Transformers (BERT) has shown marvelous improvements across various NLP tasks, and its consecutive variants have been proposed to further improve the performance of the pre-trained language models.…

Computation and Language · Computer Science 2021-11-29 Yiming Cui , Wanxiang Che , Ting Liu , Bing Qin , Ziqing Yang

Since the introduction of the original BERT (i.e., BASE BERT), researchers have developed various customized BERT models with improved performance for specific domains and tasks by exploiting the benefits of transfer learning. Due to the…

Computation and Language · Computer Science 2023-08-15 Jia Tracy Shen , Michiharu Yamashita , Ethan Prihar , Neil Heffernan , Xintao Wu , Ben Graff , Dongwon Lee

Large Language Models (LLMs) have been applied to Math Word Problems (MWPs) with transformative impacts, revolutionizing how these complex problems are approached and solved in various domains including educational settings. However, the…

Computation and Language · Computer Science 2024-06-18 Joykirat Singh , Akshay Nambi , Vibhav Vineet

Large language models (LLMs) are highly effective in various natural language processing (NLP) tasks. However, they are susceptible to producing unreliable conjectures in ambiguous contexts called hallucination. This paper presents a new…

Computation and Language · Computer Science 2024-03-07 Yuhong Sun , Zhangyue Yin , Qipeng Guo , Jiawen Wu , Xipeng Qiu , Hui Zhao

Solving mathematical word problems (MWPs) automatically is challenging, primarily due to the semantic gap between human-readable words and machine-understandable logics. Despite the long history dated back to the1960s, MWPs have regained…

Computation and Language · Computer Science 2019-04-30 Dongxiang Zhang , Lei Wang , Luming Zhang , Bing Tian Dai , Heng Tao Shen

Math word problem (MWP) serves as a fundamental research topic in artificial intelligence (AI) dating back to 1960s. This research aims to advance the reasoning abilities of AI by mirroring the human-like cognitive intelligence. The…

Artificial Intelligence · Computer Science 2025-10-28 Zhenya Huang , Jiayu Liu , Xin Lin , Zhiyuan Ma , Shangzi Xue , Tong Xiao , Qi Liu , Yee Whye Teh , Enhong Chen

Large-scale pre-trained models like BERT, have obtained a great success in various Natural Language Processing (NLP) tasks, while it is still a challenge to adapt them to the math-related tasks. Current pre-trained models neglect the…

Computation and Language · Computer Science 2021-05-04 Shuai Peng , Ke Yuan , Liangcai Gao , Zhi Tang

Developing automatic Math Word Problem (MWP) solvers has been an interest of NLP researchers since the 1960s. Over the last few years, there are a growing number of datasets and deep learning-based methods proposed for effectively solving…

Computation and Language · Computer Science 2021-09-21 Yihuai Lan , Lei Wang , Qiyuan Zhang , Yunshi Lan , Bing Tian Dai , Yan Wang , Dongxiang Zhang , Ee-Peng Lim

A math word problem (MWP) is a coherent narrative which reflects the underlying logic of math equations. Successful MWP generation can automate the writing of mathematics questions. Previous methods mainly generate MWP text based on…

Artificial Intelligence · Computer Science 2022-04-12 Tianyang Cao , Shuang Zeng , Xiaodan Xu , Mairgup Mansur , Baobao Chang

Solving math word problem (MWP) with AI techniques has recently made great progress with the success of deep neural networks (DNN), but it is far from being solved. We argue that the ability of learning by analogy is essential for an MWP…

Computation and Language · Computer Science 2023-06-16 Zihao Zhou , Maizhen Ning , Qiufeng Wang , Jie Yao , Wei Wang , Xiaowei Huang , Kaizhu Huang

Large language models (LLMs) have demonstrated strong performance on coding tasks such as generation, completion and repair, but their ability to handle complex symbolic reasoning over code still remains underexplored. We introduce the task…

Software Engineering · Computer Science 2025-09-17 Daniel Koh , Yannic Noller , Corina S. Pasareanu , Adrians Skapars , Youcheng Sun

We study the performance of a commercially available large language model (LLM) known as ChatGPT on math word problems (MWPs) from the dataset DRAW-1K. To our knowledge, this is the first independent evaluation of ChatGPT. We found that…

Computation and Language · Computer Science 2023-03-01 Paulo Shakarian , Abhinav Koyyalamudi , Noel Ngu , Lakshmivihari Mareedu

Mathematical reasoning serves as a crucial testbed for the intelligence of large language models (LLMs), and math word problems (MWPs) are a popular type of math problems. Most MWP datasets consist of problems containing only the necessary…

Computation and Language · Computer Science 2025-10-17 Kaiqi Yang , Hang Li , Yucheng Chu , Zitao Liu , Mi Tian , Hui Liu