English
Related papers

Related papers: Adversarial Examples for Evaluating Math Word Prob…

200 papers

Adversarial examples, generated by applying small perturbations to input features, are widely used to fool classifiers and measure their robustness to noisy inputs. However, little work has been done to evaluate the robustness of ranking…

Information Retrieval · Computer Science 2020-08-06 Nisarg Raval , Manisha Verma

Developing automatic Math Word Problem (MWP) solvers has been an interest of NLP researchers since the 1960s. Over the last few years, there are a growing number of datasets and deep learning-based methods proposed for effectively solving…

Computation and Language · Computer Science 2021-09-21 Yihuai Lan , Lei Wang , Qiyuan Zhang , Yunshi Lan , Bing Tian Dai , Yan Wang , Dongxiang Zhang , Ee-Peng Lim

Research shows that natural language processing models are generally considered to be vulnerable to adversarial attacks; but recent work has drawn attention to the issue of validating these adversarial inputs against certain criteria (e.g.,…

Computation and Language · Computer Science 2021-09-10 Maximilian Mozes , Max Bartolo , Pontus Stenetorp , Bennett Kleinberg , Lewis D. Griffin

This paper introduces a novel adversarial attack method targeting text classification models, termed the Modified Word Saliency-based Adversarial At-tack (MWSAA). The technique builds upon the concept of word saliency to strategically…

Computation and Language · Computer Science 2025-05-13 Hetvi Waghela , Sneha Rakshit , Jaydip Sen

Language Models today provide a high accuracy across a large number of downstream tasks. However, they remain susceptible to adversarial attacks, particularly against those where the adversarial examples maintain considerable similarity to…

Computation and Language · Computer Science 2023-07-25 Neel Bhandari , Pin-Yu Chen

Transfer learning from pretrained language models recently became the dominant approach for solving many NLP tasks. A common approach to transfer learning for multiple tasks that maximize parameter sharing trains one or more task-specific…

Computation and Language · Computer Science 2021-06-03 Karen Hambardzumyan , Hrant Khachatrian , Jonathan May

Math word problems (MWPs) require analyzing text descriptions and generating mathematical equations to derive solutions. Existing works focus on solving MWPs with two types of solvers: tree-based solver and large language model (LLM)…

Computation and Language · Computer Science 2023-08-29 Jie Yao , Zihao Zhou , Qiufeng Wang

Adversarial examples are helpful for analyzing and improving the robustness of text classifiers. Generating high-quality adversarial examples is a challenging task as it requires generating fluent adversarial sentences that are semantically…

Computation and Language · Computer Science 2022-10-21 Lei Xu , Alfredo Cuesta-Infante , Laure Berti-Equille , Kalyan Veeramachaneni

Deep neural networks have been proven to be vulnerable to adversarial examples and various methods have been proposed to defend against adversarial attacks for natural language processing tasks. However, previous defense methods have…

Machine Learning · Computer Science 2024-03-01 Fangyuan Zhang , Huichi Zhou , Shuangjiao Li , Hongtao Wang

Deep learning-based natural language processing (NLP) models, particularly pre-trained language models (PLMs), have been revealed to be vulnerable to adversarial attacks. However, the adversarial examples generated by many mainstream…

Computation and Language · Computer Science 2023-11-21 Zimu Wang , Wei Wang , Qi Chen , Qiufeng Wang , Anh Nguyen

Adversarial examples in NLP are receiving increasing research attention. One line of investigation is the generation of word-level adversarial examples against fine-tuned Transformer models that preserve naturalness and grammaticality.…

Computation and Language · Computer Science 2022-10-24 Maximilian Mozes , Bennett Kleinberg , Lewis D. Griffin

Recent studies have shown that deep neural networks are vulnerable to intentionally crafted adversarial examples, and various methods have been proposed to defend against adversarial word-substitution attacks for neural NLP models. However,…

Computation and Language · Computer Science 2021-10-07 Zongyi Li , Jianhan Xu , Jiehang Zeng , Linyang Li , Xiaoqing Zheng , Qi Zhang , Kai-Wei Chang , Cho-Jui Hsieh

Wake-up word detection models are widely used in real life, but suffer from severe performance degradation when encountering adversarial samples. In this paper we discuss the concept of confusing words in adversarial samples. Confusing…

Sound · Computer Science 2022-01-04 Haoxu Wang , Yan Jia , Zeqing Zhao , Xuyang Wang , Junjie Wang , Ming Li

Solving mathematical word problems (MWPs) automatically is challenging, primarily due to the semantic gap between human-readable words and machine-understandable logics. Despite the long history dated back to the1960s, MWPs have regained…

Computation and Language · Computer Science 2019-04-30 Dongxiang Zhang , Lei Wang , Luming Zhang , Bing Tian Dai , Heng Tao Shen

An adversarial example is an input transformed by small perturbations that machine learning models consistently misclassify. While there are a number of methods proposed to generate adversarial examples for text data, it is not trivial to…

Computation and Language · Computer Science 2020-06-02 Ying Xu , Xu Zhong , Antonio Jose Jimeno Yepes , Jey Han Lau

In this paper, we propose an optimization-based adversarial attack against Neural Machine Translation (NMT) models. First, we propose an optimization problem to generate adversarial examples that are semantically similar to the original…

Computation and Language · Computer Science 2023-06-16 Sahar Sadrizadeh , Clément Barbier , Ljiljana Dolamic , Pascal Frossard

Neural machine translation systems tend to fail on less decent inputs despite its significant efficacy, which may significantly harm the credibility of this systems-fathoming how and when neural-based systems fail in such cases is critical…

Computation and Language · Computer Science 2020-05-27 Wei Zou , Shujian Huang , Jun Xie , Xinyu Dai , Jiajun Chen

We propose algorithms to create adversarial attacks to assess model robustness in text classification problems. They can be used to create white box attacks and black box attacks while at the same time preserving the semantics and syntax of…

Computation and Language · Computer Science 2020-08-17 Rahul Singh , Tarun Joshi , Vijayan N. Nair , Agus Sudjianto

Math Word Problems (MWP) is an important task that requires the ability of understanding and reasoning over mathematical text. Existing approaches mostly formalize it as a generation task by adopting Seq2Seq or Seq2Tree models to encode an…

Computation and Language · Computer Science 2022-05-18 Ailisi Li , Xueyao Jiang , Bang Liu , Jiaqing Liang , Yanghua Xiao

From the latter half of the last decade, there has been a growing interest in developing algorithms for automatically solving mathematical word problems (MWP). It is a challenging and unique task that demands blending surface level text…

Computation and Language · Computer Science 2022-06-01 Sowmya S Sundaram , Sairam Gurajada , Marco Fisichella , Deepak P , Savitha Sam Abraham