English
Related papers

Related papers: MINIMAL: Mining Models for Data Free Universal Adv…

200 papers

In social media, neural network models have been applied to hate speech detection, sentiment analysis, etc., but neural network models are susceptible to adversarial attacks. For instance, in a text classification task, the attacker…

Computation and Language · Computer Science 2024-12-04 Xi Cao , Nuo Qun , Quzong Gesang , Yulei Zhu , Trashi Nyima

Machine learning systems based on deep neural networks, being able to produce state-of-the-art results on various perception tasks, have gained mainstream adoption in many applications. However, they are shown to be vulnerable to…

Machine Learning · Computer Science 2018-01-16 Bo Luo , Yannan Liu , Lingxiao Wei , Qiang Xu

Adversarial training is one of the best-performing methods in improving the robustness of deep language models. However, robust models come at the cost of high time consumption, as they require multi-step gradient ascents or word…

Computation and Language · Computer Science 2023-06-28 Songyang Gao , Shihan Dou , Yan Liu , Xiao Wang , Qi Zhang , Zhongyu Wei , Jin Ma , Ying Shan

Neural models of code have shown impressive results when performing tasks such as predicting method names and identifying certain kinds of bugs. We show that these models are vulnerable to adversarial examples, and introduce a novel…

Machine Learning · Computer Science 2020-10-14 Noam Yefet , Uri Alon , Eran Yahav

Neural networks (NN) classification models for Natural Language Processing (NLP) are vulnerable to the Universal Adversarial Triggers (UAT) attack that triggers a model to produce a specific prediction for any input. DARCY borrows the…

Computation and Language · Computer Science 2024-09-06 Zuquan Peng , Yuanyuan He , Jianbing Ni , Ben Niu

Generative models of language exhibit impressive capabilities but still place non-negligible probability mass over undesirable outputs. In this work, we address the task of updating a model to avoid unwanted outputs while minimally changing…

Computation and Language · Computer Science 2024-06-21 Lily H. Zhang , Rajesh Ranganath , Arya Tafvizi

Adversarial Missingness (AM) attacks aim to manipulate model fitting by carefully engineering a missing data problem to achieve a specific malicious objective. AM attacks are significantly different from prior data poisoning attacks in that…

Machine Learning · Computer Science 2025-11-18 Deniz Koyuncu , Alex Gittens , Bülent Yener , Moti Yung

We introduce a new large-scale NLI benchmark dataset, collected via an iterative, adversarial human-and-model-in-the-loop procedure. We show that training models on this new dataset leads to state-of-the-art performance on a variety of…

Computation and Language · Computer Science 2020-05-07 Yixin Nie , Adina Williams , Emily Dinan , Mohit Bansal , Jason Weston , Douwe Kiela

It is necessary to improve the performance of some special classes or to particularly protect them from attacks in adversarial learning. This paper proposes a framework combining cost-sensitive classification and adversarial learning…

Machine Learning · Computer Science 2022-06-24 Haojing Shen , Sihong Chen , Ran Wang , Xizhao Wang

Oracle-less machine learning (ML) attacks have broken various logic locking schemes. Regular synthesis, which is tailored for area-power-delay optimization, yields netlists where key-gate localities are vulnerable to learning. Thus, we call…

Cryptography and Security · Computer Science 2023-03-07 Animesh Basak Chowdhury , Lilas Alrahis , Luca Collini , Johann Knechtel , Ramesh Karri , Siddharth Garg , Ozgur Sinanoglu , Benjamin Tan

Adversarial training has emerged as an effective approach to train robust neural network models that are resistant to adversarial attacks, even in low-label regimes where labeled data is scarce. In this paper, we introduce a novel…

Machine Learning · Computer Science 2024-11-28 Tian Ye , Rajgopal Kannan , Viktor Prasanna

The textual adversarial attack refers to an attack method in which the attacker adds imperceptible perturbations to the original texts by elaborate design so that the NLP (natural language processing) model produces false judgments. This…

Computation and Language · Computer Science 2024-12-05 Xi Cao , Dolma Dawa , Nuo Qun , Trashi Nyima

Prompt-based learning is a new language model training paradigm that adapts the Pre-trained Language Models (PLMs) to downstream tasks, which revitalizes the performance benchmarks across various natural language processing (NLP) tasks.…

Computation and Language · Computer Science 2024-04-10 Yue Xu , Wenjie Wang

Generating adversarial examples for natural language is hard, as natural language consists of discrete symbols, and examples are often of variable lengths. In this paper, we propose a geometry-inspired attack for generating natural language…

Computation and Language · Computer Science 2020-10-06 Zhao Meng , Roger Wattenhofer

Deep Neural Networks (DNNs) are being used to solve a wide range of problems in many domains including safety-critical domains like self-driving cars and medical imagery. DNNs suffer from vulnerability against adversarial attacks. In the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Vipul Gupta , Apurva Narayan

The fine-tuning of pre-trained language models has a great success in many NLP fields. Yet, it is strikingly vulnerable to adversarial examples, e.g., word substitution attacks using only synonyms can easily fool a BERT-based sentiment…

Computation and Language · Computer Science 2021-12-23 Xinhsuai Dong , Luu Anh Tuan , Min Lin , Shuicheng Yan , Hanwang Zhang

Adversarial attacks against language models(LMs) are a significant concern. In particular, adversarial samples exploit the model's sensitivity to small input changes. While these changes appear insignificant on the semantics of the input…

Computation and Language · Computer Science 2024-02-06 Aly M. Kassem , Sherif Saad

Generating high-quality textual adversarial examples is critical for investigating the pitfalls of natural language processing (NLP) models and further promoting their robustness. Existing attacks are usually realized through word-level or…

Computation and Language · Computer Science 2022-05-25 Yibin Lei , Yu Cao , Dianqi Li , Tianyi Zhou , Meng Fang , Mykola Pechenizkiy

Adversarial sample attacks perturb benign inputs to induce DNN misbehaviors. Recent research has demonstrated the widespread presence and the devastating consequences of such attacks. Existing defense techniques either assume prior…

Machine Learning · Computer Science 2018-10-30 Guanhong Tao , Shiqing Ma , Yingqi Liu , Xiangyu Zhang

Neural networks are vulnerable to adversarially-constructed perturbations of their inputs. Most research so far has considered perturbations of a fixed magnitude under some $l_p$ norm. Although studying these attacks is valuable, there has…

Machine Learning · Computer Science 2019-10-02 Isaac Dunn , Hadrien Pouget , Tom Melham , Daniel Kroening