English
Related papers

Related papers: Exploiting Class Probabilities for Black-box Sente…

200 papers

There are two cases describing how a classifier processes input text, namely, misclassification and correct classification. In terms of misclassified texts, a classifier handles the texts with both incorrect predictions and adversarial…

Computation and Language · Computer Science 2021-10-14 Hoang-Quoc Nguyen-Son , Seira Hidano , Kazuhide Fukushima , Shinsaku Kiyomoto

Deep learning models suffer from a phenomenon called adversarial attacks: we can apply minor changes to the model input to fool a classifier for a particular example. The literature mostly considers adversarial attacks on models with images…

Machine Learning · Computer Science 2020-10-13 Ivan Fursov , Alexey Zaytsev , Nikita Kluchnikov , Andrey Kravchenko , Evgeny Burnaev

Most adversarial attack methods that are designed to deceive a text classifier change the text classifier's prediction by modifying a few words or characters. Few try to attack classifiers by rewriting a whole sentence, due to the…

Computation and Language · Computer Science 2022-10-21 Lei Xu , Ivan Ramirez , Kalyan Veeramachaneni

Existing black-box attacks on deep neural networks (DNNs) so far have largely focused on transferability, where an adversarial instance generated for a locally trained model can "transfer" to attack other learning models. In this paper, we…

Machine Learning · Computer Science 2017-12-29 Arjun Nitin Bhagoji , Warren He , Bo Li , Dawn Song

Numerous works study black-box attacks on image classifiers. However, these works make different assumptions on the adversary's knowledge and current literature lacks a cohesive organization centered around the threat model. To systematize…

Cryptography and Security · Computer Science 2024-02-15 Fnu Suya , Anshuman Suri , Tingwei Zhang , Jingtao Hong , Yuan Tian , David Evans

Machine Learning systems are vulnerable to adversarial attacks and will highly likely produce incorrect outputs under these attacks. There are white-box and black-box attacks regarding to adversary's access level to the victim learning…

Machine Learning · Computer Science 2019-10-23 Saeid Samizade , Zheng-Hua Tan , Chao Shen , Xiaohong Guan

Machine learning has been applied to a broad range of applications and some of them are available online as application programming interfaces (APIs) with either free (trial) or paid subscriptions. In this paper, we study adversarial…

Machine Learning · Computer Science 2018-11-06 Yi Shi , Yalin E. Sagduyu , Kemal Davaslioglu , Jason H. Li

Recently, with the advancement of deep learning, several applications in text classification have advanced significantly. However, this improvement comes with a cost because deep learning is vulnerable to adversarial examples. This weakness…

Machine Learning · Computer Science 2024-05-08 Korn Sooksatra , Bikram Khanal , Pablo Rivas

Deep learning models are vulnerable to adversarial examples, which can fool a target classifier by imposing imperceptible perturbations onto natural examples. In this work, we consider the practical and challenging decision-based black-box…

Machine Learning · Computer Science 2021-05-11 Qi-An Fu , Yinpeng Dong , Hang Su , Jun Zhu

Advances in Machine Learning (ML) have led to its adoption as an integral component in many applications, including banking, medical diagnosis, and driverless cars. To further broaden the use of ML models, cloud-based services offered by…

Machine Learning · Computer Science 2017-03-14 Hossein Hosseini , Yize Chen , Sreeram Kannan , Baosen Zhang , Radha Poovendran

Because state-of-the-art language models are expensive to train, most practitioners must make use of one of the few publicly available language models or language model APIs. This consolidation of trust increases the potency of backdoor…

Cryptography and Security · Computer Science 2023-07-28 Nikhil Kandpal , Matthew Jagielski , Florian Tramèr , Nicholas Carlini

We propose an efficient method to generate white-box adversarial examples to trick a character-level neural classifier. We find that only a few manipulations are needed to greatly decrease the accuracy. Our method relies on an atomic flip…

Computation and Language · Computer Science 2018-05-25 Javid Ebrahimi , Anyi Rao , Daniel Lowd , Dejing Dou

Black-Box attacks on machine learning models occur when an attacker, despite having no access to the inner workings of a model, can successfully craft an attack by means of model theft. The attacker will train an own substitute model that…

Machine Learning · Computer Science 2017-11-16 Yannic Kilcher , Thomas Hofmann

Recently, generating adversarial examples has become an important means of measuring robustness of a deep learning model. Adversarial examples help us identify the susceptibilities of the model and further counter those vulnerabilities by…

Machine Learning · Computer Science 2021-03-03 Prashanth Vijayaraghavan , Deb Roy

Textual adversarial attacks expose the vulnerabilities of text classifiers and can be used to improve their robustness. Existing context-aware methods solely consider the gold label probability and use the greedy search when searching an…

Computation and Language · Computer Science 2022-08-18 Huijun Liu , Jie Yu , Shasha Li , Jun Ma , Bin Ji

Finding attackable sentences in an argument is the first step toward successful refutation in argumentation. We present a first large-scale analysis of sentence attackability in online arguments. We analyze driving reasons for attacks in…

Computation and Language · Computer Science 2020-10-07 Yohan Jo , Seojin Bang , Emaad Manzoor , Eduard Hovy , Chris Reed

Large language models play a crucial role in modern natural language processing technologies. However, their extensive use also introduces potential security risks, such as the possibility of black-box attacks. These attacks can embed…

Computation and Language · Computer Science 2025-02-25 Daniil Khomsky , Narek Maloyan , Bulat Nutfullin

Adversarial black-box attacks aim to craft adversarial perturbations by querying input-output pairs of machine learning models. They are widely used to evaluate the robustness of pre-trained models. However, black-box attacks often suffer…

Machine Learning · Computer Science 2020-11-11 Lu Wang , Huan Zhang , Jinfeng Yi , Cho-Jui Hsieh , Yuan Jiang

Training robust deep learning models for down-stream tasks is a critical challenge. Research has shown that down-stream models can be easily fooled with adversarial inputs that look like the training data, but slightly perturbed, in a way…

Machine Learning · Computer Science 2021-01-19 Mahmoud Hossam , Trung Le , He Zhao , Dinh Phung

This work proposes a novel algorithm to generate natural language adversarial input for text classification models, in order to investigate the robustness of these models. It involves applying gradient-based perturbation on the sentence…

Information Retrieval · Computer Science 2019-09-11 Yu-Lun Hsieh , Minhao Cheng , Da-Cheng Juan , Wei Wei , Wen-Lian Hsu , Cho-Jui Hsieh