中文
相关论文

相关论文: Exploiting Class Probabilities for Black-box Sente…

200 篇论文

There are two cases describing how a classifier processes input text, namely, misclassification and correct classification. In terms of misclassified texts, a classifier handles the texts with both incorrect predictions and adversarial…

计算与语言 · 计算机科学 2021-10-14 Hoang-Quoc Nguyen-Son , Seira Hidano , Kazuhide Fukushima , Shinsaku Kiyomoto

Deep learning models suffer from a phenomenon called adversarial attacks: we can apply minor changes to the model input to fool a classifier for a particular example. The literature mostly considers adversarial attacks on models with images…

机器学习 · 计算机科学 2020-10-13 Ivan Fursov , Alexey Zaytsev , Nikita Kluchnikov , Andrey Kravchenko , Evgeny Burnaev

Most adversarial attack methods that are designed to deceive a text classifier change the text classifier's prediction by modifying a few words or characters. Few try to attack classifiers by rewriting a whole sentence, due to the…

计算与语言 · 计算机科学 2022-10-21 Lei Xu , Ivan Ramirez , Kalyan Veeramachaneni

Existing black-box attacks on deep neural networks (DNNs) so far have largely focused on transferability, where an adversarial instance generated for a locally trained model can "transfer" to attack other learning models. In this paper, we…

机器学习 · 计算机科学 2017-12-29 Arjun Nitin Bhagoji , Warren He , Bo Li , Dawn Song

Numerous works study black-box attacks on image classifiers. However, these works make different assumptions on the adversary's knowledge and current literature lacks a cohesive organization centered around the threat model. To systematize…

密码学与安全 · 计算机科学 2024-02-15 Fnu Suya , Anshuman Suri , Tingwei Zhang , Jingtao Hong , Yuan Tian , David Evans

Machine Learning systems are vulnerable to adversarial attacks and will highly likely produce incorrect outputs under these attacks. There are white-box and black-box attacks regarding to adversary's access level to the victim learning…

机器学习 · 计算机科学 2019-10-23 Saeid Samizade , Zheng-Hua Tan , Chao Shen , Xiaohong Guan

Machine learning has been applied to a broad range of applications and some of them are available online as application programming interfaces (APIs) with either free (trial) or paid subscriptions. In this paper, we study adversarial…

机器学习 · 计算机科学 2018-11-06 Yi Shi , Yalin E. Sagduyu , Kemal Davaslioglu , Jason H. Li

Recently, with the advancement of deep learning, several applications in text classification have advanced significantly. However, this improvement comes with a cost because deep learning is vulnerable to adversarial examples. This weakness…

机器学习 · 计算机科学 2024-05-08 Korn Sooksatra , Bikram Khanal , Pablo Rivas

Deep learning models are vulnerable to adversarial examples, which can fool a target classifier by imposing imperceptible perturbations onto natural examples. In this work, we consider the practical and challenging decision-based black-box…

机器学习 · 计算机科学 2021-05-11 Qi-An Fu , Yinpeng Dong , Hang Su , Jun Zhu

Advances in Machine Learning (ML) have led to its adoption as an integral component in many applications, including banking, medical diagnosis, and driverless cars. To further broaden the use of ML models, cloud-based services offered by…

机器学习 · 计算机科学 2017-03-14 Hossein Hosseini , Yize Chen , Sreeram Kannan , Baosen Zhang , Radha Poovendran

Because state-of-the-art language models are expensive to train, most practitioners must make use of one of the few publicly available language models or language model APIs. This consolidation of trust increases the potency of backdoor…

密码学与安全 · 计算机科学 2023-07-28 Nikhil Kandpal , Matthew Jagielski , Florian Tramèr , Nicholas Carlini

We propose an efficient method to generate white-box adversarial examples to trick a character-level neural classifier. We find that only a few manipulations are needed to greatly decrease the accuracy. Our method relies on an atomic flip…

计算与语言 · 计算机科学 2018-05-25 Javid Ebrahimi , Anyi Rao , Daniel Lowd , Dejing Dou

Black-Box attacks on machine learning models occur when an attacker, despite having no access to the inner workings of a model, can successfully craft an attack by means of model theft. The attacker will train an own substitute model that…

机器学习 · 计算机科学 2017-11-16 Yannic Kilcher , Thomas Hofmann

Recently, generating adversarial examples has become an important means of measuring robustness of a deep learning model. Adversarial examples help us identify the susceptibilities of the model and further counter those vulnerabilities by…

机器学习 · 计算机科学 2021-03-03 Prashanth Vijayaraghavan , Deb Roy

Textual adversarial attacks expose the vulnerabilities of text classifiers and can be used to improve their robustness. Existing context-aware methods solely consider the gold label probability and use the greedy search when searching an…

计算与语言 · 计算机科学 2022-08-18 Huijun Liu , Jie Yu , Shasha Li , Jun Ma , Bin Ji

Finding attackable sentences in an argument is the first step toward successful refutation in argumentation. We present a first large-scale analysis of sentence attackability in online arguments. We analyze driving reasons for attacks in…

计算与语言 · 计算机科学 2020-10-07 Yohan Jo , Seojin Bang , Emaad Manzoor , Eduard Hovy , Chris Reed

Large language models play a crucial role in modern natural language processing technologies. However, their extensive use also introduces potential security risks, such as the possibility of black-box attacks. These attacks can embed…

计算与语言 · 计算机科学 2025-02-25 Daniil Khomsky , Narek Maloyan , Bulat Nutfullin

Adversarial black-box attacks aim to craft adversarial perturbations by querying input-output pairs of machine learning models. They are widely used to evaluate the robustness of pre-trained models. However, black-box attacks often suffer…

机器学习 · 计算机科学 2020-11-11 Lu Wang , Huan Zhang , Jinfeng Yi , Cho-Jui Hsieh , Yuan Jiang

Training robust deep learning models for down-stream tasks is a critical challenge. Research has shown that down-stream models can be easily fooled with adversarial inputs that look like the training data, but slightly perturbed, in a way…

机器学习 · 计算机科学 2021-01-19 Mahmoud Hossam , Trung Le , He Zhao , Dinh Phung

This work proposes a novel algorithm to generate natural language adversarial input for text classification models, in order to investigate the robustness of these models. It involves applying gradient-based perturbation on the sentence…

信息检索 · 计算机科学 2019-09-11 Yu-Lun Hsieh , Minhao Cheng , Da-Cheng Juan , Wei Wei , Wen-Lian Hsu , Cho-Jui Hsieh