中文
相关论文

相关论文: Counter-Samples: A Stateless Strategy to Neutraliz…

200 篇论文

Powerful adversarial attack methods are vital for understanding how to construct robust deep neural networks (DNNs) and for thoroughly testing defense techniques. In this paper, we propose a black-box adversarial attack algorithm that can…

机器学习 · 计算机科学 2019-12-11 Yandong Li , Lijun Li , Liqiang Wang , Tong Zhang , Boqing Gong

We study an important and challenging task of attacking natural language processing models in a hard label black box setting. We propose a decision-based attack strategy that crafts high quality adversarial examples on text classification…

计算与语言 · 计算机科学 2021-04-30 Rishabh Maheshwary , Saket Maheshwary , Vikram Pudi

Adversarial reprogramming allows stealing computational resources by repurposing machine learning models to perform a different task chosen by the attacker. For example, a model trained to recognize images of animals can be reprogrammed to…

计算机科学与博弈论 · 计算机科学 2022-11-08 Yang Zheng , Xiaoyi Feng , Zhaoqiang Xia , Xiaoyue Jiang , Maura Pintor , Ambra Demontis , Battista Biggio , Fabio Roli

Deep neural network (DNN) as a popular machine learning model is found to be vulnerable to adversarial attack. This attack constructs adversarial examples by adding small perturbations to the raw input, while appearing unmodified to human…

机器学习 · 计算机科学 2018-09-14 Pengcheng Li , Jinfeng Yi , Lijun Zhang

Black-box adversarial attacks have demonstrated strong potential to compromise machine learning models by iteratively querying the target model or leveraging transferability from a local surrogate model. Recently, such attacks can be…

机器学习 · 计算机科学 2024-09-09 Hanbin Hong , Xinyu Zhang , Binghui Wang , Zhongjie Ba , Yuan Hong

Many adversarial attack approaches are proposed to verify the vulnerability of language models. However, they require numerous queries and the information on the target model. Even black-box attack methods also require the target model's…

密码学与安全 · 计算机科学 2025-04-21 CheolWon Na , YunSeok Choi , Jee-Hyong Lee

Deep learning models are vulnerable to adversarial examples, which poses an indisputable threat to their applications. However, recent studies observe gradient-masking defenses are self-deceiving methods if an attacker can realize this…

机器学习 · 计算机科学 2019-02-19 Yueyao Yu , Pengfei Yu , Wenye Li

Adversarial transferability in black-box scenarios presents a unique challenge: while attackers can employ surrogate models to craft adversarial examples, they lack assurance on whether these examples will successfully compromise the target…

机器学习 · 计算机科学 2024-04-19 Mosh Levy , Guy Amit , Yuval Elovici , Yisroel Mirsky

Machine Learning systems are vulnerable to adversarial attacks and will highly likely produce incorrect outputs under these attacks. There are white-box and black-box attacks regarding to adversary's access level to the victim learning…

机器学习 · 计算机科学 2019-10-23 Saeid Samizade , Zheng-Hua Tan , Chao Shen , Xiaohong Guan

Note that this paper is superceded by "Black-Box Adversarial Attacks with Limited Queries and Information." Current neural network-based image classifiers are susceptible to adversarial examples, even in the black-box setting, where the…

计算机视觉与模式识别 · 计算机科学 2018-04-09 Andrew Ilyas , Logan Engstrom , Anish Athalye , Jessy Lin

Despite the impressive performances reported by deep neural networks in different application domains, they remain largely vulnerable to adversarial examples, i.e., input samples that are carefully perturbed to cause misclassification at…

计算机视觉与模式识别 · 计算机科学 2020-04-20 Angelo Sotgiu , Ambra Demontis , Marco Melis , Battista Biggio , Giorgio Fumera , Xiaoyi Feng , Fabio Roli

We present a method for adversarial input generation against black box models for reading comprehension based question answering. Our approach is composed of two steps. First, we approximate a victim black box model via model extraction…

机器学习 · 计算机科学 2020-11-03 Naveen Jafer Nizar , Ari Kobren

In this paper, we study the problem of how to defend classifiers against adversarial attacks that fool the classifiers using subtly modified input data. In contrast to previous works, here we focus on the white-box adversarial defense where…

机器学习 · 计算机科学 2019-09-16 Zudi Lin , Hanspeter Pfister , Ziming Zhang

Many machine learning models are vulnerable to adversarial examples: inputs that are specially crafted to cause a machine learning model to produce an incorrect output. Adversarial examples that affect one model often affect another model,…

密码学与安全 · 计算机科学 2016-05-25 Nicolas Papernot , Patrick McDaniel , Ian Goodfellow

Black-box adversarial attacks are widely used as tools to test the robustness of deep neural networks against malicious perturbations of input data aimed at a specific change in the output of the model. Such methods, although they remain…

机器学习 · 计算机科学 2026-03-13 Anna Chistyakova , Mikhail Pautov

Many defenses have recently been proposed at venues like NIPS, ICML, ICLR and CVPR. These defenses are mainly focused on mitigating white-box attacks. They do not properly examine black-box attacks. In this paper, we expand upon the…

机器学习 · 计算机科学 2021-11-03 Kaleel Mahmood , Deniz Gurevin , Marten van Dijk , Phuong Ha Nguyen

Adversarial examples pose a threat to deep neural network models in a variety of scenarios, from settings where the adversary has complete knowledge of the model in a "white box" setting and to the opposite in a "black box" setting. In this…

机器学习 · 计算机科学 2021-07-09 Daniel Park , Haidar Khan , Azer Khan , Alex Gittens , Bülent Yener

Adversarial examples pose a threat to deep neural network models in a variety of scenarios, from settings where the adversary has complete knowledge of the model and to the opposite "black box" setting. Black box attacks are particularly…

机器学习 · 计算机科学 2019-05-27 Haidar Khan , Daniel Park , Azer Khan , Bülent Yener

Deep learning systems are known to be vulnerable to adversarial examples. In particular, query-based black-box attacks do not require knowledge of the deep learning model, but can compute adversarial examples over the network by submitting…

密码学与安全 · 计算机科学 2022-06-10 Huiying Li , Shawn Shan , Emily Wenger , Jiayun Zhang , Haitao Zheng , Ben Y. Zhao

Adversarial examples threaten the integrity of machine learning systems with alarming success rates even under constrained black-box conditions. Stateful defenses have emerged as an effective countermeasure, detecting potential attacks by…

机器学习 · 计算机科学 2023-08-01 Ashish Hooda , Neal Mangaokar , Ryan Feng , Kassem Fawaz , Somesh Jha , Atul Prakash