中文
相关论文

相关论文: Gradient Aligned Attacks via a Few Queries

200 篇论文

Adversarial prompts generated using gradient-based methods exhibit outstanding performance in performing automatic jailbreak attacks against safety-aligned LLMs. Nevertheless, due to the discrete nature of texts, the input gradient of LLMs…

密码学与安全 · 计算机科学 2024-11-04 Qizhang Li , Yiwen Guo , Wangmeng Zuo , Hao Chen

Large language models (LLMs) increasingly employ guardrails to enforce ethical, legal, and application-specific constraints on their outputs. While effective at mitigating harmful responses, these guardrails introduce a new class of…

密码学与安全 · 计算机科学 2025-11-07 Hongwei Yao , Yun Xia , Shuo Shao , Haoran Shi , Tong Qiao , Cong Wang

Current Transferable Adversarial Examples (TAE) are primarily generated by adding Adversarial Noise (AN). Recent studies emphasize the importance of optimizing Data Augmentation (DA) parameters along with AN, which poses a greater threat to…

人工智能 · 计算机科学 2024-10-25 Yating Ma , Xiaogang Xu , Liming Fang , Zhe Liu

Deep neural networks for image classification remain vulnerable to adversarial examples -- small, imperceptible perturbations that induce misclassifications. In black-box settings, where only the final prediction is accessible, crafting…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Arjhun Swaminathan , Mete Akgün

Deep learning models have achieved state-of-the-art performances in various domains, while they are vulnerable to the inputs with well-crafted but small perturbations, which are named after adversarial examples (AEs). Among many strategies…

计算机视觉与模式识别 · 计算机科学 2023-10-11 Huihui Gong

The adversarial attack methods based on gradient information can adequately find the perturbations, that is, the combinations of rewired links, thereby reducing the effectiveness of the deep learning model based graph embedding algorithms,…

社会与信息网络 · 计算机科学 2020-12-22 Jinyin Chen , Yixian Chen , Haibin Zheng , Shijing Shen , Shanqing Yu , Dan Zhang , Qi Xuan

Deep neural networks (DNNs) are sensitive to adversarial data in a variety of scenarios, including the black-box scenario, where the attacker is only allowed to query the trained model and receive an output. Existing black-box methods for…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Raz Lapid , Zvika Haramaty , Moshe Sipper

Despite the great achievements of the modern deep neural networks (DNNs), the vulnerability/robustness of state-of-the-art DNNs raises security concerns in many application domains requiring high reliability. Various adversarial attacks are…

机器学习 · 计算机科学 2020-02-20 Pu Zhao , Pin-Yu Chen , Siyue Wang , Xue Lin

In physics and engineering, many processes are modeled using non-differentiable black-box simulators, making the optimization of such functions particularly challenging. To address such cases, inspired by the Gradient Theorem, we propose…

Recent studies have shown that graph neural networks (GNNs) are vulnerable against perturbations due to lack of robustness and can therefore be easily fooled. Currently, most works on attacking GNNs are mainly using gradient information to…

机器学习 · 计算机科学 2021-05-07 Jintang Li , Tao Xie , Liang Chen , Fenfang Xie , Xiangnan He , Zibin Zheng

We study the most practical problem setup for evaluating adversarial robustness of a machine learning system with limited access: the hard-label black-box attack setting for generating adversarial examples, where limited model queries are…

机器学习 · 计算机科学 2020-02-17 Minhao Cheng , Simranjit Singh , Patrick Chen , Pin-Yu Chen , Sijia Liu , Cho-Jui Hsieh

We focus on the problem of adversarial attacks against models on discrete sequential data in the black-box setting where the attacker aims to craft adversarial examples with limited query access to the victim model. Existing black-box…

机器学习 · 计算机科学 2022-06-20 Deokjae Lee , Seungyong Moon , Junhyeok Lee , Hyun Oh Song

We study the problem of attacking a machine learning model in the hard-label black-box setting, where no model information is revealed except that the attacker can make queries to probe the corresponding hard-label decisions. This is a very…

机器学习 · 计算机科学 2018-07-13 Minhao Cheng , Thong Le , Pin-Yu Chen , Jinfeng Yi , Huan Zhang , Cho-Jui Hsieh

Adversarial examples have revealed the vulnerability of deep learning models and raised serious concerns about information security. The transfer-based attack is a hot topic in black-box attacks that are practical to real-world scenarios…

计算机视觉与模式识别 · 计算机科学 2025-05-07 Jian-Wei Li , Wen-Ze Shao

Model inversion attacks involve reconstructing the training data of a target model, which raises serious privacy concerns for machine learning models. However, these attacks, especially learning-based methods, are likely to suffer from low…

密码学与安全 · 计算机科学 2023-06-27 Shuai Zhou , Tianqing Zhu , Dayong Ye , Xin Yu , Wanlei Zhou

Adversarial robustness of deep autoencoders (AEs) has received less attention than that of discriminative models, although their compressed latent representations induce ill-conditioned mappings that can amplify small input perturbations…

机器学习 · 计算机科学 2026-02-24 Chethan Krishnamurthy Ramanaik , Arjun Roy , Tobias Callies , Eirini Ntoutsi

Deep learning has made significant breakthroughs in many fields, including electroencephalogram (EEG) based brain-computer interfaces (BCIs). However, deep learning models are vulnerable to adversarial attacks, in which deliberately…

机器学习 · 计算机科学 2019-11-12 Xue Jiang , Xiao Zhang , Dongrui Wu

Note that this paper is superceded by "Black-Box Adversarial Attacks with Limited Queries and Information." Current neural network-based image classifiers are susceptible to adversarial examples, even in the black-box setting, where the…

计算机视觉与模式识别 · 计算机科学 2018-04-09 Andrew Ilyas , Logan Engstrom , Anish Athalye , Jessy Lin

In generating adversarial examples, the conventional black-box attack methods rely on sufficient feedback from the to-be-attacked models by repeatedly querying until the attack is successful, which usually results in thousands of trials…

计算机视觉与模式识别 · 计算机科学 2023-12-13 Renyang Liu , Wei Zhou , Xin Jin , Song Gao , Yuanyu Wang , Ruxin Wang

Deep neural networks are vulnerable to adversarial examples that exhibit transferability across various models. Numerous approaches are proposed to enhance the transferability of adversarial examples, including advanced optimization, data…

计算机视觉与模式识别 · 计算机科学 2025-10-27 Zhaoyu Chen , Haijing Guo , Kaixun Jiang , Jiyuan Fu , Xinyu Zhou , Dingkang Yang , Hao Tang , Bo Li , Wenqiang Zhang