English
Related papers

Related papers: Spanning Attack: Reinforce Black-box Attacks with …

200 papers

Black-box textual adversarial attacks are challenging due to the lack of model information and the discrete, non-differentiable nature of text. Existing methods often lack versatility for attacking different models, suffer from limited…

Computation and Language · Computer Science 2025-01-22 Mingze Ni , Yongshun Gong , Wei Liu

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

Deep models have shown their vulnerability when processing adversarial samples. As for the black-box attack, without access to the architecture and weights of the attacked model, training a substitute model for adversarial attacks has…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Wenxuan Wang , Bangjie Yin , Taiping Yao , Li Zhang , Yanwei Fu , Shouhong Ding , Jilin Li , Feiyue Huang , Xiangyang Xue

Membership inference attacks are designed to determine, using black box access to trained models, whether a particular example was used in training or not. Membership inference can be formalized as a hypothesis testing problem. The most…

Machine Learning · Computer Science 2023-07-10 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu

Adversarial attacks perturb images such that a deep neural network produces incorrect classification results. A promising approach to defend against adversarial attacks on natural multi-object scenes is to impose a context-consistency…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Zikui Cai , Shantanu Rane , Alejandro E. Brito , Chengyu Song , Srikanth V. Krishnamurthy , Amit K. Roy-Chowdhury , M. Salman Asif

The vulnerability of the high-performance machine learning models implies a security risk in applications with real-world consequences. Research on adversarial attacks is beneficial in guiding the development of machine learning models on…

Machine Learning · Computer Science 2022-11-16 Yiran Huang , Yexu Zhou , Michael Hefenbrock , Till Riedel , Likun Fang , Michael Beigl

Depending on how much information an adversary can access to, adversarial attacks can be classified as white-box attack and black-box attack. For white-box attack, optimization-based attack algorithms such as projected gradient descent…

Machine Learning · Computer Science 2019-09-17 Jinghui Chen , Dongruo Zhou , Jinfeng Yi , Quanquan Gu

Adversarial attacks pose significant challenges for detecting adversarial attacks at an early stage. We propose attack-agnostic detection on reinforcement learning-based interactive recommendation systems. We first craft adversarial…

Machine Learning · Computer Science 2020-06-16 Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Wei Emma Zhang

Adversarial examples are perturbed inputs designed to fool machine learning models. Adversarial training injects such examples into training data to increase robustness. To scale this technique to large datasets, perturbations are crafted…

Machine Learning · Statistics 2020-04-28 Florian Tramèr , Alexey Kurakin , Nicolas Papernot , Ian Goodfellow , Dan Boneh , Patrick McDaniel

Existing adversarial learning approaches mostly use class labels to generate adversarial samples that lead to incorrect predictions, which are then used to augment the training of the model for improved robustness. While some recent works…

Machine Learning · Computer Science 2020-10-27 Minseon Kim , Jihoon Tack , Sung Ju Hwang

Deep neural network (DNN) as a popular machine learning model is found to be vulnerable to adversarial attack. This attack constructs adversarial examples by adding small perturbations to the raw input, while appearing unmodified to human…

Machine Learning · Computer Science 2018-09-14 Pengcheng Li , Jinfeng Yi , Lijun Zhang

Adversarial attacks introduce small, deliberately crafted perturbations that mislead neural networks, and their transferability from white-box to black-box target models remains a critical research focus. Input transformation-based attacks…

Machine Learning · Computer Science 2025-11-25 Quan Liu , Feng Ye , Chenhao Lu , Shuming Zhen , Guanliang Huang , Lunzhe Chen , Xudong Ke

Neural networks have been proven to be vulnerable to a variety of adversarial attacks. From a safety perspective, highly sparse adversarial attacks are particularly dangerous. On the other hand the pixelwise perturbations of sparse attacks…

Machine Learning · Computer Science 2019-09-12 Francesco Croce , Matthias Hein

Deep neural networks and other machine learning systems, despite being extremely powerful and able to make predictions with high accuracy, are vulnerable to adversarial attacks. We proposed the DeltaBound attack: a novel, powerful attack in…

Machine Learning · Computer Science 2022-10-04 Lorenzo Rossi

Growing at a fast pace, modern autonomous systems will soon be deployed at scale, opening up the possibility for cooperative multi-agent systems. Sharing information and distributing workloads allow autonomous agents to better perform tasks…

Machine Learning · Computer Science 2021-10-13 James Tu , Tsunhsuan Wang , Jingkang Wang , Sivabalan Manivasagam , Mengye Ren , Raquel Urtasun

We introduce a feature scattering-based adversarial training approach for improving model robustness against adversarial attacks. Conventional adversarial training approaches leverage a supervised scheme (either targeted or non-targeted) in…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Haichao Zhang , Jianyu Wang

Deep neural networks are vulnerable to adversarial examples, which poses security concerns on these algorithms due to the potentially severe consequences. Adversarial attacks serve as an important surrogate to evaluate the robustness of…

Machine Learning · Computer Science 2018-03-23 Yinpeng Dong , Fangzhou Liao , Tianyu Pang , Hang Su , Jun Zhu , Xiaolin Hu , Jianguo Li

Adversarial attacks on deep neural networks traditionally rely on a constrained optimization paradigm, where an optimization procedure is used to obtain a single adversarial perturbation for a given input example. In this work we frame the…

Machine Learning · Computer Science 2020-01-22 Avishek Joey Bose , Andre Cianflone , William L. Hamilton

Solving for adversarial examples with projected gradient descent has been demonstrated to be highly effective in fooling the neural network based classifiers. However, in the black-box setting, the attacker is limited only to the query…

Machine Learning · Computer Science 2022-10-19 Seungyong Moon , Gaon An , Hyun Oh Song

Clean-label (CL) attack is a form of data poisoning attack where an adversary modifies only the textual input of the training data, without requiring access to the labeling function. CL attacks are relatively unexplored in NLP, as compared…

Computation and Language · Computer Science 2023-06-01 Ashim Gupta , Amrith Krishna