English
Related papers

Related papers: Multi-task Adversarial Attacks against Black-box M…

200 papers

We extend BeamAttack, an adversarial attack algorithm designed to evaluate the robustness of text classification systems through word-level modifications guided by beam search. Our extensions include support for word deletions and the…

Computation and Language · Computer Science 2025-07-04 Arnisa Fazla , Lucas Krauter , David Guzman Piedrahita , Andrianos Michail

Many machine learning algorithms are vulnerable to almost imperceptible perturbations of their inputs. So far it was unclear how much risk adversarial perturbations carry for the safety of real-world machine learning applications because…

Machine Learning · Statistics 2018-02-19 Wieland Brendel , Jonas Rauber , Matthias Bethge

Language Models today provide a high accuracy across a large number of downstream tasks. However, they remain susceptible to adversarial attacks, particularly against those where the adversarial examples maintain considerable similarity to…

Computation and Language · Computer Science 2023-07-25 Neel Bhandari , Pin-Yu Chen

As a general-purpose vision-language pretraining model, CLIP demonstrates strong generalization ability in image-text alignment tasks and has been widely adopted in downstream applications such as image classification and image-text…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Kuanrong Liu , Siyuan Liang , Cheng Qian , Ming Zhang , Xiaochun Cao

Neural networks are known to be vulnerable to carefully crafted adversarial examples, and these malicious samples often transfer, i.e., they maintain their effectiveness even against other models. With great efforts delved into the…

Machine Learning · Computer Science 2019-05-10 Yunhan Jia , Yantao Lu , Senem Velipasalar , Zhenyu Zhong , Tao Wei

The score-based query attacks (SQAs) pose practical threats to deep neural networks by crafting adversarial perturbations within dozens of queries, only using the model's output scores. Nonetheless, we note that if the loss trend of the…

Machine Learning · Computer Science 2022-12-19 Sizhe Chen , Zhehao Huang , Qinghua Tao , Yingwen Wu , Cihang Xie , Xiaolin Huang

Machine learning security has recently become a prominent topic in the natural language processing (NLP) area. The existing black-box adversarial attack suffers prohibitively from the high model querying complexity, resulting in easily…

Cryptography and Security · Computer Science 2023-10-17 Wenjie Lv , Zhen Wang , Yitao Zheng , Zhehua Zhong , Qi Xuan , Tianyi Chen

Fooling deep neural networks (DNNs) with the black-box optimization has become a popular adversarial attack fashion, as the structural prior knowledge of DNNs is always unknown. Nevertheless, recent black-box adversarial attacks may…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Jie Wang , Zhaoxia Yin , Jing Jiang , Yang Du

Textual backdoor attacks pose a practical threat to existing systems, as they can compromise the model by inserting imperceptible triggers into inputs and manipulating labels in the training dataset. With cutting-edge generative models such…

Cryptography and Security · Computer Science 2023-05-01 Jiazhao Li , Yijin Yang , Zhuofeng Wu , V. G. Vinod Vydiswaran , Chaowei Xiao

DeepFake face swapping presents a significant threat to online security and social media, which can replace the source face in an arbitrary photo/video with the target face of an entirely different person. In order to prevent this fraud,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Junhao Dong , Yuan Wang , Jianhuang Lai , Xiaohua Xie

Extreme Multilabel Text Classification (XMTC) is a text classification problem in which, (i) the output space is extremely large, (ii) each data point may have multiple positive labels, and (iii) the data follows a strongly imbalanced…

Machine Learning · Computer Science 2021-12-15 Mohammadreza Qaraei , Rohit Babbar

Despite significant improvements in natural language understanding models with the advent of models like BERT and XLNet, these neural-network based classifiers are vulnerable to blackbox adversarial attacks, where the attacker is only…

Machine Learning · Computer Science 2021-06-17 Jatin Chauhan , Karan Bhukar , Manohar Kaul

Adversarial attack has garnered considerable attention due to its profound implications for the secure deployment of robots in sensitive security scenarios. To potentially push for advances in the field, this paper studies the adversarial…

Cryptography and Security · Computer Science 2024-07-17 Mingyuan Fan , Yang Liu , Cen Chen , Ximeng Liu

We present Twin Answer Sentences Attack (TASA), an adversarial attack method for question answering (QA) models that produces fluent and grammatical adversarial contexts while maintaining gold answers. Despite phenomenal progress on general…

Computation and Language · Computer Science 2022-10-28 Yu Cao , Dianqi Li , Meng Fang , Tianyi Zhou , Jun Gao , Yibing Zhan , Dacheng Tao

Neural network models have shown their promising opportunities for multi-task learning, which focus on learning the shared layers to extract the common and task-invariant features. However, in most existing approaches, the extracted shared…

Computation and Language · Computer Science 2017-04-20 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

Transfer learning has become a common practice for training deep learning models with limited labeled data in a target domain. On the other hand, deep models are vulnerable to adversarial attacks. Though transfer learning has been widely…

Machine Learning · Computer Science 2020-08-26 Yinghua Zhang , Yangqiu Song , Jian Liang , Kun Bai , Qiang Yang

Adversarial attacks for discrete data (such as texts) have been proved significantly more challenging than continuous data (such as images) since it is difficult to generate adversarial samples with gradient-based methods. Current…

Computation and Language · Computer Science 2020-10-05 Linyang Li , Ruotian Ma , Qipeng Guo , Xiangyang Xue , Xipeng Qiu

Adversarial attacks expose vulnerabilities of deep learning models by introducing minor perturbations to the input, which lead to substantial alterations in the output. Our research focuses on the impact of such adversarial attacks on…

Computation and Language · Computer Science 2023-09-14 Pavel Burnyshev , Elizaveta Kostenok , Alexey Zaytsev

Text adversarial attack methods are typically designed for static scenarios with fixed numbers of output labels and a predefined label space, relying on extensive querying of the victim model (query-based attacks) or the surrogate model…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Wenqiang Wang , Siyuan Liang , Xiao Yan , Xiaochun Cao

We propose an intriguingly simple method for the construction of adversarial images in the black-box setting. In constrast to the white-box scenario, constructing black-box adversarial images has the additional constraint on query budget,…

Machine Learning · Computer Science 2019-08-16 Chuan Guo , Jacob R. Gardner , Yurong You , Andrew Gordon Wilson , Kilian Q. Weinberger