English
Related papers

Related papers: Multi-task Adversarial Attacks against Black-box M…

200 papers

Textual adversarial attacking has received wide and increasing attention in recent years. Various attack models have been proposed, which are enormously distinct and implemented with different programming frameworks and settings. These…

Computation and Language · Computer Science 2021-09-27 Guoyang Zeng , Fanchao Qi , Qianrui Zhou , Tingji Zhang , Zixian Ma , Bairu Hou , Yuan Zang , Zhiyuan Liu , Maosong Sun

Model inversion attacks (MIAs) seek to infer the private training data of a target classifier by generating synthetic images that reflect the characteristics of the target class through querying the model. However, prior studies have relied…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Xinhao Liu , Yingzhao Jiang , Zetao Lin

Adversarial black-box attacks aim to craft adversarial perturbations by querying input-output pairs of machine learning models. They are widely used to evaluate the robustness of pre-trained models. However, black-box attacks often suffer…

Machine Learning · Computer Science 2020-11-11 Lu Wang , Huan Zhang , Jinfeng Yi , Cho-Jui Hsieh , Yuan Jiang

Evaluating security and reliability for multi-agent systems (MAS) is urgent as they become increasingly prevalent in various applications. As an evaluation technique, existing adversarial attack frameworks face certain limitations, e.g.,…

Multiagent Systems · Computer Science 2026-04-29 Jianming Chen , Yawen Wang , Junjie Wang , Xiaofei Xie , Yuanzhe Hu , Qing Wang , Fanjiang Xu

The existence of adversarial attacks (or adversarial examples) brings huge concern about the machine learning (ML) model's safety issues. For many safety-critical ML tasks, such as financial forecasting, fraudulent detection, and anomaly…

Machine Learning · Computer Science 2022-10-19 Han Xu , Menghai Pan , Zhimeng Jiang , Huiyuan Chen , Xiaoting Li , Mahashweta Das , Hao Yang

There has been recently a growing interest in studying adversarial examples on natural language models in the black-box setting. These methods attack natural language classifiers by perturbing certain important words until the classifier…

Machine Learning · Computer Science 2021-05-04 Mahmoud Hossam , Trung Le , He Zhao , Viet Huynh , Dinh Phung

Adversarial text attack research plays a crucial role in evaluating the robustness of NLP models. However, the increasing complexity of transformer-based architectures has dramatically raised the computational cost of attack testing,…

Computation and Language · Computer Science 2025-09-26 Abhinay Shankar Belde , Rohit Ramkumar , Jonathan Rusert

We propose the first general-purpose gradient-based attack against transformer models. Instead of searching for a single adversarial example, we search for a distribution of adversarial examples parameterized by a continuous-valued matrix,…

Computation and Language · Computer Science 2021-04-29 Chuan Guo , Alexandre Sablayrolles , Hervé Jégou , Douwe Kiela

Backdoor attacks pose a serious threat to deep learning models by allowing adversaries to implant hidden behaviors that remain dormant on clean inputs but are maliciously triggered at inference. Existing backdoor attack methods typically…

Cryptography and Security · Computer Science 2025-11-18 Lijie Hu , Junchi Liao , Weimin Lyu , Shaopeng Fu , Tianhao Huang , Shu Yang , Guimin Hu , Di Wang

Transferable adversarial attack is always in the spotlight since deep learning models have been demonstrated to be vulnerable to adversarial samples. However, existing physical attack methods do not pay enough attention on transferability…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Yu Zhang , Zhiqiang Gong , Yichuang Zhang , YongQian Li , Kangcheng Bin , Jiahao Qi , Wei Xue , Ping Zhong

Deep learning is a powerful weapon to boost application performance in many fields, including face recognition, object detection, image classification, natural language understanding, and recommendation system. With the rapid increase in…

Software Engineering · Computer Science 2021-07-28 Hongchen Cao , Shuai Li , Yuming Zhou , Ming Fan , Xuejiao Zhao , Yutian Tang

Deep learning systems are known to be vulnerable to adversarial examples. In particular, query-based black-box attacks do not require knowledge of the deep learning model, but can compute adversarial examples over the network by submitting…

Cryptography and Security · Computer Science 2022-06-10 Huiying Li , Shawn Shan , Emily Wenger , Jiayun Zhang , Haitao Zheng , Ben Y. Zhao

Strong adversarial examples are crucial for evaluating and enhancing the robustness of deep neural networks. However, the performance of popular attacks is usually sensitive, for instance, to minor image transformations, stemming from…

Machine Learning · Computer Science 2024-04-01 Zhengwei Fang , Rui Wang , Tao Huang , Liping Jing

Existing black box search methods have achieved high success rate in generating adversarial attacks against NLP models. However, such search methods are inefficient as they do not consider the amount of queries required to generate…

Computation and Language · Computer Science 2021-09-13 Rishabh Maheshwary , Saket Maheshwary , Vikram Pudi

Despite the high quality performance of the deep neural network in real-world applications, they are susceptible to minor perturbations of adversarial attacks. This is mostly undetectable to human vision. The impact of such attacks has…

Computer Vision and Pattern Recognition · Computer Science 2021-01-18 K Naveen Kumar , C Vishnu , Reshmi Mitra , C Krishna Mohan

Neural networks are vulnerable to adversarial examples, malicious inputs crafted to fool trained models. Adversarial examples often exhibit black-box transfer, meaning that adversarial examples for one model can fool another model. However,…

Machine Learning · Computer Science 2020-03-02 Qian Huang , Isay Katsman , Horace He , Zeqi Gu , Serge Belongie , Ser-Nam Lim

Deep neural networks are widely known to be susceptible to adversarial examples, which can cause incorrect predictions through subtle input modifications. These adversarial examples tend to be transferable between models, but targeted…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Junyoung Byun , Myung-Joon Kwon , Seungju Cho , Yoonji Kim , Changick Kim

Recent studies have shown that Deep Leaning models are susceptible to adversarial examples, which are data, in general images, intentionally modified to fool a machine learning classifier. In this paper, we present a multi-objective nested…

Machine Learning · Computer Science 2026-02-24 A. E. Baia , G. Di Bari , V. Poggioni

Detection of adversarial examples has been a hot topic in the last years due to its importance for safely deploying machine learning algorithms in critical applications. However, the detection methods are generally validated by assuming a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Federica Granese , Marine Picot , Marco Romanelli , Francisco Messina , Pablo Piantanida

While neural machine translation (NMT) models achieve success in our daily lives, they show vulnerability to adversarial attacks. Despite being harmful, these attacks also offer benefits for interpreting and enhancing NMT models, thus…

Computation and Language · Computer Science 2024-09-10 Yanni Xue , Haojie Hao , Jiakai Wang , Qiang Sheng , Renshuai Tao , Yu Liang , Pu Feng , Xianglong Liu