English
Related papers

Related papers: Cross-Entropy Attacks to Language Models via Rare …

200 papers

Even though the large-scale language models have achieved excellent performances, they suffer from various adversarial attacks. A large body of defense methods has been proposed. However, they are still limited due to redundant attack…

Computation and Language · Computer Science 2022-10-19 Lan Jiang , Hao Zhou , Yankai Lin , Peng Li , Jie Zhou , Rui Jiang

Adversarial robustness has emerged as an important topic in deep learning as carefully crafted attack samples can significantly disturb the performance of a model. Many recent methods have proposed to improve adversarial robustness by…

Machine Learning · Computer Science 2019-08-08 Hao-Yun Chen , Jhao-Hong Liang , Shih-Chieh Chang , Jia-Yu Pan , Yu-Ting Chen , Wei Wei , Da-Cheng Juan

Scalability issue plays a crucial role in productionizing modern recommender systems. Even lightweight architectures may suffer from high computational overload due to intermediate calculations, limiting their practicality in real-world…

Information Retrieval · Computer Science 2024-12-03 Gleb Mezentsev , Danil Gusak , Ivan Oseledets , Evgeny Frolov

Deep neural networks are vulnerable to adversarial examples, which can mislead classifiers by adding imperceptible perturbations. An intriguing property of adversarial examples is their good transferability, making black-box attacks…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Yinpeng Dong , Tianyu Pang , Hang Su , Jun Zhu

There has been recently a growing interest in studying adversarial examples on natural language models in the black-box setting. These methods attack natural language classifiers by perturbing certain important words until the classifier…

Machine Learning · Computer Science 2021-05-04 Mahmoud Hossam , Trung Le , He Zhao , Viet Huynh , Dinh Phung

Recently, with the advancement of deep learning, several applications in text classification have advanced significantly. However, this improvement comes with a cost because deep learning is vulnerable to adversarial examples. This weakness…

Machine Learning · Computer Science 2024-05-08 Korn Sooksatra , Bikram Khanal , Pablo Rivas

Existing black-box attacks have demonstrated promising potential in creating adversarial examples (AE) to deceive deep learning models. Most of these attacks need to handle a vast optimization space and require a large number of queries,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Renyang Liu , Wei Zhou , Tianwei Zhang , Kangjie Chen , Jun Zhao , Kwok-Yan Lam

In the context of adversarial robustness, a single model does not usually have enough power to defend against all possible adversarial attacks, and as a result, has sub-optimal robustness. Consequently, an emerging line of work has focused…

Machine Learning · Computer Science 2022-06-08 Dinghuai Zhang , Hongyang Zhang , Aaron Courville , Yoshua Bengio , Pradeep Ravikumar , Arun Sai Suggala

Pre-trained vision-language models (VLMs) have showcased remarkable performance in image and natural language understanding, such as image captioning and response generation. As the practical applications of vision-language models become…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Peng Xie , Yequan Bie , Jianda Mao , Yangqiu Song , Yang Wang , Hao Chen , Kani Chen

Sentence-level attacks craft adversarial sentences that are synonymous with correctly-classified sentences but are misclassified by the text classifiers. Under the black-box setting, classifiers are only accessible through their feedback to…

Computation and Language · Computer Science 2024-02-22 Raha Moraffah , Huan Liu

Note that this paper is superceded by "Black-Box Adversarial Attacks with Limited Queries and Information." Current neural network-based image classifiers are susceptible to adversarial examples, even in the black-box setting, where the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-09 Andrew Ilyas , Logan Engstrom , Anish Athalye , Jessy Lin

We propose a novel genetic-algorithm technique that generates black-box adversarial examples which successfully fool neural network based text classifiers. We perform a genetic search with multi-objective optimization guided by deep…

Artificial Intelligence · Computer Science 2020-11-11 Alex Mathai , Shreya Khare , Srikanth Tamilselvam , Senthil Mani

Black-box adversarial attack has attracted a lot of research interests for its practical use in AI safety. Compared with the white-box attack, a black-box setting is more difficult for less available information related to the attacked…

Machine Learning · Computer Science 2020-09-02 Linjun Zhou , Peng Cui , Yinan Jiang , Shiqiang Yang

Deep learning models are vulnerable to adversarial examples, which can fool a target classifier by imposing imperceptible perturbations onto natural examples. In this work, we consider the practical and challenging decision-based black-box…

Machine Learning · Computer Science 2021-05-11 Qi-An Fu , Yinpeng Dong , Hang Su , Jun Zhu

We design blackbox transfer-based targeted adversarial attacks for an environment where the attacker's source model and the target blackbox model may have disjoint label spaces and training datasets. This scenario significantly differs from…

Machine Learning · Computer Science 2021-03-19 Nathan Inkawhich , Kevin J Liang , Jingyang Zhang , Huanrui Yang , Hai Li , Yiran Chen

In cross-lingual text classification, one seeks to exploit labeled data from one language to train a text classification model that can then be applied to a completely different language. Recent multilingual representation models have made…

Computation and Language · Computer Science 2020-07-31 Xin Dong , Yaxin Zhu , Yupeng Zhang , Zuohui Fu , Dongkuan Xu , Sen Yang , Gerard de Melo

We present a new method for black-box adversarial attack. Unlike previous methods that combined transfer-based and scored-based methods by using the gradient or initialization of a surrogate white-box model, this new method tries to learn a…

Machine Learning · Computer Science 2020-01-07 Zhichao Huang , Tong Zhang

Existing textual adversarial attacks usually utilize the gradient or prediction confidence to generate adversarial examples, making it hard to be deployed in real-world applications. To this end, we consider a rarely investigated but more…

Computation and Language · Computer Science 2022-10-25 Zhen Yu , Xiaosen Wang , Wanxiang Che , Kun He

Deep learning has made significant breakthroughs in many fields, including electroencephalogram (EEG) based brain-computer interfaces (BCIs). However, deep learning models are vulnerable to adversarial attacks, in which deliberately…

Machine Learning · Computer Science 2019-11-12 Xue Jiang , Xiao Zhang , Dongrui Wu

Large Language Models (LLMs) exhibit impressive capabilities, but remain susceptible to a growing spectrum of safety risks, including jailbreaks, toxic content, hallucinations, and bias. Existing defenses often address only a single threat…

Computation and Language · Computer Science 2025-11-18 Md Rafi Ur Rashid , Vishnu Asutosh Dasu , Ye Wang , Gang Tan , Shagufta Mehnaz