English
Related papers

Related papers: HQA-Attack: Toward High Quality Black-Box Hard-Lab…

200 papers

Clean-label (CL) attack is a form of data poisoning attack where an adversary modifies only the textual input of the training data, without requiring access to the labeling function. CL attacks are relatively unexplored in NLP, as compared…

Computation and Language · Computer Science 2023-06-01 Ashim Gupta , Amrith Krishna

Despite their promising performance across various natural language processing (NLP) tasks, current NLP systems are vulnerable to textual adversarial attacks. To defend against these attacks, most existing methods apply adversarial training…

Computation and Language · Computer Science 2023-07-06 Junjie Wu , Dit-Yan Yeung

Recent advances in deep learning research have shown remarkable achievements across many tasks in computer vision (CV) and natural language processing (NLP). At the intersection of CV and NLP is the problem of image captioning, where the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Jiyao Li , Mingze Ni , Yifei Dong , Tianqing Zhu , Wei Liu

Powerful adversarial attack methods are vital for understanding how to construct robust deep neural networks (DNNs) and for thoroughly testing defense techniques. In this paper, we propose a black-box adversarial attack algorithm that can…

Machine Learning · Computer Science 2019-12-11 Yandong Li , Lijun Li , Liqiang Wang , Tong Zhang , Boqing Gong

Transfer attacks optimize on a surrogate and deploy to a black-box target. While iterative optimization attacks in this paradigm are limited by their per-input cost limits efficiency and scalability due to multistep gradient updates for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Jongoh Jeong , Hunmin Yang , Jaeseok Jeong , Kuk-Jin Yoon

Neural networks are vulnerable to adversarial examples, malicious inputs crafted to fool trained models. Adversarial examples often exhibit black-box transfer, meaning that adversarial examples for one model can fool another model. However,…

Machine Learning · Computer Science 2018-11-22 Qian Huang , Zeqi Gu , Isay Katsman , Horace He , Pian Pawakapan , Zhiqiu Lin , Serge Belongie , Ser-Nam Lim

Adversarial transferability in black-box scenarios presents a unique challenge: while attackers can employ surrogate models to craft adversarial examples, they lack assurance on whether these examples will successfully compromise the target…

Machine Learning · Computer Science 2024-04-19 Mosh Levy , Guy Amit , Yuval Elovici , Yisroel Mirsky

HotFlip is a topical gradient-based word substitution method for attacking language models. Recently, this method has been further applied to attack retrieval systems by generating malicious passages that are injected into a corpus, i.e.,…

Information Retrieval · Computer Science 2025-03-11 Yongkang Li , Panagiotis Eustratiadis , Evangelos Kanoulas

Current large language models (LLM) provide a strong foundation for large-scale user-oriented natural language tasks. Many users can easily inject adversarial text or instructions through the user interface, thus causing LLM model security…

Computation and Language · Computer Science 2024-11-14 Chong Zhang , Mingyu Jin , Dong Shu , Taowen Wang , Dongfang Liu , Xiaobo Jin

In targeted adversarial attacks on vision models, the selection of the target label is a critical yet often overlooked determinant of attack success. This target label corresponds to the class that the attacker aims to force the model to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Katarzyna Filus , Jorge M. Cruz-Duarte

Text classification systems have been proven vulnerable to adversarial text examples, modified versions of the original text examples that are often unnoticed by human eyes, yet can force text classification models to alter their…

Computation and Language · Computer Science 2024-02-07 Norah Alshahrani , Saied Alshahrani , Esma Wali , Jeanna Matthews

We construct targeted audio adversarial examples on automatic speech recognition. Given any audio waveform, we can produce another that is over 99.9% similar, but transcribes as any phrase we choose (recognizing up to 50 characters per…

Machine Learning · Computer Science 2018-04-02 Nicholas Carlini , David Wagner

Text-to-Image(T2I) models have achieved remarkable success in image generation and editing, yet these models still have many potential issues, particularly in generating inappropriate or Not-Safe-For-Work(NSFW) content. Strengthening…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sensen Gao , Xiaojun Jia , Yihao Huang , Ranjie Duan , Jindong Gu , Yang Bai , Yang Liu , Qing Guo

Decision-based black-box attacks often necessitate a large number of queries to craft an adversarial example. Moreover, decision-based attacks based on querying boundary points in the estimated normal vector direction often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Md Farhamdur Reza , Ali Rahmati , Tianfu Wu , Huaiyu Dai

Machine learning (ML), especially deep neural networks (DNNs) have been widely used in various applications, including several safety-critical ones (e.g. autonomous driving). As a result, recent research about adversarial examples has…

Machine Learning · Computer Science 2020-05-29 Huichen Li , Xiaojun Xu , Xiaolu Zhang , Shuang Yang , Bo Li

Explainable AI is a strong strategy implemented to understand complex black-box model predictions in a human interpretable language. It provides the evidence required to execute the use of trustworthy and reliable AI systems. On the other…

Computation and Language · Computer Science 2025-03-12 Esther Chiramal , Kelvin Soh Boon Kai

Recent research has revealed that natural language processing (NLP) models are vulnerable to adversarial examples. However, the current techniques for generating such examples rely on deterministic heuristic rules, which fail to produce…

Computation and Language · Computer Science 2023-12-29 Mingze Ni , Zhensu Sun , Wei Liu

Adversarial examples are known as carefully perturbed images fooling image classifiers. We propose a geometric framework to generate adversarial examples in one of the most challenging black-box settings where the adversary can only…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Ali Rahmati , Seyed-Mohsen Moosavi-Dezfooli , Pascal Frossard , Huaiyu Dai

Deep neural networks are vulnerable to adversarial attacks. White-box adversarial attacks can fool neural networks with small adversarial perturbations, especially for large size images. However, keeping successful adversarial perturbations…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Yongwei Wang , Mingquan Feng , Rabab Ward , Z. Jane Wang , Lanjun Wang

Deep neural networks are powerful and popular learning models that achieve state-of-the-art pattern recognition performance on many computer vision, speech, and language processing tasks. However, these networks have also been shown…

Machine Learning · Computer Science 2016-12-20 Nina Narodytska , Shiva Prasad Kasiviswanathan