English
Related papers

Related papers: Zero-Query Adversarial Attack on Black-box Automat…

200 papers

Adversarial attacks on face recognition (FR) systems pose a significant security threat, yet most are confined to the digital domain or require white-box access. We introduce GaP (Gaussian Patch), a novel method to generate a universal,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Andrey Kaznacheev , Matvey Mikhalchuk , Andrey Kuznetsov , Aleksandr Petiushko , Anton Razzhigaev

Deep neural networks are vulnerable to adversarial examples that mislead models with imperceptible perturbations. In audio, although adversarial examples have achieved incredible attack success rates on white-box settings and black-box…

Sound · Computer Science 2022-10-13 Deng JiaCheng , Dong Li , Yan Diqun , Wang Rangding , Zeng Jiaming

Recent advances in Automatic Speech Recognition (ASR) have demonstrated remarkable accuracy and robustness in diverse audio applications, such as live transcription and voice command processing. However, deploying these models on…

Automatic Speaker Verification (ASV) systems can be used for voice-enabled applications for identity verification. However, recent studies have exposed these systems' vulnerabilities to both over-the-line (OTL) and over-the-air (OTA)…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-12 Li Wang , Xiaoyan Lei , Haorui He , Lei Wang , Jie Shi , Zhizheng Wu

Recent work has shown it is possible to construct adversarial examples that cause an aligned language model to emit harmful strings or perform harmful behavior. Existing attacks work either in the white-box setting (with full access to the…

Computation and Language · Computer Science 2024-12-10 Jonathan Hayase , Ema Borevkovic , Nicholas Carlini , Florian Tramèr , Milad Nasr

Adversarial examples seem to be inevitable. These specifically crafted inputs allow attackers to arbitrarily manipulate machine learning systems. Even worse, they often seem harmless to human observers. In our digital society, this poses a…

Cryptography and Security · Computer Science 2021-06-04 Thorsten Eisenhofer , Lea Schönherr , Joel Frank , Lars Speckemeier , Dorothea Kolossa , Thorsten Holz

End-to-end models for robust automatic speech recognition (ASR) have not been sufficiently well-explored in prior work. With end-to-end models, one could choose to preprocess the input speech using speech enhancement techniques and train…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Archiki Prasad , Preethi Jyothi , Rajbabu Velmurugan

Voice biometric systems based on automatic speaker verification (ASV) are exposed to \textit{spoofing} attacks which may compromise their security. To increase the robustness against such attacks, anti-spoofing or presentation attack…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-05 Alejandro Gomez-Alanis , Jose A. Gonzalez-Lopez , Antonio M. Peinado

Speech is a common and effective way of communication between humans, and modern consumer devices such as smartphones and home hubs are equipped with deep learning based accurate automatic speech recognition to enable natural interaction…

Computation and Language · Computer Science 2018-01-03 Moustafa Alzantot , Bharathan Balaji , Mani Srivastava

With the wide use of Automatic Speech Recognition (ASR) in applications such as human machine interaction, simultaneous interpretation, audio transcription, etc., its security protection becomes increasingly important. Although recent…

Cryptography and Security · Computer Science 2021-08-02 Yuxuan Chen , Jiangshan Zhang , Xuejing Yuan , Shengzhi Zhang , Kai Chen , Xiaofeng Wang , Shanqing Guo

Large Language Models (LLMs) increasingly employ alignment techniques to prevent harmful outputs. Despite these safeguards, attackers can circumvent them by crafting adversarial prompts. Predominant token-level optimization methods…

Computation and Language · Computer Science 2026-05-12 Jiawei Lian , Jianhong Pan , Lefan Wang , Yi Wang , Tairan Huang , Shaohui Mei , Lap-Pui Chau

We propose a versatile framework based on random search, Sparse-RS, for score-based sparse targeted and untargeted attacks in the black-box setting. Sparse-RS does not rely on substitute models and achieves state-of-the-art success rate and…

Machine Learning · Computer Science 2022-02-09 Francesco Croce , Maksym Andriushchenko , Naman D. Singh , Nicolas Flammarion , Matthias Hein

Adversarial audio attacks can be considered as a small perturbation unperceptive to human ears that is intentionally added to the audio signal and causes a machine learning model to make mistakes. This poses a security concern about the…

Machine Learning · Computer Science 2019-11-26 Mohammad Esmaeilpour , Patrick Cardinal , Alessandro Lameiras Koerich

Adversarial examples exhibit cross-model transferability, enabling threatening black-box attacks on commercial models. Model ensembling, which attacks multiple surrogate models, is a known strategy to improve this transferability. However,…

Machine Learning · Computer Science 2025-12-19 Chuan Liu , Huanran Chen , Yichi Zhang , Jun Zhu , Yinpeng Dong

Transfer-based adversarial example is one of the most important classes of black-box attacks. However, there is a trade-off between transferability and imperceptibility of the adversarial perturbation. Prior work in this direction often…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Fangcheng Liu , Chao Zhang , Hongyang Zhang

We study the query-based attack against image retrieval to evaluate its robustness against adversarial examples under the black-box setting, where the adversary only has query access to the top-k ranked unlabeled images from the database.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Xiaodan Li , Jinfeng Li , Yuefeng Chen , Shaokai Ye , Yuan He , Shuhui Wang , Hang Su , Hui Xue

Neural networks are vulnerable to adversarial examples, malicious inputs crafted to fool trained models. Adversarial examples often exhibit black-box transfer, meaning that adversarial examples for one model can fool another model. However,…

Machine Learning · Computer Science 2020-03-02 Qian Huang , Isay Katsman , Horace He , Zeqi Gu , Serge Belongie , Ser-Nam Lim

Lately, the self-attention mechanism has marked a new milestone in the field of automatic speech recognition (ASR). Nevertheless, its performance is susceptible to environmental intrusions as the system predicts the next output symbol…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-06 Lujun Li , Yikai Kang , Yuchen Shi , Ludwig Kürzinger , Tobias Watzel , Gerhard Rigoll

This work investigates efficient score-based black-box adversarial attacks with a high Attack Success Rate (ASR) and good generalizability. We design a novel attack method based on a Disentangled Feature space, called DifAttack, which…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Liu Jun , Zhou Jiantao , Zeng Jiandian , Jinyu Tian

In general, adversarial perturbations superimposed on inputs are realistic threats for a deep neural network (DNN). In this paper, we propose a practical generation method of such adversarial perturbation to be applied to black-box attacks…

Machine Learning · Computer Science 2020-02-19 Hisaichi Shibata , Shouhei Hanaoka , Yukihiro Nomura , Naoto Hayashi , Osamu Abe