English
Related papers

Related papers: SoK: Pitfalls in Evaluating Black-Box Attacks

200 papers

Deep learning models are used in safety-critical tasks such as automated driving and face recognition. However, small perturbations in the model input can significantly change the predictions. Adversarial attacks are used to identify small…

Cryptography and Security · Computer Science 2025-12-03 Issa Oe , Keiichiro Yamamura , Hiroki Ishikura , Ryo Hamahira , Katsuki Fujisawa

Control policies, trained using the Deep Reinforcement Learning, have been recently shown to be vulnerable to adversarial attacks introducing even very small perturbations to the policy input. The attacks proposed so far have been designed…

Machine Learning · Computer Science 2019-08-02 Alessio Russo , Alexandre Proutiere

Adversarial attacks perturb images such that a deep neural network produces incorrect classification results. A promising approach to defend against adversarial attacks on natural multi-object scenes is to impose a context-consistency…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Zikui Cai , Shantanu Rane , Alejandro E. Brito , Chengyu Song , Srikanth V. Krishnamurthy , Amit K. Roy-Chowdhury , M. Salman Asif

Any human-designed system can potentially be exploited in ways that its designers did not envision, and information systems or networks using quantum components do not escape this reality. We are presented with a unique but quickly waning…

Cryptography and Security · Computer Science 2024-04-22 Benjamin Blakely , Joaquin Chung , Alec Poczatek , Ryan Syed , Raj Kettimuthu

Interpretability, trustworthiness, and usability are key considerations in high-stake security applications, especially when utilizing deep learning models. While these models are known for their high accuracy, they behave as black boxes in…

A thorough and systematic understanding of different elements of cyberattacks is essential for developing the necessary tools to prevent, detect, diagnose, and mitigate cyberattacks in manufacturing systems. In response, researchers have…

Cryptography and Security · Computer Science 2023-03-23 Md Habibor Rahman , Thorsten Wuest , Mohammed Shafae

The advent of deep learning and its astonishing performance has enabled its usage in complex systems, including autonomous vehicles. On the other hand, deep learning models are susceptible to mispredictions when small, adversarial changes…

Cryptography and Security · Computer Science 2025-08-14 Masoud Jamshidiyan Tehrani , Jinhan Kim , Rosmael Zidane Lekeufack Foulefack , Alessandro Marchetto , Paolo Tonella

Adversarial examples represent a serious issue for the application of machine learning models in many sensitive domains. For generating adversarial examples, decision based black-box attacks are one of the most practical techniques as they…

Machine Learning · Computer Science 2024-11-20 Nicole Meng , Caleb Manicke , David Chen , Yingjie Lao , Caiwen Ding , Pengyu Hong , Kaleel Mahmood

Black-Box attacks on machine learning models occur when an attacker, despite having no access to the inner workings of a model, can successfully craft an attack by means of model theft. The attacker will train an own substitute model that…

Machine Learning · Computer Science 2017-11-16 Yannic Kilcher , Thomas Hofmann

This report presents a taxonomy of vulnerabilities created as a part of an effort to develop a framework for deriving verification and validation strategies to assess software security. This taxonomy is grounded in a theoretical model of…

Cryptography and Security · Computer Science 2007-05-23 Anil Bazaz , James D. Arthur

A fundamental issue in deep learning has been adversarial robustness. As these systems have scaled, such issues have persisted. Currently, large language models (LLMs) with billions of parameters suffer from adversarial attacks just like…

Machine Learning · Computer Science 2025-02-11 Brian Formento , Chuan Sheng Foo , See-Kiong Ng

Patch-based attacks introduce a perceptible but localized change to the input that induces misclassification. A limitation of current patch-based black-box attacks is that they perform poorly for targeted attacks, and even for the less…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Chenglin Yang , Adam Kortylewski , Cihang Xie , Yinzhi Cao , Alan Yuille

With the development of incipient technologies, user devices becoming more exposed and ill-used by foes. In upcoming decades, traditional security measures will not be sufficient enough to handle this huge threat towards distributed…

Cryptography and Security · Computer Science 2019-02-13 Md Mehedi Hassan Onik , Nasr Al-Zaben , Hung Phan Hoo , Chul-Soo Kim

In Machine Learning, White Box Adversarial Attacks rely on knowing underlying knowledge about the model attributes. This works focuses on discovering to distrinct pieces of model information: the underlying architecture and primary training…

Machine Learning · Computer Science 2020-09-08 Josh Kalin , Matthew Ciolino , David Noever , Gerry Dozier

This paper attempts to strengthen the pursued research on social engineering (SE) threat identification, and control, by means of the author's illustrated classification, which includes attack types, determining the degree of possible harm…

Cryptography and Security · Computer Science 2019-02-25 V. Y. Sokolov , O. Y. Korzhenko

In the highly interconnected digital landscape of today, safeguarding complex infrastructures against cyber threats has become increasingly challenging due to the exponential growth in the number and complexity of vulnerabilities. Resource…

Cryptography and Security · Computer Science 2025-02-18 Yuning Jiang , Nay Oo , Qiaoran Meng , Hoon Wei Lim , Biplab Sikdar

In this work, we study the black-box targeted attack problem from the model discrepancy perspective. On the theoretical side, we present a generalization error bound for black-box targeted attacks, which gives a rigorous theoretical…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Anqi Zhao , Tong Chu , Yahao Liu , Wen Li , Jingjing Li , Lixin Duan

Adversarial attacks have threatened the application of deep neural networks in security-sensitive scenarios. Most existing black-box attacks fool the target model by interacting with it many times and producing global perturbations.…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Tao Xiang , Hangcheng Liu , Shangwei Guo , Tianwei Zhang , Xiaofeng Liao

Data reconstruction attacks, which aim to recover the training dataset of a target model with limited access, have gained increasing attention in recent years. However, there is currently no consensus on a formal definition of data…

Cryptography and Security · Computer Science 2025-06-10 Rui Wen , Yiyong Liu , Michael Backes , Yang Zhang

Adversarial attacks, wherein slight inputs are carefully crafted to mislead intelligent models, have attracted increasing attention. However, a critical gap persists between theoretical advancements and practical application, particularly…

Cryptography and Security · Computer Science 2025-06-26 Sabrine Ennaji , Elhadj Benkhelifa , Luigi V. Mancini