English
Related papers

Related papers: SoK: Pitfalls in Evaluating Black-Box Attacks

200 papers

A variety of explanation methods have been proposed in recent years to help users gain insights into the results returned by neural networks, which are otherwise complex and opaque black-boxes. However, explanations give rise to potential…

Machine Learning · Computer Science 2022-06-29 Pengrui Quan , Supriyo Chakraborty , Jeya Vikranth Jeyakumar , Mani Srivastava

Decision-based evasion attacks repeatedly query a black-box classifier to generate adversarial examples. Prior work measures the cost of such attacks by the total number of queries made to the classifier. We argue this metric is flawed.…

Cryptography and Security · Computer Science 2024-02-15 Edoardo Debenedetti , Nicholas Carlini , Florian Tramèr

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

Many defenses have recently been proposed at venues like NIPS, ICML, ICLR and CVPR. These defenses are mainly focused on mitigating white-box attacks. They do not properly examine black-box attacks. In this paper, we expand upon the…

Machine Learning · Computer Science 2021-11-03 Kaleel Mahmood , Deniz Gurevin , Marten van Dijk , Phuong Ha Nguyen

Deep learning systems, critical in domains like autonomous vehicles, are vulnerable to adversarial examples (crafted inputs designed to mislead classifiers). This study investigates black-box adversarial attacks in computer vision. This is…

Cryptography and Security · Computer Science 2025-06-09 Francesco Panebianco , Mario D'Onghia , Stefano Zanero aand Michele Carminati

Threat modeling and risk assessments are common ways to identify, estimate, and prioritize risk to national, organizational, and individual operations and assets. Several threat modeling and risk assessment approaches have been proposed…

Cryptography and Security · Computer Science 2021-10-18 Paul Griffioen , Bruno Sinopoli

In this article, we propose the Artificial Intelligence Security Taxonomy to systematize the knowledge of threats, vulnerabilities, and security controls of machine-learning-based (ML-based) systems. We first classify the damage caused by…

Cryptography and Security · Computer Science 2023-01-20 Yusuke Kawamoto , Kazumasa Miyake , Koichi Konishi , Yutaka Oiwa

Textual backdoor attacks are a kind of practical threat to NLP systems. By injecting a backdoor in the training phase, the adversary could control model predictions via predefined triggers. As various attack and defense models have been…

Machine Learning · Computer Science 2022-11-02 Ganqu Cui , Lifan Yuan , Bingxiang He , Yangyi Chen , Zhiyuan Liu , Maosong Sun

Machine Learning (ML) systems are vulnerable to adversarial examples, particularly those from query-based black-box attacks. Despite various efforts to detect and prevent such attacks, ML systems are still at risk, demanding a more…

Machine Learning · Computer Science 2025-02-21 Yue Gao , Ilia Shumailov , Kassem Fawaz

With the increasing number of network threats it is essential to have a knowledge of existing and new network threats in order to design better intrusion detection systems. In this paper we propose a taxonomy for classifying network attacks…

Cryptography and Security · Computer Science 2018-06-12 Hanan Hindy , Elike Hodo , Ethan Bayne , Amar Seeam , Robert Atkinson , Xavier Bellekens

Deep neural network-based classifiers are prone to errors when processing adversarial examples (AEs). AEs are minimally perturbed input data undetectable to humans posing significant risks to security-dependent applications. Hence,…

Cryptography and Security · Computer Science 2026-01-05 Fumiya Morimoto , Ryuto Morita , Satoshi Ono

We study an important and challenging task of attacking natural language processing models in a hard label black box setting. We propose a decision-based attack strategy that crafts high quality adversarial examples on text classification…

Computation and Language · Computer Science 2021-04-30 Rishabh Maheshwary , Saket Maheshwary , Vikram Pudi

Black box attacks, where adversaries have limited knowledge of the target model, pose a significant threat to machine learning systems. Adversarial examples generated with a substitute model often suffer from limited transferability to the…

Machine Learning · Computer Science 2024-10-22 Bar Avraham , Yisroel Mirsky

Space infrastructures represent an emerging domain that is critical to the global economy and society. However, this domain is vulnerable to attacks, including cyber attacks and other kinds of attacks. To enhance the resilience of this…

Cryptography and Security · Computer Science 2026-04-13 Jose Luis Castanon Remy , Shouhuai Xu

Backdoor (trojan) attacks embed hidden, controllable behaviors into machine-learning models so that models behave normally on benign inputs but produce attacker-chosen outputs when a trigger is present. This survey reviews the rapidly…

Cryptography and Security · Computer Science 2025-09-10 Bilal Hussain Abbasi , Yanjun Zhang , Leo Zhang , Shang Gao

With the growing deployment of sequential recommender systems in e-commerce and other fields, their black-box interfaces raise security concerns: models are vulnerable to extraction and subsequent adversarial manipulation. Existing…

Information Retrieval · Computer Science 2026-02-13 Hongyue Zhang , Mingming Li , Dongqin Liu , Hui Wang , Yaning Zhang , Xi Zhou , Honglei Lv , Jiao Dai , Jizhong Han

The rise of cyber-physical systems in safety-critical domains calls for robust risk-evaluation frameworks. Assurance cases, often required by regulatory bodies, are a structured approach to demonstrate that a system meets its safety…

Software Engineering · Computer Science 2025-02-04 Usman Gohar , Michael C. Hunter , Myra B. Cohen , Robyn R. Lutz

Neural text ranking models have witnessed significant advancement and are increasingly being deployed in practice. Unfortunately, they also inherit adversarial vulnerabilities of general neural models, which have been detected but remain…

Information Retrieval · Computer Science 2023-04-19 Jiawei Liu , Yangyang Kang , Di Tang , Kaisong Song , Changlong Sun , Xiaofeng Wang , Wei Lu , Xiaozhong Liu

Black-box adversarial attack has attracted a lot of research interests for its practical use in AI safety. Compared with the white-box attack, a black-box setting is more difficult for less available information related to the attacked…

Machine Learning · Computer Science 2020-09-02 Linjun Zhou , Peng Cui , Yinan Jiang , Shiqiang Yang

The incremental diffusion of machine learning algorithms in supporting cybersecurity is creating novel defensive opportunities but also new types of risks. Multiple researches have shown that machine learning methods are vulnerable to…

Cryptography and Security · Computer Science 2021-06-18 Giovanni Apruzzese , Mauro Andreolini , Luca Ferretti , Mirco Marchetti , Michele Colajanni