English
Related papers

Related papers: A Strong Baseline for Query Efficient Attacks in a…

200 papers

We propose a versatile framework based on random search, Sparse-RS, for score-based sparse targeted and untargeted attacks in the black-box setting. Sparse-RS does not rely on substitute models and achieves state-of-the-art success rate and…

Machine Learning · Computer Science 2022-02-09 Francesco Croce , Maksym Andriushchenko , Naman D. Singh , Nicolas Flammarion , Matthias Hein

Boundary based blackbox attack has been recognized as practical and effective, given that an attacker only needs to access the final model prediction. However, the query efficiency of it is in general high especially for high dimensional…

Machine Learning · Computer Science 2021-06-14 Jiawei Zhang , Linyi Li , Huichen Li , Xiaolu Zhang , Shuang Yang , Bo Li

Though CNNs have achieved the state-of-the-art performance on various vision tasks, they are vulnerable to adversarial examples --- crafted by adding human-imperceptible perturbations to clean images. However, most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Cihang Xie , Zhishuai Zhang , Yuyin Zhou , Song Bai , Jianyu Wang , Zhou Ren , Alan Yuille

We present a novel approach for attacking black-box large language models (LLMs) by exploiting their ability to express confidence in natural language. Existing black-box attacks require either access to continuous model outputs like logits…

Cryptography and Security · Computer Science 2025-10-21 Jie Zhang , Meng Ding , Yang Liu , Jue Hong , Florian Tramèr

Neural networks are getting deeper and more computation-intensive nowadays. Quantization is a useful technique in deploying neural networks on hardware platforms and saving computation costs with negligible performance loss. However, recent…

Machine Learning · Computer Science 2021-01-26 Chang Song , Elias Fallon , Hai Li

Machine learning models have been found to be susceptible to adversarial examples that are often indistinguishable from the original inputs. These adversarial examples are created by applying adversarial perturbations to input samples,…

Machine Learning · Computer Science 2019-09-18 Rayan Mosli , Matthew Wright , Bo Yuan , Yin Pan

Black-Box attacks on machine learning models occur when an attacker, despite having no access to the inner workings of a model, can successfully craft an attack by means of model theft. The attacker will train an own substitute model that…

Machine Learning · Computer Science 2017-11-16 Yannic Kilcher , Thomas Hofmann

High-dimensional black-box optimisation remains an important yet notoriously challenging problem. Despite the success of Bayesian optimisation methods on continuous domains, domains that are categorical, or that mix continuous and…

Machine Learning · Statistics 2021-06-11 Xingchen Wan , Vu Nguyen , Huong Ha , Binxin Ru , Cong Lu , Michael A. Osborne

Adversarial examples pose a threat to deep neural network models in a variety of scenarios, from settings where the adversary has complete knowledge of the model and to the opposite "black box" setting. Black box attacks are particularly…

Machine Learning · Computer Science 2019-05-27 Haidar Khan , Daniel Park , Azer Khan , Bülent Yener

Enhancing our understanding of adversarial examples is crucial for the secure application of machine learning models in real-world scenarios. A prevalent method for analyzing adversarial examples is through a frequency-based approach.…

Machine Learning · Computer Science 2024-04-17 Zhun Zhang , Yi Zeng , Qihe Liu , Shijie Zhou

Benchmark workloads are extremely important to the database management research community, especially as more machine learning components are integrated into database systems. Here, we propose a Bayesian optimization technique to…

Deep Learning has become popular due to its vast applications in almost all domains. However, models trained using deep learning are prone to failure for adversarial samples and carry a considerable risk in sensitive applications. Most of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Satyadwyoom Kumar , Saurabh Gupta , Arun Balaji Buduru

Machine learning has been proven to be susceptible to carefully crafted samples, known as adversarial examples. The generation of these adversarial examples helps to make the models more robust and gives us an insight into the underlying…

Computation and Language · Computer Science 2020-12-29 Sachin Saxena

The textual adversarial attack refers to an attack method in which the attacker adds imperceptible perturbations to the original texts by elaborate design so that the NLP (natural language processing) model produces false judgments. This…

Computation and Language · Computer Science 2024-12-05 Xi Cao , Dolma Dawa , Nuo Qun , Trashi Nyima

Deep neural networks are vulnerable to adversarial attacks. Among different attack settings, the most challenging yet the most practical one is the hard-label setting where the attacker only has access to the hard-label output (prediction…

Machine Learning · Computer Science 2020-09-08 Jinghui Chen , Quanquan Gu

Multi-component natural language processing (NLP) pipelines are increasingly deployed for high-stakes decisions, yet no existing adversarial method can test their robustness under realistic conditions: binary-only feedback, no gradient…

Artificial Intelligence · Computer Science 2026-04-28 Mazal Bethany , Kim-Kwang Raymond Choo , Nishant Vishwamitra , Peyman Najafirad

Recent research on reinforcement learning (RL) has suggested that trained agents are vulnerable to maliciously crafted adversarial samples. In this work, we show how such samples can be generalised from White-box and Grey-box attacks to a…

Machine Learning · Computer Science 2019-11-25 Yiren Zhao , Ilia Shumailov , Han Cui , Xitong Gao , Robert Mullins , Ross Anderson

Adversarial attacks, wherein slight inputs are carefully crafted to mislead intelligent models, have attracted increasing attention. However, a critical gap persists between theoretical advancements and practical application, particularly…

Cryptography and Security · Computer Science 2025-06-26 Sabrine Ennaji , Elhadj Benkhelifa , Luigi V. Mancini

Deep neural networks for image classification remain vulnerable to adversarial examples -- small, imperceptible perturbations that induce misclassifications. In black-box settings, where only the final prediction is accessible, crafting…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Arjhun Swaminathan , Mete Akgün

The problem of adversarial examples, evasion attacks on machine learning classifiers, has proven extremely difficult to solve. This is true even when, as is the case in many practical settings, the classifier is hosted as a remote service…

Cryptography and Security · Computer Science 2019-07-15 Steven Chen , Nicholas Carlini , David Wagner