English
Related papers

Related papers: Blacklight: Scalable Defense for Neural Networks a…

200 papers

Despite the improved accuracy of deep neural networks, the discovery of adversarial examples has raised serious safety concerns. Most existing approaches for crafting adversarial examples necessitate some knowledge (architecture,…

Computer Vision and Pattern Recognition · Computer Science 2018-02-21 Matthew Wicker , Xiaowei Huang , Marta Kwiatkowska

Recent work in black-box adversarial attacks for NLP systems has attracted much attention. Prior black-box attacks assume that attackers can observe output labels from target models based on selected inputs. In this work, inspired by…

Machine Learning · Computer Science 2022-09-21 Siddhartha Datta

Traffic state prediction is necessary for many Intelligent Transportation Systems applications. Recent developments of the topic have focused on network-wide, multi-step prediction, where state of the art performance is achieved via deep…

Machine Learning · Computer Science 2024-03-12 Bibek Poudel , Weizi Li

Adversarial text attack research plays a crucial role in evaluating the robustness of NLP models. However, the increasing complexity of transformer-based architectures has dramatically raised the computational cost of attack testing,…

Computation and Language · Computer Science 2025-09-26 Abhinay Shankar Belde , Rohit Ramkumar , Jonathan Rusert

Deep Neural Networks (DNNs) are notoriously vulnerable to adversarial input designs with limited noise budgets. While numerous successful attacks with subtle modifications to original input have been proposed, defense techniques against…

Machine Learning · Computer Science 2025-06-27 Furkan Mumcu , Yasin Yilmaz

The success of deep learning research has catapulted deep models into production systems that our society is becoming increasingly dependent on, especially in the image and video domains. However, recent work has shown that these largely…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Nathan Inkawhich , Matthew Inkawhich , Yiran Chen , Hai Li

We study black-box attacks on machine learning classifiers where each query to the model incurs some cost or risk of detection to the adversary. We focus explicitly on minimizing the number of queries as a major objective. Specifically, we…

Cryptography and Security · Computer Science 2017-12-27 Fnu Suya , Yuan Tian , David Evans , Paolo Papotti

Deep neural networks are vulnerable to adversarial attacks. Among different attack settings, the most challenging yet the most practical one is the hard-label setting where the attacker only has access to the hard-label output (prediction…

Machine Learning · Computer Science 2020-09-08 Jinghui Chen , Quanquan Gu

Recent studies have shown that deep neural networks (DNN) are vulnerable to adversarial samples: maliciously-perturbed samples crafted to yield incorrect model outputs. Such attacks can severely undermine DNN systems, particularly in…

Machine Learning · Computer Science 2017-04-28 Ji Gao , Beilun Wang , Zeming Lin , Weilin Xu , Yanjun Qi

Many machine learning algorithms are vulnerable to almost imperceptible perturbations of their inputs. So far it was unclear how much risk adversarial perturbations carry for the safety of real-world machine learning applications because…

Machine Learning · Statistics 2018-02-19 Wieland Brendel , Jonas Rauber , Matthias Bethge

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In previous studies, the use of models encrypted with a secret key was demonstrated to be robust against white-box attacks, but not against black-box…

Artificial Intelligence · Computer Science 2024-02-13 Ryota Iijima , Sayaka Shiota , Hitoshi Kiya

Despite the enormous performance of deepneural networks (DNNs), recent studies have shown theirvulnerability to adversarial examples (AEs), i.e., care-fully perturbed inputs designed to fool the targetedDNN. Currently, the literature is…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Anouar Kherchouche , Sid Ahmed Fezza , Wassim Hamidouche

Convolutional Neural Networks have achieved significant success across multiple computer vision tasks. However, they are vulnerable to carefully crafted, human-imperceptible adversarial noise patterns which constrain their deployment in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Aamir Mustafa , Salman H. Khan , Munawar Hayat , Jianbing Shen , Ling Shao

Deep learning classifiers are susceptible to well-crafted, imperceptible variations of their inputs, known as adversarial attacks. In this regard, the study of powerful attack models sheds light on the sources of vulnerability in these…

Machine Learning · Computer Science 2020-10-26 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

The query-based black-box attacks have raised serious threats to machine learning models in many real applications. In this work, we study a lightweight defense method, dubbed Random Noise Defense (RND), which adds proper Gaussian noise to…

Machine Learning · Computer Science 2021-11-02 Zeyu Qin , Yanbo Fan , Hongyuan Zha , Baoyuan Wu

Generating and eliminating adversarial examples has been an intriguing topic in the field of deep learning. While previous research verified that adversarial attacks are often fragile and can be defended via image-level processing, it…

Machine Learning · Computer Science 2019-06-27 Yifeng Li , Lingxi Xie , Ya Zhang , Rui Zhang , Yanfeng Wang , Qi Tian

Black-box hard-label adversarial attack on text is a practical and challenging task, as the text data space is inherently discrete and non-differentiable, and only the predicted label is accessible. Research on this problem is still in the…

Computation and Language · Computer Science 2024-02-06 Han Liu , Zhi Xu , Xiaotong Zhang , Feng Zhang , Fenglong Ma , Hongyang Chen , Hong Yu , Xianchao Zhang

Clustering algorithms play a fundamental role as tools in decision-making and sensible automation processes. Due to the widespread use of these applications, a robustness analysis of this family of algorithms against adversarial noise has…

Machine Learning · Computer Science 2021-11-11 Antonio Emanuele Cinà , Alessandro Torcinovich , Marcello Pelillo

A recent line of work on black-box adversarial attacks has revived the use of transfer from surrogate models by integrating it into query-based search. However, we find that existing approaches of this type underperform their potential, and…

Machine Learning · Computer Science 2022-03-17 Nicholas A. Lord , Romain Mueller , Luca Bertinetto

Deep neural networks have recently achieved tremendous success in image classification. Recent studies have however shown that they are easily misled into incorrect classification decisions by adversarial examples. Adversaries can even…

Machine Learning · Computer Science 2019-03-27 Yujia Liu , Seyed-Mohsen Moosavi-Dezfooli , Pascal Frossard