English
Related papers

Related papers: The best defense is a good offense: Countering bla…

200 papers

Control policies, trained using the Deep Reinforcement Learning, have been recently shown to be vulnerable to adversarial attacks introducing even very small perturbations to the policy input. The attacks proposed so far have been designed…

Machine Learning · Computer Science 2019-08-02 Alessio Russo , Alexandre Proutiere

We present a method for adversarial input generation against black box models for reading comprehension based question answering. Our approach is composed of two steps. First, we approximate a victim black box model via model extraction…

Machine Learning · Computer Science 2020-11-03 Naveen Jafer Nizar , Ari Kobren

Deep learning is a powerful weapon to boost application performance in many fields, including face recognition, object detection, image classification, natural language understanding, and recommendation system. With the rapid increase in…

Software Engineering · Computer Science 2021-07-28 Hongchen Cao , Shuai Li , Yuming Zhou , Ming Fan , Xuejiao Zhao , Yutian Tang

Deep learning models are vulnerable to adversarial examples, which can fool a target classifier by imposing imperceptible perturbations onto natural examples. In this work, we consider the practical and challenging decision-based black-box…

Machine Learning · Computer Science 2021-05-11 Qi-An Fu , Yinpeng Dong , Hang Su , Jun Zhu

As real-world images come in varying sizes, the machine learning model is part of a larger system that includes an upstream image scaling algorithm. In this paper, we investigate the interplay between vulnerabilities of the image scaling…

Machine Learning · Computer Science 2022-06-22 Yue Gao , Ilia Shumailov , Kassem Fawaz

Recently, researchers have discovered that the state-of-the-art object classifiers can be fooled easily by small perturbations in the input unnoticeable to human eyes. It is also known that an attacker can generate strong adversarial…

Machine Learning · Computer Science 2018-06-28 Jihun Hamm , Akshay Mehra

The growing interest for adversarial examples, i.e. maliciously modified examples which fool a classifier, has resulted in many defenses intended to detect them, render them inoffensive or make the model more robust against them. In this…

Machine Learning · Computer Science 2021-03-04 Rémi Bernhard , Pierre-Alain Moellic , Jean-Max Dutertre

Traffic state prediction is necessary for many Intelligent Transportation Systems applications. Recent developments of the topic have focused on network-wide, multi-step prediction, where state of the art performance is achieved via deep…

Machine Learning · Computer Science 2024-03-12 Bibek Poudel , Weizi Li

As deep neural networks (DNNs) have become increasingly important and popular, the robustness of DNNs is the key to the safety of both the Internet and the physical world. Unfortunately, some recent studies show that adversarial examples,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Yifan Ding , Liqiang Wang , Huan Zhang , Jinfeng Yi , Deliang Fan , Boqing Gong

Deep neural networks have been demonstrated to be vulnerable to backdoor attacks. Specifically, by injecting a small number of maliciously constructed inputs into the training set, an adversary is able to plant a backdoor into the trained…

Machine Learning · Statistics 2019-12-10 Alexander Turner , Dimitris Tsipras , Aleksander Madry

Deep neural networks (DNNs) are known to be vulnerable to adversarial examples which contain human-imperceptible perturbations. A series of defending methods, either proactive defence or reactive defence, have been proposed in the recent…

Machine Learning · Computer Science 2020-07-27 Derek Wang , Chaoran Li , Sheng Wen , Surya Nepal , Yang Xiang

Minute pixel changes in an image drastically change the prediction that the deep learning model makes. One of the most significant problems that could arise due to this, for instance, is autonomous driving. Many methods have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Shreyank N Gowda , Chun Yuan

An adversary who aims to steal a black-box model repeatedly queries the model via a prediction API to learn a function that approximates its decision boundary. Adversarial approximation is non-trivial because of the enormous combinations of…

Cryptography and Security · Computer Science 2020-06-30 Abdullah Ali , Birhanu Eshete

Adversarial examples are important for understanding the behavior of neural models, and can improve their robustness through adversarial training. Recent work in natural language processing generated adversarial examples by assuming…

Machine Learning · Computer Science 2019-04-05 Yotam Gil , Yoav Chai , Or Gorodissky , Jonathan Berant

In this paper, we study the problem of how to defend classifiers against adversarial attacks that fool the classifiers using subtly modified input data. In contrast to previous works, here we focus on the white-box adversarial defense where…

Machine Learning · Computer Science 2019-09-16 Zudi Lin , Hanspeter Pfister , Ziming Zhang

In Machine Learning, White Box Adversarial Attacks rely on knowing underlying knowledge about the model attributes. This works focuses on discovering to distrinct pieces of model information: the underlying architecture and primary training…

Machine Learning · Computer Science 2020-09-08 Josh Kalin , Matthew Ciolino , David Noever , Gerry Dozier

Existing studies in backdoor defense have predominantly focused on the training phase, overlooking the critical aspect of testing time defense. This gap becomes pronounced in the context of LLMs deployed as Web Services, which typically…

Computation and Language · Computer Science 2025-02-13 Wenjie Mo , Jiashu Xu , Qin Liu , Jiongxiao Wang , Jun Yan , Hadi Askari , Chaowei Xiao , Muhao Chen

Adversarial attacks remain a significant threat that can jeopardize the integrity of Machine Learning (ML) models. In particular, query-based black-box attacks can generate malicious noise without having access to the victim model's…

Cryptography and Security · Computer Science 2025-03-18 Jeonghwan Park , Niall McLaughlin , Ihsen Alouani

Deep learning methods have shown state of the art performance in a range of tasks from computer vision to natural language processing. However, it is well known that such systems are vulnerable to attackers who craft inputs in order to…

Machine Learning · Computer Science 2020-09-29 Giulio Zizzo , Chris Hankin , Sergio Maffeis , Kevin Jones

Machine learning has been proven to be susceptible to carefully crafted samples, known as adversarial examples. The generation of these adversarial examples helps to make the models more robust and gives us an insight into the underlying…

Computation and Language · Computer Science 2020-12-29 Sachin Saxena