English
Related papers

Related papers: Explainable AI for Natural Adversarial Images

200 papers

Research of adversarial attacks is important for AI security because it shows the vulnerability of deep learning models and helps to build more robust models. Adversarial attacks on images are most widely studied, which include noise-based…

Cryptography and Security · Computer Science 2024-10-14 Xiaopei Zhu , Peiyang Xu , Guanning Zeng , Yingpeng Dong , Xiaolin Hu

Adversarial examples are inputs to a machine learning system that result in an incorrect output from that system. Attacks launched through this type of input can cause severe consequences: for example, in the field of image recognition, a…

Machine Learning · Computer Science 2021-11-24 Stefano Cresci , Marinella Petrocchi , Angelo Spognardi , Stefano Tognazzi

As humans, we inherently perceive images based on their predominant features, and ignore noise embedded within lower bit planes. On the contrary, Deep Neural Networks are known to confidently misclassify images corrupted with meticulously…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Sravanti Addepalli , Vivek B. S. , Arya Baburaj , Gaurang Sriramanan , R. Venkatesh Babu

DNN-based image classifiers are susceptible to adversarial attacks. Most previous adversarial attacks do not have clear patterns, making it difficult to interpret attacks' results and gain insights into classifiers' mechanisms. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Ryoya Nara , Yusuke Matsui

Improving the interpretability of geospatial artificial intelligence (GeoAI) models has become critically important to open the "black box" of complex AI models, such as deep learning. This paper compares popular saliency map generation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chia-Yu Hsu , Wenwen Li

The goal of explainable Artificial Intelligence (XAI) is to generate human-interpretable explanations, but there are no computationally precise theories of how humans interpret AI generated explanations. The lack of theory means that…

Artificial Intelligence · Computer Science 2022-06-10 Scott Cheng-Hsin Yang , Tomas Folke , Patrick Shafto

It has been shown that most machine learning algorithms are susceptible to adversarial perturbations. Slightly perturbing an image in a carefully chosen direction in the image space may cause a trained neural network model to misclassify…

Computer Vision and Pattern Recognition · Computer Science 2017-07-13 Jiajun Lu , Hussein Sibai , Evan Fabry , David Forsyth

Recent research has found that many families of machine learning models are vulnerable to adversarial examples: inputs that are specifically designed to cause the target model to produce erroneous outputs. In this survey, we focus on…

Machine Learning · Computer Science 2019-11-19 Rey Reza Wiyatno , Anqi Xu , Ousmane Dia , Archy de Berker

Machine learning models are vulnerable to adversarial examples: small changes to images can cause computer vision models to make mistakes such as identifying a school bus as an ostrich. However, it is still an open question whether humans…

Adversarial examples raise questions about whether neural network models are sensitive to the same visual features as humans. In this paper, we first detect adversarial examples or otherwise corrupted images based on a class-conditional…

Machine Learning · Computer Science 2020-02-19 Yao Qin , Nicholas Frosst , Sara Sabour , Colin Raffel , Garrison Cottrell , Geoffrey Hinton

State-of-the-art deep-learning systems use decision rules that are challenging for humans to model. Explainable AI (XAI) attempts to improve human understanding but rarely accounts for how people typically reason about unfamiliar agents. We…

Artificial Intelligence · Computer Science 2021-04-27 Scott Cheng-Hsin Yang , Wai Keen Vong , Ravi B. Sojitra , Tomas Folke , Patrick Shafto

Almost all adversarial attacks are formulated to add an imperceptible perturbation to an image in order to fool a model. Here, we consider the opposite which is adversarial examples that can fool a human but not a model. A large enough and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Ali Borji

A plethora of attack methods have been proposed to generate adversarial examples, among which the iterative methods have been demonstrated the ability to find a strong attack. However, the computation of an adversarial perturbation for a…

Machine Learning · Computer Science 2021-12-16 Chia-Hung Yuan , Pin-Yu Chen , Chia-Mu Yu

Deep neural networks have been proved that they are vulnerable to adversarial examples, which are generated by adding human-imperceptible perturbations to images. To defend these adversarial examples, various detection based methods have…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Kejiang Chen , Yuefeng Chen , Hang Zhou , Chuan Qin , Xiaofeng Mao , Weiming Zhang , Nenghai Yu

We investigate adversarial attacks for autoencoders. We propose a procedure that distorts the input image to mislead the autoencoder in reconstructing a completely different target image. We attack the internal latent representations,…

Neural and Evolutionary Computing · Computer Science 2016-12-02 Pedro Tabacof , Julia Tavares , Eduardo Valle

In this paper, we aim to understand and explain the decisions of deep neural networks by studying the behavior of predicted attributes when adversarial examples are introduced. We study the changes in attributes for clean as well as…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Sadaf Gulshad , Zeynep Akata , Jan Hendrik Metzen , Arnold Smeulders

A novel explainable AI method called CLEAR Image is introduced in this paper. CLEAR Image is based on the view that a satisfactory explanation should be contrastive, counterfactual and measurable. CLEAR Image explains an image's…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Adam White , Kwun Ho Ngan , James Phelan , Saman Sadeghi Afgeh , Kevin Ryan , Constantino Carlos Reyes-Aldasoro , Artur d'Avila Garcez

Including human analysis has the potential to positively affect the robustness of Deep Neural Networks and is relatively unexplored in the Adversarial Machine Learning literature. Neural network visual explanation maps have been shown to be…

Machine Learning · Computer Science 2023-08-28 Ryan McCoppin , Marla Kennedy , Platon Lukyanenko , Sean Kennedy

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

It is well known that a determined adversary can fool a neural network by making imperceptible adversarial perturbations to an image. Recent studies have shown that these perturbations can be detected even without information about the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Siddharth Krishna Kumar