English
Related papers

Related papers: Explainable AI for Natural Adversarial Images

200 papers

We introduce a new type of indirect, cross-modal injection attacks against visual language models that enable creation of self-interpreting images. These images contain hidden "meta-instructions" that control how models answer users'…

Cryptography and Security · Computer Science 2025-06-16 Tingwei Zhang , Collin Zhang , John X. Morris , Eugene Bagdasarian , Vitaly Shmatikov

Convolutional neural networks (CNNs) offer great machine learning performance over a range of applications, but their operation is hard to interpret, even for experts. Various explanation algorithms have been proposed to address this issue,…

Human-Computer Interaction · Computer Science 2020-02-04 Ahmed Alqaraawi , Martin Schuessler , Philipp Weiß , Enrico Costanza , Nadia Berthouze

Over the past decade, Deep Learning has emerged as a useful and efficient tool to solve a wide variety of complex learning problems ranging from image classification to human pose estimation, which is challenging to solve using statistical…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Ashutosh Chaubey , Nikhil Agrawal , Kavya Barnwal , Keerat K. Guliani , Pramod Mehta

Two major uncertainties, dataset bias and adversarial examples, prevail in state-of-the-art AI algorithms with deep neural networks. In this paper, we present an intuitive explanation for these issues as well as an interpretation of the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-12 Yifei Fan , Anthony Yezzi

In recent years, neural networks have continued to flourish, achieving high efficiency in detecting relevant objects in photos or simply recognizing (classifying) these objects - mainly using CNN networks. Current solutions, however, are…

Neural and Evolutionary Computing · Computer Science 2020-05-06 Filip Marcinek

Adversarial algorithms have shown to be effective against neural networks for a variety of tasks. Some adversarial algorithms perturb all the pixels in the image minimally for the image classification task in image classification. In…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Shashank Kotyan , Danilo Vasconcellos Vargas

The field of eXplainable artificial intelligence (XAI) has produced a plethora of methods (e.g., saliency-maps) to gain insight into artificial intelligence (AI) models, and has exploded with the rise of deep learning (DL). However,…

Human-Computer Interaction · Computer Science 2024-04-12 Marvin Pafla , Kate Larson , Mark Hancock

Neural network image classifiers are known to be vulnerable to adversarial images, i.e., natural images which have been modified by an adversarial perturbation specifically designed to be imperceptible to humans yet fool the classifier. Not…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Gintare Karolina Dziugaite , Zoubin Ghahramani , Daniel M. Roy

As neural networks become the tool of choice to solve an increasing variety of problems in our society, adversarial attacks become critical. The possibility of generating data instances deliberately designed to fool a network's analysis can…

Machine Learning · Computer Science 2021-03-19 Gabriel D. Cantareira , Rodrigo F. Mello , Fernando V. Paulovich

With the perpetual increase of complexity of the state-of-the-art deep neural networks, it becomes a more and more challenging task to maintain their interpretability. Our work aims to evaluate the effects of adversarial training utilized…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Delyan Boychev

A particular class of Explainable AI (XAI) methods provide saliency maps to highlight part of the image a Convolutional Neural Network (CNN) model looks at to classify the image as a way to explain its working. These methods provide an…

Machine Learning · Computer Science 2021-06-25 Sam Zabdiel Sunder Samuel , Vidhya Kamakshi , Namrata Lodhi , Narayanan C Krishnan

Adversarial examples are maliciously tweaked images that can easily fool machine learning techniques, such as neural networks, but they are normally not visually distinguishable for human beings. One of the main approaches to solve this…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Zukang Liao

Modern image classification systems are often built on deep neural networks, which suffer from adversarial examples--images with deliberately crafted, imperceptible noise to mislead the network's classification. To defend against…

Machine Learning · Computer Science 2019-12-02 Chang Xiao , Changxi Zheng

Over the last few years, convolutional neural networks (CNNs) have proved to reach super-human performance in visual recognition tasks. However, CNNs can easily be fooled by adversarial examples, i.e., maliciously-crafted images that force…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Federico Nesti , Alessandro Biondi , Giorgio Buttazzo

Explaining decisions of black-box classifiers is paramount in sensitive domains such as medical imaging since clinicians confidence is necessary for adoption. Various explanation approaches have been proposed, among which perturbation based…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Martin Charachon , Céline Hudelot , Paul-Henry Cournède , Camille Ruppli , Roberto Ardon

We propose a probabilistic perspective on adversarial examples, allowing us to embed subjective understanding of semantics as a distribution into the process of generating adversarial examples, in a principled manner. Despite significant…

Machine Learning · Statistics 2024-11-26 Andi Zhang , Mingtian Zhang , Damon Wischik

Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance on a variety of computer vision tasks, particularly visual classification problems, where new algorithms reported to achieve or even surpass the human…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Hossein Hosseini , Baicen Xiao , Mayoore Jaiswal , Radha Poovendran

The susceptibility of modern machine learning classifiers to adversarial examples has motivated theoretical results suggesting that these might be unavoidable. However, these results can be too general to be applicable to natural data…

Machine Learning · Computer Science 2024-05-28 Ambar Pal , Jeremias Sulam , René Vidal

We consider the problem of the stability of saliency-based explanations of Neural Network predictions under adversarial attacks in a classification task. Saliency interpretations of deterministic Neural Networks are remarkably brittle even…

Machine Learning · Computer Science 2022-05-06 Ginevra Carbone , Guido Sanguinetti , Luca Bortolussi

The adversarial machine learning literature is largely partitioned into evasion attacks on testing data and poisoning attacks on training data. In this work, we show that adversarial examples, originally intended for attacking pre-trained…

Machine Learning · Computer Science 2021-06-22 Liam Fowl , Micah Goldblum , Ping-yeh Chiang , Jonas Geiping , Wojtek Czaja , Tom Goldstein