中文
相关论文

相关论文: Explainable AI for Natural Adversarial Images

200 篇论文

Neural networks trained on visual data are well-known to be vulnerable to often imperceptible adversarial perturbations. The reasons for this vulnerability are still being debated in the literature. Recently Ilyas et al. (2019) showed that…

机器学习 · 计算机科学 2021-02-11 Jacob M. Springer , Melanie Mitchell , Garrett T. Kenyon

People's decision-making abilities often fail to improve or may even erode when they rely on AI for decision-support, even when the AI provides informative explanations. We argue this is partly because people intuitively seek contrastive…

人机交互 · 计算机科学 2025-03-20 Zana Buçinca , Siddharth Swaroop , Amanda E. Paluch , Finale Doshi-Velez , Krzysztof Z. Gajos

The misuse of generative AI in online disinformation campaigns highlights the urgent need for transparent and explainable detection systems. In this work, we investigate how detectors for AI-generated images can be more effective in…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Silvia Poletti , Justin Ilyes , Marcel Hasenbalg , David Fischinger , Martin Boyer

Adversarial examples pose a significant challenge to deep neural networks (DNNs) across both image and text domains, with the intent to degrade model performance through meticulously altered inputs. Adversarial texts, however, are distinct…

机器学习 · 计算机科学 2025-01-24 Shakila Mahjabin Tonni , Pedro Faustini , Mark Dras

The robustness of neural networks is challenged by adversarial examples that contain almost imperceptible perturbations to inputs, which mislead a classifier to incorrect outputs in high confidence. Limited by the extreme difficulty in…

机器学习 · 计算机科学 2020-10-20 Honglin Li , Yifei Fan , Frieder Ganz , Anthony Yezzi , Payam Barnaghi

Fundamental questions remain about when and why adversarial examples arise in neural networks, with competing views characterising them either as artifacts of the irregularities in the decision landscape or as products of sensitivity to…

机器学习 · 计算机科学 2025-10-14 Edward Stevinson , Lucas Prieto , Melih Barsbey , Tolga Birdal

Adversarial perturbations of normal images are usually imperceptible to humans, but they can seriously confuse state-of-the-art machine learning models. What makes them so special in the eyes of image classifiers? In this paper, we show…

机器学习 · 计算机科学 2018-05-22 Yang Song , Taesup Kim , Sebastian Nowozin , Stefano Ermon , Nate Kushman

Deep Neural Networks have been shown to be vulnerable to adversarial images. Conventional attacks strive for indistinguishable adversarial images with strictly restricted perturbations. Recently, researchers have moved to explore…

计算机视觉与模式识别 · 计算机科学 2023-06-19 Zhengyu Zhao , Zhuoran Liu , Martha Larson

The majority of computer vision algorithms fail to find higher-order (abstract) patterns in an image so are not robust against adversarial attacks, unlike human lateralized vision. Deep learning considers each input pixel in a homogeneous…

计算机视觉与模式识别 · 计算机科学 2023-01-31 Abubakar Siddique , Will N. Browne , Gina M. Grimshaw

Machine learning classifiers with high test accuracy often perform poorly under adversarial attacks. It is commonly believed that adversarial training alleviates this issue. In this paper, we demonstrate that, surprisingly, the opposite may…

机器学习 · 计算机科学 2022-03-30 Jacob Clarysse , Julia Hörrmann , Fanny Yang

The attacks on the neural-network-based classifiers using adversarial images have gained a lot of attention recently. An adversary can purposely generate an image that is indistinguishable from a innocent image for a human being but is…

密码学与安全 · 计算机科学 2019-07-02 Nir Morgulis , Alexander Kreines , Shachar Mendelowitz , Yuval Weisglass

Deep neural networks are at the forefront of machine learning research. However, despite achieving impressive performance on complex tasks, they can be very sensitive: Small perturbations of inputs can be sufficient to induce incorrect…

计算机视觉与模式识别 · 计算机科学 2020-09-04 Alex Serban , Erik Poll , Joost Visser

Machine learning models, especially deep neural networks (DNNs), have been shown to be vulnerable against adversarial examples which are carefully crafted samples with a small magnitude of the perturbation. Such adversarial perturbations…

计算机视觉与模式识别 · 计算机科学 2020-03-23 Anand Bhattad , Min Jin Chong , Kaizhao Liang , Bo Li , D. A. Forsyth

Clinical applicability of automated decision support systems depends on a robust, well-understood classification interpretation. Artificial neural networks while achieving class-leading scores fall short in this regard. Therefore, numerous…

计算机视觉与模式识别 · 计算机科学 2020-04-06 David Major , Dimitrios Lenis , Maria Wimmer , Gert Sluiter , Astrid Berg , Katja Bühler

Neural networks have been proven to be vulnerable to a variety of adversarial attacks. From a safety perspective, highly sparse adversarial attacks are particularly dangerous. On the other hand the pixelwise perturbations of sparse attacks…

机器学习 · 计算机科学 2019-09-12 Francesco Croce , Matthias Hein

The overarching goal of Explainable AI is to develop systems that not only exhibit intelligent behaviours, but also are able to explain their rationale and reveal insights. In explainable machine learning, methods that produce a high level…

人工智能 · 计算机科学 2020-05-06 Xiuyi Fan , Siyuan Liu , Thomas C. Henderson

Model explanations such as saliency maps can improve user trust in AI by highlighting important features for a prediction. However, these become distorted and misleading when explaining predictions of images that are subject to systematic…

人机交互 · 计算机科学 2022-03-02 Wencan Zhang , Mariella Dimiccoli , Brian Y. Lim

We introduce the concept of deceptive diffusion -- training a generative AI model to produce adversarial images. Whereas a traditional adversarial attack algorithm aims to perturb an existing image to induce a misclassificaton, the…

机器学习 · 计算机科学 2024-07-01 Lucas Beerens , Catherine F. Higham , Desmond J. Higham

A wide range of defenses have been proposed to harden neural networks against adversarial attacks. However, a pattern has emerged in which the majority of adversarial defenses are quickly broken by new attacks. Given the lack of success at…

机器学习 · 计算机科学 2020-02-05 Ali Shafahi , W. Ronny Huang , Christoph Studer , Soheil Feizi , Tom Goldstein

As the applications of Natural Language Processing (NLP) in sensitive areas like Political Profiling, Review of Essays in Education, etc. proliferate, there is a great need for increasing transparency in NLP models to build trust with…

计算与语言 · 计算机科学 2022-11-29 Adel Rahimi , Shaurya Jain