English
Related papers

Related papers: Interpretations Cannot Be Trusted: Stealthy and Ef…

200 papers

Deep Learning methods are renowned for their performances, yet their lack of interpretability prevents them from high-stakes contexts. Recent model agnostic methods address this problem by providing post-hoc interpretability methods by…

Machine Learning · Computer Science 2021-11-30 Marco Repetto

Most existing multi-document machine reading comprehension models mainly focus on understanding the interactions between the input question and documents, but ignore following two kinds of understandings. First, to understand the semantic…

Computation and Language · Computer Science 2022-04-08 Feiliang Ren , Yongkang Liu , Bochao Li , Zhibo Wang , Yu Guo , Shilei Liu , Huimin Wu , Jiaqi Wang , Chunchao Liu , Bingchao Wang

Deep Neural Networks have been found vulnerable re-cently. A kind of well-designed inputs, which called adver-sarial examples, can lead the networks to make incorrectpredictions. Depending on the different scenarios, goalsand capabilities,…

Machine Learning · Computer Science 2022-06-14 Junde Wu , Rao Fu

Deep neural networks (DNNs) are vulnerable to adversarial examples with small perturbations. Adversarial defense thus has been an important means which improves the robustness of DNNs by defending against adversarial examples. Existing…

Machine Learning · Computer Science 2021-03-16 Jincheng Li , Jiezhang Cao , Yifan Zhang , Jian Chen , Mingkui Tan

Although multimodal large language models (MLLMs) are increasingly deployed in real-world applications, their instruction-following behavior leaves them vulnerable to prompt injection attacks. Existing prompt injection methods predominantly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Meiwen Ding , Song Xia , Chenqi Kong , Xudong Jiang

Deep learning methods have become very popular for the processing of natural images, and were then successfully adapted to the neuroimaging field. As these methods are non-transparent, interpretability methods are needed to validate them…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Elina Thibeau-Sutre , Sasha Collin , Ninon Burgos , Olivier Colliot

Nowadays, intrusion detection systems based on deep learning deliver state-of-the-art performance. However, recent research has shown that specially crafted perturbations, called adversarial examples, are capable of significantly reducing…

Cryptography and Security · Computer Science 2022-10-31 Islam Debicha , Richard Bauwens , Thibault Debatty , Jean-Michel Dricot , Tayeb Kenaza , Wim Mees

Recent studies have shown that state-of-the-art deep learning models are vulnerable to the inputs with small perturbations (adversarial examples). We observe two critical obstacles in adversarial examples: (i) Strong adversarial attacks…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Xiaoyong Yuan , Pan He , Xiaolin Andy Li , Dapeng Oliver Wu

Deep learning constitutes a pivotal component within the realm of machine learning, offering remarkable capabilities in tasks ranging from image recognition to natural language processing. However, this very strength also renders deep…

Machine Learning · Computer Science 2023-09-12 Saminder Dhesi , Laura Fontes , Pedro Machado , Isibor Kennedy Ihianle , Farhad Fassihi Tash , David Ada Adama

Compared with traditional machine learning models, deep neural networks perform better, especially in image classification tasks. However, they are vulnerable to adversarial examples. Adding small perturbations on examples causes a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Zifei Zhang , Kai Qiao , Lingyun Jiang , Linyuan Wang , Bin Yan

The burgeoning success of deep learning has raised the security and privacy concerns as more and more tasks are accompanied with sensitive data. Adversarial attacks in deep learning have emerged as one of the dominating security threat to a…

Machine Learning · Computer Science 2019-01-01 Wenqi Wei , Ling Liu , Margaret Loper , Stacey Truex , Lei Yu , Mehmet Emre Gursoy , Yanzhao Wu

It has been suggested that adversarial examples cause deep learning models to make incorrect predictions with high confidence. In this work, we take the opposite stance: an overly confident model is more likely to be vulnerable to…

Machine Learning · Computer Science 2018-02-14 Angus Galloway , Graham W. Taylor , Medhat Moussa

Deep neural networks are vulnerable to adversarial examples, i.e., carefully-perturbed inputs aimed to mislead classification. This work proposes a detection method based on combining non-linear dimensionality reduction and density…

Machine Learning · Computer Science 2019-05-02 Francesco Crecchi , Davide Bacciu , Battista Biggio

This tutorial aims to introduce the fundamentals of adversarial robustness of deep learning, presenting a well-structured review of up-to-date techniques to assess the vulnerability of various types of deep learning models to adversarial…

Machine Learning · Computer Science 2021-08-25 Wenjie Ruan , Xinping Yi , Xiaowei Huang

Recent attacks on Machine Learning (ML) models such as evasion attacks with adversarial examples and models stealing through extraction attacks pose several security and privacy threats. Prior work proposes to use adversarial training to…

Machine Learning · Computer Science 2022-08-23 Kacem Khaled , Gabriela Nicolescu , Felipe Gohring de Magalhães

Production machine learning systems are consistently under attack by adversarial actors. Various deep learning models must be capable of accurately detecting fake or adversarial input while maintaining speed. In this work, we propose one…

Machine Learning · Computer Science 2021-06-15 Matthew Ciolino , Josh Kalin , David Noever

This paper explores the intricate relationship between interpretability and robustness in deep learning models. Despite their remarkable performance across various tasks, deep learning models often exhibit critical vulnerabilities,…

Machine Learning · Computer Science 2024-12-30 Navid Nayyem , Abdullah Rakin , Longwei Wang

Adversarial attacks in deep learning represent a significant threat to the integrity and reliability of machine learning models. Adversarial training has been a popular defence technique against these adversarial attacks. In this work, we…

Machine Learning · Computer Science 2025-02-24 Akshay G Rao , Chandrashekhar Lakshminarayanan , Arun Rajkumar

Deep neural networks for medical image classification often fail to generalize consistently in clinical practice due to violations of the i.i.d. assumption and opaque decision-making. This paper examines interpretability in deep neural…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Mohammad Hossein Najafi , Mohammad Morsali , Mohammadreza Pashanejad , Saman Soleimani Roudi , Mohammad Norouzi , Saeed Bagheri Shouraki

Interpretability is crucial to understand the inner workings of deep neural networks (DNNs) and many interpretation methods generate saliency maps that highlight parts of the input image that contribute the most to the prediction made by…

Cryptography and Security · Computer Science 2022-07-21 Shihong Fang , Anna Choromanska