English
Related papers

Related papers: Interpretations Cannot Be Trusted: Stealthy and Ef…

200 papers

Deep learning has come a long way and has enjoyed an unprecedented success. Despite high accuracy, however, deep models are brittle and are easily fooled by imperceptible adversarial perturbations. In contrast to common inference-time…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Ali Borji

Deep learning has gained tremendous success and great popularity in the past few years. However, deep learning systems are suffering several inherent weaknesses, which can threaten the security of learning models. Deep learning's wide use…

Cryptography and Security · Computer Science 2020-10-28 Yingzhe He , Guozhu Meng , Kai Chen , Xingbo Hu , Jinwen He

As machine learning models become increasingly deployed across the edge of internet of things environments, a partitioned deep learning paradigm in which models are split across multiple computational nodes introduces a new dimension of…

Machine Learning · Computer Science 2025-07-11 Giulio Rossolini , Fabio Brau , Alessandro Biondi , Battista Biggio , Giorgio Buttazzo

Thanks to recent advances in deep neural networks (DNNs), face recognition systems have become highly accurate in classifying a large number of face images. However, recent studies have found that DNNs could be vulnerable to adversarial…

Machine Learning · Computer Science 2020-01-29 Kazuya Kakizaki , Kosuke Yoshida

Interpretability is essential for user trust in real-world anomaly detection applications. However, deep learning models, despite their strong performance, often lack transparency. In this work, we study the interpretability of…

Deep learning is currently the most widespread and successful technology in artificial intelligence. It promises to push the frontier of scientific discovery beyond current limits. However, skeptics have worried that deep neural networks…

Machine Learning · Computer Science 2020-03-27 Cameron Buckner

Deep neural networks are normally executed in the forward direction. However, in this work, we identify a vulnerability that enables models to be trained in both directions and on different tasks. Adversaries can exploit this capability to…

Machine Learning · Computer Science 2024-05-20 Guy Amit , Mosh Levy , Yisroel Mirsky

Deep neural networks (DNNs) are highly susceptible to adversarial examples--subtle perturbations applied to inputs that are often imperceptible to humans yet lead to incorrect model predictions. In black-box scenarios, however, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Qing Wan , Shilong Deng , Xun Wang

Social networks are frequently polluted by rumors, which can be detected by advanced models such as graph neural networks. However, the models are vulnerable to attacks and understanding the vulnerabilities is critical to rumor detection in…

Machine Learning · Computer Science 2022-10-17 Yuefei Lyu , Xiaoyu Yang , Jiaxin Liu , Philip S. Yu , Sihong Xie , Xi Zhang

Recent advances of deep learning have brought exceptional performance on many computer vision tasks such as semantic segmentation and depth estimation. However, the vulnerability of deep neural networks towards adversarial examples have…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Ziqi Zhang , Xinge Zhu , Yingwei Li , Xiangqun Chen , Yao Guo

Nowadays, organizations collect vast quantities of accounting relevant transactions, referred to as 'journal entries', in 'Enterprise Resource Planning' (ERP) systems. The aggregation of those entries ultimately defines an organization's…

Machine Learning · Computer Science 2019-10-10 Marco Schreyer , Timur Sattarov , Bernd Reimer , Damian Borth

Despite the tremendous success of deep neural networks in various learning problems, it has been observed that adding an intentionally designed adversarial perturbation to inputs of these architectures leads to erroneous classification with…

Machine Learning · Computer Science 2018-12-19 Emilio Rafael Balda , Arash Behboodi , Rudolf Mathar

State-of-the-art deep neural networks have proven to be highly powerful in a broad range of tasks, including semantic image segmentation. However, these networks are vulnerable against adversarial attacks, i.e., non-perceptible…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Kira Maag , Asja Fischer

Deep Learning has empowered us to train neural networks for complex data with high performance. However, with the growing research, several vulnerabilities in neural networks have been exposed. A particular branch of research, Adversarial…

Machine Learning · Computer Science 2023-08-08 Shashank Kotyan

Deep learning models have achieved state-of-the-art performance in many classification tasks. However, most of them cannot provide an interpretation for their classification results. Machine learning models that are interpretable are…

Machine Learning · Computer Science 2021-11-04 Miles Q. Li , Benjamin C. M. Fung , Adel Abusitta

Supervised machine learning models boast remarkable predictive capabilities. But can you trust your model? Will it work in deployment? What else can it tell you about the world? We want models to be not only good, but interpretable. And yet…

Machine Learning · Computer Science 2017-03-07 Zachary C. Lipton

As machine learning models are increasingly deployed in safety-critical domains, visual explanation techniques have become essential tools for supporting transparency. In this work, we reveal a new class of attacks that compromise model…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Farhin Farhad Riya , Shahinul Hoque , Jinyuan Stella Sun , Olivera Kotevska

Collaborative machine learning settings like federated learning can be susceptible to adversarial interference and attacks. One class of such attacks is termed model inversion attacks, characterised by the adversary reverse-engineering the…

Machine Learning · Computer Science 2022-03-02 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

Adversarial robust models have been shown to learn more robust and interpretable features than standard trained models. As shown in [\cite{tsipras2018robustness}], such robust models inherit useful interpretable properties where the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Gunjan Aggarwal , Abhishek Sinha , Nupur Kumari , Mayank Singh

Neural network models have achieved state-of-the-art performances in a wide range of natural language processing (NLP) tasks. However, a long-standing criticism against neural network models is the lack of interpretability, which not only…

Computation and Language · Computer Science 2021-10-26 Xiaofei Sun , Diyi Yang , Xiaoya Li , Tianwei Zhang , Yuxian Meng , Han Qiu , Guoyin Wang , Eduard Hovy , Jiwei Li