English
Related papers

Related papers: Towards More Robust Interpretation via Local Gradi…

200 papers

An evaluation criterion for safe and trustworthy deep learning is how well the invariances captured by representations of deep neural networks (DNNs) are shared with humans. We identify challenges in measuring these invariances. Prior works…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Vedant Nanda , Ayan Majumdar , Camila Kolling , John P. Dickerson , Krishna P. Gummadi , Bradley C. Love , Adrian Weller

With the ever-increasing complexity of neural language models, practitioners have turned to methods for understanding the predictions of these models. One of the most well-adopted approaches for model interpretability is feature-based…

Computation and Language · Computer Science 2021-06-10 Muhammad Bilal Zafar , Michele Donini , Dylan Slack , Cédric Archambeau , Sanjiv Das , Krishnaram Kenthapadi

Deep learning-based discriminative classifiers, despite their remarkable success, remain vulnerable to adversarial examples that can mislead model predictions. While adversarial training can enhance robustness, it fails to address the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Chunheng Zhao , Pierluigi Pisu , Gurcan Comert , Negash Begashaw , Varghese Vaidyan , Nina Christine Hubig

Adversarial training has been actively studied in recent computer vision research to improve the robustness of models. However, due to the huge computational cost of generating adversarial samples, adversarial training methods are often…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Yihan Wu , Xinda Li , Florian Kerschbaum , Heng Huang , Hongyang Zhang

In recent years, neural networks have demonstrated outstanding effectiveness in a large amount of applications.However, recent works have shown that neural networks are susceptible to adversarial examples, indicating possible flaws…

Machine Learning · Computer Science 2018-06-08 Fuxun Yu , Zirui Xu , Yanzhi Wang , Chenchen Liu , Xiang Chen

In this work, we investigate the phenomenon that robust image classifiers have human-recognizable features -- often referred to as interpretability -- as revealed through the input gradients of their score functions and their subsequent…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Jonathan Helland , Nathan VanHoudnos

In recent years, the learned local descriptors have outperformed handcrafted ones by a large margin, due to the powerful deep convolutional neural network architectures such as L2-Net [1] and triplet based metric learning [2]. However,…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Yanwu Xu , Mingming Gong , Tongliang Liu , Kayhan Batmanghelich , Chaohui Wang

Despite the growing prevalence of artificial neural networks in real-world applications, their vulnerability to adversarial attacks remains a significant concern, which motivates us to investigate the robustness of machine learning models.…

Machine Learning · Computer Science 2024-08-23 Jie Wang , Rui Gao , Yao Xie

Adversarial perturbations are imperceptible changes to input pixels that can change the prediction of deep learning models. Learned weights of models robust to such perturbations are previously found to be transferable across different…

Machine Learning · Computer Science 2020-10-30 Alvin Chan , Yi Tay , Yew-Soon Ong

Recent studies on the adversarial vulnerability of neural networks have shown that models trained to be more robust to adversarial attacks exhibit more interpretable saliency maps than their non-robust counterparts. We aim to quantify this…

Machine Learning · Statistics 2019-05-13 Christian Etmann , Sebastian Lunz , Peter Maass , Carola-Bibiane Schönlieb

For machine learning models to be reliable and trustworthy, their decisions must be interpretable. As these models find increasing use in safety-critical applications, it is important that not just the model predictions but also their…

Machine Learning · Computer Science 2023-12-19 Sandesh Kamath , Sankalp Mittal , Amit Deshpande , Vineeth N Balasubramanian

Gradient-based saliency methods are widely used to interpret deep neural networks, yet they often produce noisy and unstable explanations that poorly align with semantically meaningful input features. We argue that a fundamental cause of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Ali Karkehabadi , Jamshid Hassanpour , Houman Homayoun , Avesta Sasan

For a standard convolutional neural network, optimizing over the input pixels to maximize the score of some target class will generally produce a grainy-looking version of the original image. However, Santurkar et al. (2019) demonstrated…

Machine Learning · Computer Science 2019-10-24 Simran Kaur , Jeremy Cohen , Zachary C. Lipton

Deep neural networks are the default choice of learning models for computer vision tasks. Extensive work has been carried out in recent years on explaining deep models for vision tasks such as classification. However, recent work has shown…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Anindya Sarkar , Anirban Sarkar , Vineeth N Balasubramanian

Throughout the past five years, the susceptibility of neural networks to minimal adversarial perturbations has moved from a peculiar phenomenon to a core issue in Deep Learning. Despite much attention, however, progress towards more robust…

Machine Learning · Statistics 2019-12-13 Wieland Brendel , Jonas Rauber , Matthias Kümmerer , Ivan Ustyuzhaninov , Matthias Bethge

Ensuring the trustworthiness and interpretability of machine learning models is critical to their deployment in real-world applications. Feature attribution methods have gained significant attention, which provide local explanations of…

Machine Learning · Computer Science 2023-09-20 Md Abdul Kadir , Gowtham Krishna Addluri , Daniel Sonntag

In this work, we investigate a particular implicit bias in gradient descent training, which we term "Feature Averaging," and argue that it is one of the principal factors contributing to the non-robustness of deep neural networks. We show…

Machine Learning · Computer Science 2025-03-04 Binghui Li , Zhixuan Pan , Kaifeng Lyu , Jian Li

A widely believed explanation for the remarkable generalization capacities of overparameterized neural networks is that the optimization algorithms used for training induce an implicit bias towards benign solutions. To grasp this…

Machine Learning · Computer Science 2025-12-19 Maria Matveev , Vit Fojtik , Hung-Hsu Chou , Gitta Kutyniok , Johannes Maly

The adversarial robustness of attributions is a fundamental requirement for reliable explainability in deep learning, yet existing approaches typically rely on computationally expensive explicit regularization. In this work, we show that…

Machine Learning · Computer Science 2026-05-29 Amir Mehrpanah , Matteo Gamba , Hossein Azizpour

Deep networks for computer vision are not reliable when they encounter adversarial examples. In this paper, we introduce a framework that uses the dense intrinsic constraints in natural images to robustify inference. By introducing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Chengzhi Mao , Lingyu Zhang , Abhishek Joshi , Junfeng Yang , Hao Wang , Carl Vondrick