English
Related papers

Related papers: Saliency is a Possible Red Herring When Diagnosing…

200 papers

The robust generalization of models to rare, in-distribution (ID) samples drawn from the long tail of the training distribution and to out-of-training-distribution (OOD) samples is one of the major challenges of current deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Paul Gavrikov , Janis Keuper

The performance of convolutional neural networks has continued to improve over the last decade. At the same time, as model complexity grows, it becomes increasingly more difficult to explain model decisions. Such explanations may be of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Colton Crum , Patrick Tinsley , Aidan Boyd , Jacob Piland , Christopher Sweet , Timothy Kelley , Kevin Bowyer , Adam Czajka

Conventionally, AI models are thought to trade off explainability for lower accuracy. We develop a training strategy that not only leads to a more explainable AI system for object classification, but as a consequence, suffers no perceptible…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Andrea Zunino , Sarah Adel Bargal , Riccardo Volpi , Mehrnoosh Sameki , Jianming Zhang , Stan Sclaroff , Vittorio Murino , Kate Saenko

Existing saliency-guided training approaches improve model generalization by incorporating a loss term that compares the model's class activation map (CAM) for a sample's true-class ({\it i.e.}, correct-label class) against a human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Jacob Piland , Chris Sweet , Adam Czajka

Most of the saliency methods are evaluated on their ability to generate saliency maps, and not on their functionality in a complete vision pipeline, like for instance, image classification. In the current paper, we propose an approach which…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Carola Figueroa-Flores , Bogdan Raducanu , David Berga , Joost van de Weijer

Advanced data augmentation strategies have widely been studied to improve the generalization ability of deep learning models. Regional dropout is one of the popular solutions that guides the model to focus on less discriminative parts by…

Machine Learning · Computer Science 2021-07-28 A. F. M. Shahab Uddin , Mst. Sirazam Monira , Wheemyung Shin , TaeChoong Chung , Sung-Ho Bae

Recent work uncovered potential flaws in \eg attribution or heatmap based saliency methods. A typical flaw is a confirmations bias, where the scores are compared to human expectation. Since measuring the quality of saliency methods is hard…

Machine Learning · Computer Science 2025-01-27 Leonid Schwenke , Martin Atzmueller

Saliency maps are widely used in the computer vision community for interpreting neural network classifiers. However, due to the randomness of training samples and optimization algorithms, the resulting saliency maps suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Shizhan Gong , Jingwei Zhang , Qi Dou , Farzan Farnia

Deep learning models are now used in many different industries, while in certain domains safety is not a critical issue in the medical field it is a huge concern. Not only, we want the models to generalize well but we also want to know the…

Machine Learning · Computer Science 2019-07-08 Jae Duk Seo

Salient object detection is subjective in nature, which implies that multiple estimations should be related to the same input image. Most existing salient object detection models are deterministic following a point to point estimation…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Xinyu Tian , Jing Zhang , Yuchao Dai

Data augmentation is a commonly applied technique with two seemingly related advantages. With this method one can increase the size of the training set generating new samples and also increase the invariance of the network against the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Jalal Al-afandi , Bálint Magyar , András Horváth

One of the significant challenges of deep neural networks is that the complex nature of the network prevents human comprehension of the outcome of the network. Consequently, the applicability of complex machine learning models is limited in…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Shailja Thakur , Sebastian Fischmeister

Within the set of the many complex factors driving gaze placement, the properities of an image that are associated with fixations under free viewing conditions have been studied extensively. There is a general impression that the field is…

Computer Vision and Pattern Recognition · Computer Science 2014-09-29 Matthias Kümmerer , Thomas Wallis , Matthias Bethge

Saliency maps have become a widely used method to make deep learning models more interpretable by providing post-hoc explanations of classifiers through identification of the most pertinent areas of the input medical image. They are…

With too few samples or too many model parameters, overfitting can inhibit the ability to generalise predictions to new data. Within medical imaging, this can occur when features are incorrectly assigned importance such as distinct hospital…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Becks Simpson , Francis Dutil , Yoshua Bengio , Joseph Paul Cohen

In recent years, considerable work has been devoted to explaining predictive, deep learning-based models, and in turn how to evaluate explanations. An important class of evaluation methods are ones that are human-centered, which typically…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Yayan Zhao , Mingwei Li , Matthew Berger

Recent results suggest that state-of-the-art saliency models perform far from optimal in predicting fixations. This lack in performance has been attributed to an inability to model the influence of high-level image features such as objects.…

Computer Vision and Pattern Recognition · Computer Science 2015-04-10 Matthias Kümmerer , Lucas Theis , Matthias Bethge

Most existing saliency models use low-level features or task descriptions when generating attention predictions. However, the link between observer characteristics and gaze patterns is rarely investigated. We present a novel saliency…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Bingqing Yu , James J. Clark

Saliency maps can explain how deep neural networks classify images. But are they actually useful for humans? The present systematic review of 68 user studies found that while saliency maps can enhance human performance, null effects or even…

Human-Computer Interaction · Computer Science 2024-08-20 Romy Müller

Visual representations underlie object recognition tasks, but they often contain both robust and non-robust features. Our main observation is that image classifiers may perform poorly on out-of-distribution samples because spurious…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Chengzhi Mao , Kevin Xia , James Wang , Hao Wang , Junfeng Yang , Elias Bareinboim , Carl Vondrick