English
Related papers

Related papers: Explainable GeoAI: Can saliency maps help interpre…

200 papers

Although deep neural networks hold the state-of-the-art in several remote sensing tasks, their black-box operation hinders the understanding of their decisions, concealing any bias and other shortcomings in datasets and model performance.…

Machine Learning · Computer Science 2021-09-21 Ioannis Kakogeorgiou , Konstantinos Karantzalos

Transparency and explainability in image classification are essential for establishing trust in machine learning models and detecting biases and errors. State-of-the-art explainability methods generate saliency maps to show where a specific…

Machine Learning · Computer Science 2024-07-30 Matteo Bianchi , Antonio De Santis , Andrea Tocchetti , Marco Brambilla

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

Saliency maps are often used in computer vision to provide intuitive interpretations of what input regions a model has used to produce a specific prediction. A number of approaches to saliency map generation are available, but most require…

Machine Learning · Computer Science 2020-01-31 Mamuku Mokuwe , Michael Burke , Anna Sergeevna Bosman

Interpretability is a critical factor in applying complex deep learning models to advance the understanding of brain disorders in neuroimaging studies. To interpret the decision process of a trained classifier, existing techniques typically…

Image and Video Processing · Electrical Eng. & Systems 2021-06-29 Zixuan Liu , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao

Explainable artificial intelligence (XAI) plays an indispensable role in demystifying the decision-making processes of AI, especially within the healthcare industry. Clinicians rely heavily on detailed reasoning when making a diagnosis,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Anna Stubbin , Thompson Chyrikov , Jim Zhao , Christina Chajo

Gradient-based saliency methods such as Vanilla Gradient (VG) and Integrated Gradients (IG) are widely used to explain image classifiers, yet the resulting maps are often noisy and unstable, limiting their usefulness in high-stakes…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Dipkamal Bhusal , Md Tanvirul Alam , Nidhi Rastogi

Understanding specifically where a model focuses on within an image is critical for human interpretability of the decision-making process. Deep learning-based solutions are prone to learning coincidental correlations in training datasets,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Aidan Boyd , Mohamed Trabelsi , Huseyin Uzunalioglu , Dan Kushnir

Deep learning has become the de facto standard and dominant paradigm in image analysis tasks, achieving state-of-the-art performance. However, this approach often results in "black-box" models, whose decision-making processes are difficult…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Nguyen Van Tu , Pham Nguyen Hai Long , Vo Hoai Viet

Recent developments in machine learning have introduced models that approach human performance at the cost of increased architectural complexity. Efforts to make the rationales behind the models' predictions transparent have inspired an…

Computation and Language · Computer Science 2020-09-29 Pepa Atanasova , Jakob Grue Simonsen , Christina Lioma , Isabelle Augenstein

This paper studies interpretability of convolutional networks by means of saliency maps. Most approaches based on Class Activation Maps (CAM) combine information from fully connected layers and gradient through variants of backpropagation.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Felipe Torres Figueroa , Hanwei Zhang , Ronan Sicre , Yannis Avrithis , Stephane Ayache

Evaluating, explaining, and visualizing high-level concepts in generative models, such as variational autoencoders (VAEs), is challenging in part due to a lack of known prediction classes that are required to generate saliency maps in…

Machine Learning · Computer Science 2023-03-21 Lennart Brocki , Neo Christopher Chung

In this paper, we propose several novel deep learning methods for object saliency detection based on the powerful convolutional neural networks. In our approach, we use a gradient descent method to iteratively modify an input image based on…

Computer Vision and Pattern Recognition · Computer Science 2015-05-07 Hengyue Pan , Bo Wang , Hui Jiang

Deep Neural Networks are powerful tools to understand complex patterns and making decisions. However, their black-box nature impedes a complete understanding of their inner workings. While online saliency-guided training methods try to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Ali Karkehabadi

Convolutional neural networks (CNNs) have recently attracted great attention in geoscience due to their ability to capture non-linear system behavior and extract predictive spatiotemporal patterns. Given their black-box nature however, and…

Geophysics · Physics 2022-09-07 Antonios Mamalakis , Elizabeth A. Barnes , Imme Ebert-Uphoff

Saliency Map, the gradient of the score function with respect to the input, is the most basic technique for interpreting deep neural network decisions. However, saliency maps are often visually noisy. Although several hypotheses were…

Machine Learning · Computer Science 2019-09-17 Beomsu Kim , Junghoon Seo , SeungHyun Jeon , Jamyoung Koo , Jeongyeol Choe , Taegyun Jeon

Planet-scale photo geolocalization is the complex task of estimating the location depicted in an image solely based on its visual content. Due to the success of convolutional neural networks (CNNs), current approaches achieve super-human…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Jonas Theiner , Eric Mueller-Budack , Ralph Ewerth

It is well established that neural networks are vulnerable to adversarial examples, which are almost imperceptible on human vision and can cause the deep models misbehave. Such phenomenon may lead to severely inestimable consequences in the…

Machine Learning · Computer Science 2020-09-09 Dengpan Ye , Chuanxi Chen , Changrui Liu , Hao Wang , Shunzhi Jiang

Deep learning dominates image classification tasks, yet understanding how models arrive at predictions remains a challenge. Much research focuses on local explanations of individual predictions, such as saliency maps, which visualise the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 James Hinns , David Martens

Saliency methods can make deep neural network predictions more interpretable by identifying a set of critical features in an input sample, such as pixels that contribute most strongly to a prediction made by an image classifier.…

Machine Learning · Computer Science 2021-06-15 Yang Lu , Wenbo Guo , Xinyu Xing , William Stafford Noble