English
Related papers

Related papers: From Heatmaps to Structural Explanations of Image …

200 papers

Deep Neural Networks (DNNs) are widely used for decision making in a myriad of critical applications, ranging from medical to societal and even judicial. Given the importance of these decisions, it is crucial for us to be able to interpret…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Teddy Koker , Fatemehsadat Mireshghallah , Tom Titcombe , Georgios Kaissis

The trustworthiness of neural networks is often challenged because they lack the ability to express uncertainty and explain their skill. This can be problematic given the increasing use of neural networks in high stakes decision-making such…

Atmospheric and Oceanic Physics · Physics 2022-12-07 Mariana C. A. Clare , Maike Sonnewald , Redouane Lguensat , Julie Deshayes , Venkatramani Balaji

Understanding why a neural network model makes certain decisions can be as important as the inference performance. Various methods have been proposed to help practitioners explain the prediction of a neural network model, of which Shapley…

Machine Learning · Computer Science 2023-10-04 Yong Zhao , Runxin He , Nicholas Kersting , Can Liu , Shubham Agrawal , Chiranjeet Chetia , Yu Gu

This paper presents a new state-of-the-art for document image classification and retrieval, using features learned by deep convolutional neural networks (CNNs). In object and scene analysis, deep neural nets are capable of learning a…

Computer Vision and Pattern Recognition · Computer Science 2015-02-26 Adam W. Harley , Alex Ufkes , Konstantinos G. Derpanis

Despite substantial progress in applying neural networks (NN) to a wide variety of areas, they still largely suffer from a lack of transparency and interpretability. While recent developments in explainable artificial intelligence attempt…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Yunhao Ge , Yao Xiao , Zhi Xu , Meng Zheng , Srikrishna Karanam , Terrence Chen , Laurent Itti , Ziyan Wu

Convolutional Neural Networks (CNNs) have become the state of the art method for image classification in the last ten years. Despite the fact that they achieve superhuman classification accuracy on many popular datasets, they often perform…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Sebastian Stabinger , Peer David , Justus Piater , Antonio Rodríguez-Sánchez

Higher-order interactions (HOIs) are ubiquitous in real-world complex systems and applications. Investigation of deep learning for HOIs, thus, has become a valuable agenda for the data mining and machine learning communities. As networks of…

Machine Learning · Computer Science 2024-07-26 Sunwoo Kim , Soo Yong Lee , Yue Gao , Alessia Antelmi , Mirko Polato , Kijung Shin

Neural networks are becoming increasingly better at tasks that involve classifying and recognizing images. At the same time techniques intended to explain the network output have been proposed. One such technique is the Gradient-based Class…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Mirtha Lucas , Miguel Lerma , Jacob Furst , Daniela Raicu

As machine learning systems increasingly inform critical decisions, the need for human-understandable explanations grows. Current evaluations of Explainable AI (XAI) often prioritize technical fidelity over cognitive accessibility which…

Human-Computer Interaction · Computer Science 2025-09-23 Tobias Labarta , Nhi Hoang , Katharina Weitz , Wojciech Samek , Sebastian Lapuschkin , Leander Weber

Existing explanation methods for image classification struggle to provide faithful and plausible explanations. This paper addresses this issue by proposing a post-hoc natural language explanation method that can be applied to any CNN-based…

Artificial Intelligence · Computer Science 2025-03-19 Adam Wojciechowski , Mateusz Lango , Ondrej Dusek

Fine-grained visual classification (FGVC) is challenging but more critical than traditional classification tasks. It requires distinguishing different subcategories with the inherently subtle intra-class object variations. Previous works…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Zhenhuan Huang , Xiaoyue Duan , Bo Zhao , Jinhu Lü , Baochang Zhang

Graph Neural Networks (GNNs) are a popular approach for predicting graph structured data. As GNNs tightly entangle the input graph into the neural network structure, common explainable AI approaches are not applicable. To a large extent,…

Graph Neural Networks (GNNs) achieve outstanding performance across graph-based tasks but remain difficult to interpret. In this paper, we revisit foundational assumptions underlying model-level explanation methods for GNNs, namely: (1)…

Machine Learning · Computer Science 2025-06-10 Hsiao-Ying Lu , Yiran Li , Ujwal Pratap Krishna Kaluvakolanu Thyagarajan , Kwan-Liu Ma

Graph Neural Networks (GNNs) are a powerful tool for machine learning on graphs.GNNs combine node feature information with the graph structure by recursively passing neural messages along edges of the input graph. However, incorporating…

Machine Learning · Computer Science 2019-11-15 Rex Ying , Dylan Bourgeois , Jiaxuan You , Marinka Zitnik , Jure Leskovec

While deep learning has led to huge progress in complex image classification tasks like ImageNet, unexpected failure modes, e.g. via spurious features, call into question how reliably these classifiers work in the wild. Furthermore, for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Maximilian Augustin , Yannic Neuhaus , Matthias Hein

One of the main challenges since the advancement of convolutional neural networks is how to connect the extracted feature map to the final classification layer. VGG models used two sets of fully connected layers for the classification part…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Mohammad Rahimzadeh , AmirAli Askari , Soroush Parvin , Elnaz Safi , Mohammad Reza Mohammadi

A particular class of Explainable AI (XAI) methods provide saliency maps to highlight part of the image a Convolutional Neural Network (CNN) model looks at to classify the image as a way to explain its working. These methods provide an…

Machine Learning · Computer Science 2021-06-25 Sam Zabdiel Sunder Samuel , Vidhya Kamakshi , Namrata Lodhi , Narayanan C Krishnan

Explaining predictions of deep neural networks (DNNs) is an important and nontrivial task. In this paper, we propose a practical approach to interpret decisions made by a DNN object detector that has fidelity comparable to state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Denis Gudovskiy , Alec Hodgkinson , Takuya Yamaguchi , Yasunori Ishii , Sotaro Tsukizawa

The explication of Convolutional Neural Networks (CNN) through xAI techniques often poses challenges in interpretation. The inherent complexity of input features, notably pixels extracted from images, engenders complex correlations.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Caroline Mazini Rodrigues , Nicolas Boutry , Laurent Najman

Deep learning has recently gained popularity in digital pathology due to its high prediction quality. However, the medical domain requires explanation and insight for a better understanding beyond standard quantitative performance…

Image and Video Processing · Electrical Eng. & Systems 2020-04-28 Miriam Hägele , Philipp Seegerer , Sebastian Lapuschkin , Michael Bockmayr , Wojciech Samek , Frederick Klauschen , Klaus-Robert Müller , Alexander Binder