English
Related papers

Related papers: Transforming gradient-based techniques into interp…

200 papers

We present Gradient Activation Maps (GAM) - a machinery for explaining predictions made by visual similarity and classification models. By gleaning localized gradient and activation information from multiple network layers, GAM offers…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Oren Barkan , Omri Armstrong , Amir Hertz , Avi Caciularu , Ori Katz , Itzik Malkiel , Noam Koenigstein

Explainable Artificial Intelligence (XAI) techniques, such as Gradient-weighted Class Activation Mapping (Grad-CAM), have become indispensable for visualizing the reasoning process of deep neural networks in medical image analysis. Despite…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Teerapong Panboonyuen

Disentangled representation learning has recently attracted a significant amount of attention, particularly in the field of image representation learning. However, learning the disentangled representations behind a graph remains largely…

Machine Learning · Computer Science 2020-06-11 Xiaojie Guo , Liang Zhao , Zhao Qin , Lingfei Wu , Amarda Shehu , Yanfang Ye

CAM-based methods are widely-used post-hoc interpretability method that produce a saliency map to explain the decision of an image classification model. The saliency map highlights the important areas of the image relevant to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Magamed Taimeskhanov , Ronan Sicre , Damien Garreau

Graph Neural Networks (GNNs), which aggregate features from neighbors, are widely used for graph-structured data processing due to their powerful representation learning capabilities. It is generally believed that GNNs can implicitly remove…

Machine Learning · Computer Science 2022-09-30 Songtao Liu , Rex Ying , Hanze Dong , Lu Lin , Jinghui Chen , Dinghao Wu

Gradient-based analysis methods, such as saliency map visualizations and adversarial input perturbations, have found widespread use in interpreting neural NLP models due to their simplicity, flexibility, and most importantly, their…

Computation and Language · Computer Science 2020-10-13 Junlin Wang , Jens Tuyls , Eric Wallace , Sameer Singh

Computer-generated graphics (CGs) are images generated by computer software. The~rapid development of computer graphics technologies has made it easier to generate photorealistic computer graphics, and these graphics are quite difficult to…

Multimedia · Computer Science 2018-04-26 Ye Yao , Weitong Hu , Wei Zhang , Ting Wu , Yun-Qing Shi

In the wake of a fabricated explosion image at the Pentagon, an ability to discern real images from fake counterparts has never been more critical. Our study introduces a novel multi-modal approach to detect AI-generated images amidst the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Inzamamul Alam , Muhammad Shahid Muneer , Simon S. Woo

In this paper two new learning-based eXplainable AI (XAI) methods for deep convolutional neural network (DCNN) image classifiers, called L-CAM-Fm and L-CAM-Img, are proposed. Both methods use an attention mechanism that is inserted in the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Ioanna Gkartzonika , Nikolaos Gkalelis , Vasileios Mezaris

Graph learning has rapidly evolved into a critical subfield of machine learning and artificial intelligence (AI). Its development began with early graph-theoretic methods, gaining significant momentum with the advent of graph neural…

Machine Learning · Computer Science 2025-11-10 Feng Xia , Ciyuan Peng , Jing Ren , Falih Gozi Febrinanto , Renqiang Luo , Vidya Saikrishna , Shuo Yu , Xiangjie Kong

This paper presents a methodology for image classification using Graph Neural Network (GNN) models. We transform the input images into region adjacency graphs (RAGs), in which regions are superpixels and edges connect neighboring…

Machine Learning · Computer Science 2020-11-17 Pedro H. C. Avelar , Anderson R. Tavares , Thiago L. T. da Silveira , Cláudio R. Jung , Luís C. Lamb

Convolutional neural networks (CNNs) achieve prevailing results in segmentation tasks nowadays and represent the state-of-the-art for image-based analysis. However, the understanding of the accurate decision-making process of a CNN is…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Tillmann Rheude , Andreas Wirtz , Arjan Kuijper , Stefan Wesarg

Deep Neural Networks (DNNs) are widely used for decision making in a myriad of critical applications, ranging from medical to societal and even judicial. Given the importance of these decisions, it is crucial for us to be able to interpret…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Teddy Koker , Fatemehsadat Mireshghallah , Tom Titcombe , Georgios Kaissis

Graph Neural Networks (GNNs) have emerged as a prominent framework for graph mining, leading to significant advances across various domains. Stemmed from the node-wise representations of GNNs, existing explanation studies have embraced the…

Machine Learning · Computer Science 2024-07-03 Yuwen Wang , Shunyu Liu , Tongya Zheng , Kaixuan Chen , Mingli Song

Medical ultrasound video analysis is challenging due to variable sequence lengths, subtle spatial cues, and the need for interpretable video-level assessment. We introduce GADA, a Graph Attention-based Detection Aggregation framework that…

Image and Video Processing · Electrical Eng. & Systems 2025-10-14 Li Chen , Naveen Balaraju , Jochen Kruecker , Balasundar Raju , Alvin Chen

While eXplainable AI (XAI) has advanced significantly, few methods address interpretability in embedded vector spaces where dimensions represent complex abstractions. We introduce Distance Explainer, a novel method for generating local,…

Machine Learning · Computer Science 2026-03-26 Christiaan Meijer , E. G. Patrick Bos

Explainable artificial intelligence (XAI) is an important area in the AI community, and interpretability is crucial for building robust and trustworthy AI models. While previous work has explored model-level and instance-level explainable…

Machine Learning · Computer Science 2025-12-05 Xudong Wang , Ziheng Sun , Chris Ding , Jicong Fan

This paper investigates the recently emerged problem of Language-assisted Image Clustering (LaIC), where textual semantics are leveraged to improve the discriminability of visual representations to facilitate image clustering. Due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Bo Peng , Jie Lu , Guangquan Zhang , Zhen Fang

This paper investigates the integration of graph neural networks (GNNs) with Qualitative Explainable Graphs (QXGs) for scene understanding in automated driving. Scene understanding is the basis for any further reactive or proactive…

Robotics · Computer Science 2025-04-18 Nassim Belmecheri , Arnaud Gotlieb , Nadjib Lazaar , Helge Spieker

Multimodal tabular-image fusion is an emerging task that has received increasing attention in various domains. However, existing methods may be hindered by gradient conflicts between modalities, misleading the optimization of the unimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Longfei Huang , Yang Yang