English
Related papers

Related papers: GRAPHSHAP: Explaining Identity-Aware Graph Classif…

200 papers

Graph Neural Networks (GNNs) have achieved outstanding performance across a wide range of graph-related tasks. However, their "black-box" nature poses significant challenges to their explainability, and existing methods often fail to…

Machine Learning · Computer Science 2025-07-25 Lijun Wu , Dong Hao , Zhiyi Fan

Image classification is a primary task in data analysis where explainable models are crucially demanded in various applications. Although amounts of methods have been proposed to obtain explainable knowledge from the black-box classifiers,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Ruitao Xie , Jingbang Chen , Limai Jiang , Rui Xiao , Yi Pan , Yunpeng Cai

Existing tools for explaining the output of image classifiers can be divided into white-box, which rely on access to the model internals, and black-box, agnostic to the model. As the usage of AI in the medical domain grows, so too does the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Nathan Blake , Hana Chockler , David A. Kelly , Santiago Calderon Pena , Akchunya Chanchal

Integrated Gradients (IG) is a common explainability technique to address the black-box problem of neural networks. Integrated gradients assumes continuous data. Graphs are discrete structures making IG ill-suited to graphs. In this work,…

Machine Learning · Computer Science 2025-09-10 Lachlan Simpson , Kyle Millar , Adriel Cheng , Cheng-Chew Lim , Hong Gunn Chew

Many existing approaches for estimating feature importance are problematic because they ignore or hide dependencies among features. A causal graph, which encodes the relationships among input variables, can aid in assigning feature…

Machine Learning · Computer Science 2021-03-01 Jiaxuan Wang , Jenna Wiens , Scott Lundberg

Local explanation frameworks aim to rationalize particular decisions made by a black-box prediction model. Existing techniques are often restricted to a specific type of predictor or based on input saliency, which may be undesirably…

Machine Learning · Computer Science 2019-02-12 Brandon Carter , Jonas Mueller , Siddhartha Jain , David Gifford

Mining human-brain networks to discover patterns that can be used to discriminate between healthy individuals and patients affected by some neurological disorder, is a fundamental task in neuroscience. Learning simple and interpretable…

Social and Information Networks · Computer Science 2020-06-11 Tommaso Lanciano , Francesco Bonchi , Aristides Gionis

To harness the power of large language models in safety-critical domains, we need to ensure the explainability of their predictions. However, despite the significant attention to model interpretability, there remains an unexplored domain in…

Computation and Language · Computer Science 2024-06-04 Kenza Amara , Rita Sevastjanova , Mennatallah El-Assady

Despite significant advancements in causal research on graphs and its application to cracking label imbalance, the role of edge features in detecting the causal effects within graphs has been largely overlooked, leaving existing methods…

Machine Learning · Computer Science 2025-01-08 Fengrui Zhang , Yujia Yin , Hongzong Li , Yifan Chen , Tianyi Qu

The Shapley value is a prominent tool for interpreting black-box machine learning models thanks to its strong theoretical foundation. However, for models with structured inputs, such as graph neural networks, existing Shapley-based…

Machine Learning · Computer Science 2024-05-24 Ngoc Bui , Hieu Trung Nguyen , Viet Anh Nguyen , Rex Ying

Artificial Intelligence algorithms have now become pervasive in multiple high-stakes domains. However, their internal logic can be obscure to humans. Explainable Artificial Intelligence aims to design tools and techniques to illustrate the…

Human-Computer Interaction · Computer Science 2024-04-29 Eleonora Cappuccio , Daniele Fadda , Rosa Lanzilotti , Salvatore Rinzivillo

We investigate the problem of producing structured graph representations of visual scenes. Our work analyzes the role of motifs: regularly appearing substructures in scene graphs. We present new quantitative insights on such repeated…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Rowan Zellers , Mark Yatskar , Sam Thomson , Yejin Choi

Graph and network visualization supports exploration, analysis and communication of relational data arising in many domains: from biological and social networks, to transportation and powergrid systems. With the arrival of AI-based…

With the advent of larger and more complex deep learning models, such as in Natural Language Processing (NLP), model qualities like explainability and interpretability, albeit highly desirable, are becoming harder challenges to tackle and…

Computation and Language · Computer Science 2024-01-30 Amrita Bhattacharjee , Raha Moraffah , Joshua Garland , Huan Liu

Numerous social, medical, engineering and biological challenges can be framed as graph-based learning tasks. Here, we propose a new feature based approach to network classification. We show how dynamics on a network can be useful to reveal…

Machine Learning · Statistics 2017-06-01 Leonardo Gutierrez Gomez , Benjamin Chiem , Jean-Charles Delvenne

Explainability is crucial for the application of black-box Graph Neural Networks (GNNs) in critical fields such as healthcare, finance, cybersecurity, and more. Various feature attribution methods, especially the perturbation-based methods,…

Machine Learning · Computer Science 2024-12-31 Xingping Xian , Jianlu Liu , Chao Wang , Tao Wu , Shaojie Qiao , Xiaochuan Tang , Qun Liu

Real data collected from different applications that have additional topological structures and connection information are amenable to be represented as a weighted graph. Considering the node labeling problem, Graph Neural Networks (GNNs)…

Social and Information Networks · Computer Science 2020-02-06 Xiaoxiao Li , Joao Saude

Interpretability in Vision-Language Models (VLMs) is crucial for trust, debugging, and decision-making in high-stakes applications. We introduce PixelSHAP, a model-agnostic framework extending Shapley-based analysis to structured visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Roni Goldshmidt

Graph Neural Networks (GNNs) achieve outstanding performance across graph-based tasks but remain difficult to interpret. In this paper, we revisit foundational assumptions underlying model-level explanation methods for GNNs, namely: (1)…

Machine Learning · Computer Science 2025-06-10 Hsiao-Ying Lu , Yiran Li , Ujwal Pratap Krishna Kaluvakolanu Thyagarajan , Kwan-Liu Ma

Existing algorithms for explaining the outputs of image classifiers are based on a variety of approaches and produce explanations that frequently lack formal rigour. On the other hand, logic-based explanations are formally and rigorously…

Artificial Intelligence · Computer Science 2026-02-20 David A Kelly , Hana Chockler