English
Related papers

Related papers: ConceptExplainer: Interactive Explanation for Deep…

200 papers

Concept Bottleneck Models (CBMs) enhance the interpretability of neural networks by basing predictions on human-understandable concepts. However, current CBMs typically rely on concept sets extracted from large language models or extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Katharina Prasse , Patrick Knab , Sascha Marton , Christian Bartelt , Margret Keuper

The success of deep neural nets heavily relies on their ability to encode complex relations between their input and their output. While this property serves to fit the training data well, it also obscures the mechanism that drives…

Machine Learning · Computer Science 2021-12-10 Itai Gat , Guy Lorberbom , Idan Schwartz , Tamir Hazan

Graph Neural Networks (GNNs) resurge as a trending research subject owing to their impressive ability to capture representations from graph-structured data. However, the black-box nature of GNNs presents a significant challenge in terms of…

Machine Learning · Computer Science 2023-10-26 Tianchun Wang , Dongsheng Luo , Wei Cheng , Haifeng Chen , Xiang Zhang

Concept bottleneck models have been successfully used for explainable machine learning by encoding information within the model with a set of human-defined concepts. In the context of human-assisted or autonomous driving, explainability…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jessica Echterhoff , An Yan , Kyungtae Han , Amr Abdelraouf , Rohit Gupta , Julian McAuley

Although explainability is essential in the clinical diagnosis, most deep learning models still function as black boxes without elucidating their decision-making process. In this study, we investigate the explainable model development that…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Yunhe Gao , Difei Gu , Mu Zhou , Dimitris Metaxas

To date, most discoveries of network subcomponents that implement human-interpretable computations in deep vision models have involved close study of single units and large amounts of human labor. We explore scalable methods for extracting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Achyuta Rajaram , Neil Chowdhury , Antonio Torralba , Jacob Andreas , Sarah Schwettmann

Although neural models have achieved remarkable performance, they still encounter doubts due to the intransparency. To this end, model prediction explanation is attracting more and more attentions. However, current methods rarely…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yong Guan , Freddy Lecue , Jiaoyan Chen , Ru Li , Jeff Z. Pan

The popularity of Deep Learning for real-world applications is ever-growing. With the introduction of high performance hardware, applications are no longer limited to image recognition. With the introduction of more complex problems comes…

Machine Learning · Computer Science 2019-09-13 Liam Hiley , Alun Preece , Yulia Hicks

EXplainable AI (XAI) is an essential topic to improve human understanding of deep neural networks (DNNs) given their black-box internals. For computer vision tasks, mainstream pixel-based XAI methods explain DNN decisions by identifying…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Ao Sun , Pingchuan Ma , Yuanyuan Yuan , Shuai Wang

As applications of generative AI become mainstream, it is important to understand what generative models are capable of producing, and the extent to which one can predictably control their outputs. In this paper, we propose a visualization…

Human-Computer Interaction · Computer Science 2024-07-01 Sangwon Jeong , Mingwei Li , Matthew Berger , Shusen Liu

Transformer-based architectures have become the shared backbone of natural language processing and computer vision. However, understanding how these models operate remains challenging, particularly in vision settings, where images are…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Juan Manuel Hernandez , Mariana Fernandez-Espinosa , Denis Parra , Diego Gomez-Zara

Deep generative models like VAEs and diffusion models have advanced various generation tasks by leveraging latent variables to learn data distributions and generate high-quality samples. Despite the field of explainable AI making strides in…

Machine Learning · Computer Science 2025-12-22 Mengdan Zhu , Raasikh Kanjiani , Jiahui Lu , Andrew Choi , Qirui Ye , Liang Zhao

Concept Activation Vectors (CAVs) provide a powerful approach for interpreting deep neural networks by quantifying their sensitivity to human-defined concepts. However, when computed independently at different layers, CAVs often exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Zhenghao He , Sanchit Sinha , Guangzhi Xiong , Aidong Zhang

Recurrent Neural Networks (RNNs) have been widely used in Natural Language Processing (NLP) tasks given its superior performance on processing sequential data. However, it is challenging to interpret and debug RNNs due to the inherent…

Human-Computer Interaction · Computer Science 2023-03-06 Zhijie Wang , Yuheng Huang , Da Song , Lei Ma , Tianyi Zhang

Deep visual models are susceptible to adversarial perturbations to inputs. Although these signals are carefully crafted, they still appear noise-like patterns to humans. This observation has led to the argument that deep visual…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Naveed Akhtar , Muhammad A. A. K. Jalwana , Mohammed Bennamoun , Ajmal Mian

Nowadays, deep prediction models, especially graph neural networks, have a majorplace in critical applications. In such context, those models need to be highlyinterpretable or being explainable by humans, and at the societal scope, this…

Artificial Intelligence · Computer Science 2023-03-13 Adrien Raison , Pascal Bourdon , David Helbert

Convolutional neural networks (CNNs) are increasingly being used in critical systems, where robustness and alignment are crucial. In this context, the field of explainable artificial intelligence has proposed the generation of high-level…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Andres Felipe Posada-Moreno , Nikita Surya , Sebastian Trimpe

With the continue development of Convolutional Neural Networks (CNNs), there is a growing concern regarding representations that they encode internally. Analyzing these internal representations is referred to as model interpretation. While…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Hamed Behzadi-Khormouji , José Oramas

Deep neural networks have been well-known for their superb handling of various machine learning and artificial intelligence tasks. However, due to their over-parameterized black-box nature, it is often difficult to understand the prediction…

Machine Learning · Computer Science 2022-07-18 Xuhong Li , Haoyi Xiong , Xingjian Li , Xuanyu Wu , Xiao Zhang , Ji Liu , Jiang Bian , Dejing Dou

Explainable Artificial Intelligence has gained significant attention due to the widespread use of complex deep learning models in high-stake domains such as medicine, finance, and autonomous cars. However, different explanations often…

Artificial Intelligence · Computer Science 2024-04-17 Weronika Hryniewska-Guzik , Luca Longo , Przemysław Biecek