English
Related papers

Related papers: Semantically Interpretable Activation Maps: what-w…

200 papers

We consider the problem of explaining the decisions of deep neural networks for image recognition in terms of human-recognizable visual concepts. In particular, given a test set of images, we aim to explain each classification in terms of a…

Machine Learning · Computer Science 2018-12-21 Mandana Hamidi-Haines , Zhongang Qi , Alan Fern , Fuxin Li , Prasad Tadepalli

In many scientific research fields, understanding and visualizing a black-box function in terms of the effects of all the input variables is of great importance. Existing visualization tools do not allow one to visualize the effects of all…

Machine Learning · Computer Science 2023-03-08 Shengtong Zhang , Daniel W. Apley

Despite neural networks (NN) have been widely applied in various fields and generally outperforms humans, they still lack interpretability to a certain extent, and humans are unable to intuitively understand the decision logic of NN. This…

Human-Computer Interaction · Computer Science 2024-01-12 Zhanliang He , Nuoye Xiong , Hongsheng Li , Peiyi Shen , Guangming Zhu , Liang Zhang

Explainable AI (XAI) has become essential in computer vision to make the decision-making processes of deep learning models transparent. However, current visual explanation (XAI) methods face a critical trade-off between the high fidelity of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Gwanghee Lee , Sungyoon Jeong , Kyoungson Jhang

Similarly to other connectionist models, Graph Neural Networks (GNNs) lack transparency in their decision-making. A number of sub-symbolic approaches have been developed to provide insights into the GNN decision making process. These are…

Artificial Intelligence · Computer Science 2021-12-06 Anna Himmelhuber , Stephan Grimm , Sonja Zillner , Mitchell Joblin , Martin Ringsquandl , Thomas Runkler

Our ability to interact with the world around us relies on being able to infer what actions objects afford -- often referred to as affordances. The neural mechanisms of object-action associations are realized in the visuomotor pathway where…

Neurons and Cognition · Quantitative Biology 2020-02-24 Aria Yuan Wang , Michael J. Tarr

Explainable AI (XAI) is crucial for building transparent and trustworthy machine learning systems, especially in high-stakes domains. Concept Bottleneck Models (CBMs) have emerged as a promising ante-hoc approach that provides…

Artificial Intelligence · Computer Science 2026-01-21 Hanwei Zhang , Luo Cheng , Rui Wen , Yang Zhang , Lijun Zhang , Holger Hermanns

This paper presents a method to explain the knowledge encoded in a convolutional neural network (CNN) quantitatively and semantically. The analysis of the specific rationale of each prediction made by the CNN presents a key issue of…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Runjin Chen , Hao Chen , Ge Huang , Jie Ren , Quanshi Zhang

Narrative sensemaking is an essential part of understanding sequential data. Narrative maps are a visual representation model that can assist analysts to understand narratives. In this work, we present a semantic interaction (SI) framework…

Human-Computer Interaction · Computer Science 2023-02-14 Brian Keith Norambuena , Tanushree Mitra , Chris North

The evaluation of explainable artificial intelligence is challenging, because automated and human-centred metrics of explanation quality may diverge. To clarify their relationship, we investigated whether human and artificial image…

Human-Computer Interaction · Computer Science 2024-08-20 Romy Müller , Marius Thoß , Julian Ullrich , Steffen Seitz , Carsten Knoll

Method: We develop CNN-based methods for automatic ICD coding based on clinical text from intensive care unit (ICU) stays. We come up with the Shallow and Wide Attention convolutional Mechanism (SWAM), which allows our model to learn local…

Computation and Language · Computer Science 2021-01-28 Shu Yuan Hu , Fei Teng

CNNs have excelled at performing place recognition over time, particularly when the neural network is optimized for localization in the current environmental conditions. In this paper we investigate the concept of feature map filtering,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Stephen Hausler , Adam Jacobson , Michael Milford

Convolutional neural networks (CNNs) have recently attracted great attention in geoscience due to their ability to capture non-linear system behavior and extract predictive spatiotemporal patterns. Given their black-box nature however, and…

Geophysics · Physics 2022-09-07 Antonios Mamalakis , Elizabeth A. Barnes , Imme Ebert-Uphoff

Visual interpretability of Convolutional Neural Networks (CNNs) has gained significant popularity because of the great challenges that CNN complexity imposes to understanding their inner workings. Although many techniques have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2021-02-01 Alexandros Stergiou

In the present paper we present the potential of Explainable Artificial Intelligence methods for decision-support in medical image analysis scenarios. With three types of explainable methods applied to the same medical image data set our…

Artificial Intelligence · Computer Science 2021-05-20 Samanta Knapič , Avleen Malhi , Rohit Saluja , Kary Främling

Convolutional neural networks (CNNs) have received increasing attention over the last few years. They were initially conceived for image categorization, i.e., the problem of assigning a semantic label to an entire input image. In this paper…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Emmanuel Maggiori , Yuliya Tarabalka , Guillaume Charpiat , Pierre Alliez

The intensity estimation of facial action units (AUs) is challenging due to subtle changes in the person's facial appearance. Previous approaches mainly rely on probabilistic models or predefined rules for modeling co-occurrence…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Yingruo Fan , Jacqueline C. K. Lam , Victor O. K. Li

Multispectral disparity estimation is a difficult task for many reasons: it has all the same challenges as traditional visible-visible disparity estimation (occlusions, repetitive patterns, textureless surfaces), in addition of having very…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 David-Alexandre Beaupre , Guillaume-Alexandre Bilodeau

Explainable AI is an emerging field providing solutions for acquiring insights into automated systems' rationale. It has been put on the AI map by suggesting ways to tackle key ethical and societal issues. Existing explanation techniques…

Machine Learning · Computer Science 2022-05-02 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

Deep neural networks have significantly improved the performance of low-level vision tasks but also increased the difficulty of interpretability. A deep understanding of deep models is beneficial for both network design and practical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Jinfan Hu , Jinjin Gu , Shiyao Yu , Fanghua Yu , Zheyuan Li , Zhiyuan You , Chaochao Lu , Chao Dong