English
Related papers

Related papers: Interpretable Deep Neural Networks for Single-Tria…

200 papers

The ability of deep learning (DL) to improve the practice of medicine and its clinical outcomes faces a looming obstacle: model interpretation. Without description of how outputs are generated, a collaborating physician can neither resolve…

Machine Learning · Computer Science 2020-06-30 Christopher Snyder , Sriram Vishwanath

Deep Neural Networks (DNNs) are widely used for visual classification tasks, but their complex computation process and black-box nature hinder decision transparency and interpretability. Class activation maps (CAMs) and recent variants…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Townim Faisal Chowdhury , Kewen Liao , Vu Minh Hieu Phan , Minh-Son To , Yutong Xie , Kevin Hung , David Ross , Anton van den Hengel , Johan W. Verjans , Zhibin Liao

We implement a visual interpretability method Layer-wise Relevance Propagation (LRP) on top of 3D U-Net trained to perform lesion segmentation on the small dataset of multi-modal images provided by ISLES 2017 competition. We demonstrate…

Image and Video Processing · Electrical Eng. & Systems 2020-01-14 Erico Tjoa , Guo Heng , Lu Yuhao , Cuntai Guan

Emerging foundation models (FMs) in electroencephalography (EEG) promise a path to scale deep learning in diagnostics and brain-computer interfaces despite data scarcity, yet their opaque nature remains a barrier to wider adoption. We…

Artificial Intelligence · Computer Science 2026-05-18 Justus Meyer zu Bexten , Nico Scherf , Bogdan Franczyk , Simon M. Hofmann

This article summarizes a systematic review of the electroencephalography (EEG)-based cognitive workload (CWL) estimation. The focus of the article is twofold: identify the disparate experimental paradigms used for reliably eliciting…

Signal Processing · Electrical Eng. & Systems 2024-10-24 Vishnu KN , Cota Navin Gupta

Convolutional neural networks (CNNs) underpin many modern computer vision systems. With applications ranging from common to critical areas, a need to explain and understand the model and its decisions (XAI) emerged. Prior works suggest that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Vojtěch Kůr , Adam Bajger , Adam Kukučka , Marek Hradil , Vít Musil , Tomáš Brázdil

Nonlinear methods such as Deep Neural Networks (DNNs) are the gold standard for various challenging machine learning problems, e.g., image classification, natural language processing or human action recognition. Although these methods…

Machine Learning · Computer Science 2017-11-15 Grégoire Montavon , Sebastian Bach , Alexander Binder , Wojciech Samek , Klaus-Robert Müller

Even though deep neural networks (DNNs) achieve state-of-the-art results for a number of problems involving genomic data, getting DNNs to explain their decision-making process has been a major challenge due to their black-box nature. One…

Genomics · Quantitative Biology 2022-12-14 Utku Ozbulak , Solha Kang , Jasper Zuallaert , Stephen Depuydt , Joris Vankerschaver

Due to the powerful learning ability on high-rank and non-linear features, deep neural networks (DNNs) are being applied to data mining and machine learning in various fields, and exhibit higher discrimination performance than conventional…

Machine Learning · Computer Science 2023-02-21 Weiyu Guo , Zhijiang Yang , Shu Wu , Fu Chen

Graph Neural Networks (GNNs) are a popular approach for predicting graph structured data. As GNNs tightly entangle the input graph into the neural network structure, common explainable AI approaches are not applicable. To a large extent,…

Convolutional Neural Networks (CNN) have become state-of-the-art in the field of image classification. However, not everything is understood about their inner representations. This paper tackles the interpretability and explainability of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Brian Kenji Iwana , Ryohei Kuroki , Seiichi Uchida

The ubiquity of neural networks (NNs) in real-world applications, from healthcare to natural language processing, underscores their immense utility in capturing complex relationships within high-dimensional data. However, NNs come with…

Machine Learning · Computer Science 2024-07-08 Chang Yue , Niraj K. Jha

This manuscript proposes a novel methodology for developing an interpretable prediction model for irregular Electrocardiogram (ECG) classification, using features extracted by a 1-D Deconvolutional Neural Network (1-D DNN). Given the…

Applications · Statistics 2024-10-17 Giacomo Lancia , Cristian Spitoni

In recent years, deep neural networks have been applied to obtain high performance of prediction, classification, and pattern recognition. However, the weights in these deep neural networks are difficult to be explained. Although a linear…

Machine Learning · Computer Science 2020-05-08 Chi-Hua Chen

Recently, a technique called Layer-wise Relevance Propagation (LRP) was shown to deliver insightful explanations in the form of input space relevances for understanding feed-forward neural network classification decisions. In the present…

Computation and Language · Computer Science 2017-08-08 Leila Arras , Grégoire Montavon , Klaus-Robert Müller , Wojciech Samek

We present an application of the Layer-wise Relevance Propagation (LRP) algorithm to state of the art deep convolutional neural networks and Fisher Vector classifiers to compare the image perception and prediction strategies of both…

Computer Vision and Pattern Recognition · Computer Science 2016-04-05 Sebastian Bach , Alexander Binder , Klaus-Robert Müller , Wojciech Samek

Artificial neural networks (ANNs) are known to be powerful methods for many hard problems (e.g. image classification, speech recognition or time series prediction). However, these models tend to produce black-box results and are often…

Machine Learning · Computer Science 2022-11-17 Marco Landt-Hayen , Peer Kröger , Martin Claus , Willi Rath

Machine learning (ML) model explainability has received growing attention, especially in the area related to model risk and regulations. In this paper, we reviewed and compared some popular ML model explainability methodologies, especially…

Artificial Intelligence · Computer Science 2021-06-15 Shafie Gholizadeh , Nengfeng Zhou

Deep learning (DL) has proven to be an effective machine learning and computer vision technique. DL-based image segmentation, object recognition and classification will aid many in-situ Mars rover tasks such as path planning and artifact…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Daniel Lundstrom , Alexander Huyen , Arya Mevada , Kyongsik Yun , Thomas Lu

Deep neural networks (DNNs) are being increasingly used to make predictions from functional magnetic resonance imaging (fMRI) data. However, they are widely seen as uninterpretable "black boxes", as it can be difficult to discover what…

Machine Learning · Computer Science 2020-12-18 Patrick McClure , Dustin Moraczewski , Ka Chun Lam , Adam Thomas , Francisco Pereira