English
Related papers

Related papers: Utilizing Mutations to Evaluate Interpretability o…

200 papers

Attribution methods are an easy to use tool for investigating and validating machine learning models. Multiple methods have been suggested in the literature and it is not yet clear which method is most suitable for a given task. In this…

Image and Video Processing · Electrical Eng. & Systems 2019-09-20 Fabian Eitel , Kerstin Ritter

Numerous explanation methods have been recently developed to interpret the decisions made by deep neural network (DNN) models. For image classifiers, these methods typically provide an attribution score to each pixel in the image to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Ruo Yang , Binghui Wang , Mustafa Bilgic

Thanks to rapidly evolving sequencing techniques, the amount of genomic data at our disposal is growing increasingly large. Determining the gene structure is a fundamental requirement to effectively interpret gene function and regulation.…

Genomics · Quantitative Biology 2017-11-28 Jasper Zuallaert , Mijung Kim , Yvan Saeys , Wesley De Neve

Explaining recommendations enables users to understand whether recommended items are relevant to their needs and has been shown to increase their trust in the system. More generally, if designing explainable machine learning models is key…

Machine Learning · Computer Science 2020-08-27 Darius Afchar , Romain Hennequin

Within the last decade, neural network based predictors have demonstrated impressive - and at times super-human - capabilities. This performance is often paid for with an intransparent prediction process and thus has sparked numerous…

In recent years, artificial intelligence (AI) systems have come to the forefront. These systems, mostly based on Deep learning (DL), achieve excellent results in areas such as image processing, natural language processing, or speech…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Frantisek Sefcik , Wanda Benesova

Recent technological advancements have led to a large number of patents in a diverse range of domains, making it challenging for human experts to analyze and manage. State-of-the-art methods for multi-label patent classification rely on…

Artificial Intelligence · Computer Science 2024-07-30 Md Shajalal , Sebastian Denef , Md. Rezaul Karim , Alexander Boden , Gunnar Stevens

Deep neural networks (DNNs) demonstrate outstanding performance across most computer vision tasks. Some critical applications, such as autonomous driving or medical imaging, also require investigation into their behavior and the reasons…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Edouard Yvinec , Arnaud Dapogny , Kevin Bailly , Xavier Fischer

The development of effective explainability tools for Transformers is a crucial pursuit in deep learning research. One of the most promising approaches in this domain is Layer-wise Relevance Propagation (LRP), which propagates relevance…

Machine Learning · Computer Science 2025-06-04 Yarden Bakish , Itamar Zimerman , Hila Chefer , Lior Wolf

As interpretability has been pointed out as the obstacle to the adoption of Deep Neural Networks (DNNs), there is an increasing interest in solving a transparency issue to guarantee the impressive performance. In this paper, we demonstrate…

Image and Video Processing · Electrical Eng. & Systems 2021-07-20 Woo-Jeoung Nam , Seong-Whan Lee

Deep Neural Networks (DNNs) have demonstrated impressive performance in complex machine learning tasks such as image classification or speech recognition. However, due to their multi-layer nonlinear structure, they are not transparent,…

Computer Vision and Pattern Recognition · Computer Science 2015-09-22 Wojciech Samek , Alexander Binder , Grégoire Montavon , Sebastian Bach , Klaus-Robert Müller

DeConvNet, Guided BackProp, LRP, were invented to better understand deep neural networks. We show that these methods do not produce the theoretically correct explanation for a linear model. Yet they are used on multi-layer networks with…

Transformer-based models excel in various natural language processing (NLP) tasks, attracting countless efforts to explain their inner workings. Prior methods explain Transformers by focusing on the raw gradient and attention as token…

Computation and Language · Computer Science 2024-01-29 Linxin Song , Yan Cui , Ao Luo , Freddy Lecue , Irene Li

Trust and credibility in machine learning models is bolstered by the ability of a model to explain itsdecisions. While explainability of deep learning models is a well-known challenge, a further chal-lenge is clarity of the explanation…

Machine Learning · Computer Science 2020-11-30 hsan Ullah , Andre Rios , Vaibhav Gala , Susan Mckeever

Informative data selection is a key requirement for large language models (LLMs) to minimize the amount of data required for fine-tuning, network distillation, and token pruning, enabling fast and efficient deployment, especially under…

Machine Learning · Computer Science 2026-02-03 Ahmad Sarlak , Abolfazl Razi

To solve ever more complex problems, Deep Neural Networks are scaled to billions of parameters, leading to huge computational costs. An effective approach to reduce computational requirements and increase efficiency is to prune unnecessary…

Recently, a technique called Layer-wise Relevance Propagation (LRP) was shown to deliver insightful explanations in the form of input space relevances for understanding feed-forward neural network classification decisions. In the present…

Computation and Language · Computer Science 2017-08-08 Leila Arras , Grégoire Montavon , Klaus-Robert Müller , Wojciech Samek

In recent years, neural networks have demonstrated their remarkable ability to discern intricate patterns and relationships from raw data. However, understanding the inner workings of these black box models remains challenging, yet crucial…

Machine Learning · Statistics 2024-04-18 Niklas Koenen , Marvin N. Wright

Convolutional neural networks (CNNs) underpin many modern computer vision systems. With applications ranging from common to critical areas, a need to explain and understand the model and its decisions (XAI) emerged. Prior works suggest that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Vojtěch Kůr , Adam Bajger , Adam Kukučka , Marek Hradil , Vít Musil , Tomáš Brázdil

Most techniques for explainable machine learning focus on feature attribution, i.e., values are assigned to the features such that their sum equals the prediction. Example attribution is another form of explanation that assigns weights to…

Machine Learning · Computer Science 2025-02-28 Genghua Dong , Henrik Boström , Michalis Vazirgiannis , Roman Bresson