English
Related papers

Related papers: Benchmarking Attribution Methods with Relative Fea…

200 papers

Feature attribution methods aim to improve the transparency of deep neural networks by identifying the input features that influence a model's decision. Pixel-based heatmaps have become the standard for attributing features to…

Machine Learning · Statistics 2025-06-06 Gabriel Kasmi , Amandine Brunetto , Thomas Fel , Jayneel Parekh

Generative machine learning models offer a powerful framework for therapeutic design by efficiently exploring large spaces of biological sequences enriched for desirable properties. Unlike supervised learning methods, which require both…

Despite the growing body of work in interpretable machine learning, it remains unclear how to evaluate different explainability methods without resorting to qualitative assessment and user-studies. While interpretability is an inherently…

Machine Learning · Computer Science 2020-07-16 An-phi Nguyen , María Rodríguez Martínez

As the capabilities of large-scale pre-trained models evolve, understanding the determinants of their outputs becomes more important. Feature attribution aims to reveal which parts of the input elements contribute the most to model outputs.…

Computation and Language · Computer Science 2025-05-23 Gaofei Shen , Hosein Mohebbi , Arianna Bisazza , Afra Alishahi , Grzegorz Chrupała

Attribution methods compute importance scores for input features to explain model predictions. However, assessing the faithfulness of these methods remains challenging due to the absence of attribution ground truth to model predictions. In…

Cryptography and Security · Computer Science 2025-10-02 Peiyu Yang , Naveed Akhtar , Jiantong Jiang , Ajmal Mian

Feature attribution is often loosely presented as the process of selecting a subset of relevant features as a rationale of a prediction. Task-dependent by nature, precise definitions of "relevance" encountered in the literature are however…

Machine Learning · Computer Science 2021-07-12 Darius Afchar , Romain Hennequin , Vincent Guigue

Feature attribution methods attempt to explain neural network predictions by identifying relevant features. However, establishing a cohesive framework for assessing feature attribution remains a challenge. There are several views through…

Machine Learning · Computer Science 2024-11-26 Yawei Li , Yang Zhang , Kenji Kawaguchi , Ashkan Khakzar , Bernd Bischl , Mina Rezaei

Interpretability is a crucial aspect of machine learning models that enables humans to understand and trust the decision-making process of these models. In many real-world applications, the interpretability of models is essential for legal,…

Machine Learning · Statistics 2023-07-18 Shree Charran R , Sandipan Das Mahapatra

Attribution-based explanations are garnering increasing attention recently and have emerged as the predominant approach towards \textit{eXplanable Artificial Intelligence}~(XAI). However, the absence of consistent configurations and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Jiarui Duan , Haoling Li , Haofei Zhang , Hao Jiang , Mengqi Xue , Li Sun , Mingli Song , Jie Song

In the field of artificial intelligence, AI models are frequently described as `black boxes' due to the obscurity of their internal mechanisms. It has ignited research interest on model interpretability, especially in attribution methods…

Machine Learning · Computer Science 2024-08-16 Zhiyu Zhu , Zhibo Jin , Jiayu Zhang , Huaming Chen

Complex machine learning algorithms are used more and more often in critical tasks involving text data, leading to the development of interpretability methods. Among local methods, two families have emerged: those computing importance…

Machine Learning · Computer Science 2025-10-22 Gianluigi Lopardo , Damien Garreau

The rapid advancement and widespread adoption of machine learning-driven technologies have underscored the practical and ethical need for creating interpretable artificial intelligence systems. Feature importance, a method that assigns…

Machine Learning · Computer Science 2023-12-07 Nimrod Harel , Uri Obolski , Ran Gilad-Bachrach

To explain predictions made by complex machine learning models, many feature attribution methods have been developed that assign importance scores to input features. Some recent work challenges the robustness of these methods by showing…

Machine Learning · Computer Science 2023-11-01 Chris Lin , Ian Covert , Su-In Lee

A common approach for feature selection is to examine the variable importance scores for a machine learning model, as a way to understand which features are the most relevant for making predictions. Given the significance of feature…

Machine Learning · Computer Science 2021-05-13 Jack Dunn , Luca Mingardi , Ying Daisy Zhuo

Most accurate predictions are typically obtained by learning machines with complex feature spaces (as e.g. induced by kernels). Unfortunately, such decision rules are hardly accessible to humans and cannot easily be used to gain insights…

Machine Learning · Statistics 2010-08-13 Alexander Zien , Nicole Kraemer , Soeren Sonnenburg , Gunnar Raetsch

Feature attribution methods (FAs) are popular approaches for providing insights into the model reasoning process of making predictions. The more faithful a FA is, the more accurately it reflects which parts of the input are more important…

Computation and Language · Computer Science 2024-01-31 Zhixue Zhao , Nikolaos Aletras

Feature attribution methods identify which features of an input most influence a model's output. Most widely-used feature attribution methods (such as SHAP, LIME, and Grad-CAM) are "class-dependent" methods in that they generate a feature…

Machine Learning · Computer Science 2023-02-28 Neil Jethani , Adriel Saporta , Rajesh Ranganath

Feature attribution aims to explain the reasoning behind a black-box model's prediction by identifying the impact of each feature on the prediction. Recent work has extended feature attribution to interactions between multiple features.…

Machine Learning · Computer Science 2023-05-17 Yifan Jiang , Shane Steinert-Threlkeld

Trustworthy answer content is abundant in many high-resource languages and is instantly accessible through question answering systems, yet this content can be hard to access for those that do not speak these languages. The leap forward in…

The black box problem in machine learning has led to the introduction of an ever-increasing set of explanation methods for complex models. These explanations have different properties, which in turn has led to the problem of method…

Machine Learning · Computer Science 2024-12-19 Arne Gevaert , Yvan Saeys