English
Related papers

Related papers: A Unified Taylor Framework for Revisiting Attribut…

200 papers

Feature attribution explains neural network outputs by identifying relevant input features. The attribution has to be faithful, meaning that the attributed features must mirror the input features that influence the output. One recent trend…

Machine Learning · Computer Science 2024-02-15 Yang Zhang , Yawei Li , Hannah Brown , Mina Rezaei , Bernd Bischl , Philip Torr , Ashkan Khakzar , Kenji Kawaguchi

A multitude of explainability methods and associated fidelity performance metrics have been proposed to help better understand how modern AI systems make decisions. However, much of the current work has remained theoretical -- without much…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Julien Colin , Thomas Fel , Remi Cadene , Thomas Serre

Interpretability is an important area of research for safe deployment of machine learning systems. One particular type of interpretability method attributes model decisions to input features. Despite active development, quantitative…

Machine Learning · Computer Science 2019-11-06 Mengjiao Yang , Been Kim

Data attribution methods, which quantify the influence of individual training data points on a machine learning model, have gained increasing popularity in data-centric applications in modern AI. Despite a recent surge of new methods…

Machine Learning · Computer Science 2025-10-24 Weiyi Wang , Junwei Deng , Yuzheng Hu , Shiyuan Zhang , Xirui Jiang , Runting Zhang , Han Zhao , Jiaqi W. Ma

Attribution methods compute importance scores for input features to explain model predictions. However, assessing the faithfulness of these methods remains challenging due to the absence of attribution ground truth to model predictions. In…

Cryptography and Security · Computer Science 2025-10-02 Peiyu Yang , Naveed Akhtar , Jiantong Jiang , Ajmal Mian

Data attribution methods aim to quantify the influence of individual training samples on the prediction of artificial intelligence (AI) models. As training data plays an increasingly crucial role in the modern development of large-scale AI…

Machine Learning · Computer Science 2024-10-08 Junwei Deng , Ting-Wei Li , Shiyuan Zhang , Shixuan Liu , Yijun Pan , Hao Huang , Xinhe Wang , Pingbang Hu , Xingjian Zhang , Jiaqi W. Ma

For machine learning models to be reliable and trustworthy, their decisions must be interpretable. As these models find increasing use in safety-critical applications, it is important that not just the model predictions but also their…

Machine Learning · Computer Science 2023-12-19 Sandesh Kamath , Sankalp Mittal , Amit Deshpande , Vineeth N Balasubramanian

The widespread use of Artificial Intelligence (AI) in consequential domains, such as healthcare and parole decision-making systems, has drawn intense scrutiny on the fairness of these methods. However, ensuring fairness is often…

Artificial Intelligence · Computer Science 2021-09-10 Ninareh Mehrabi , Umang Gupta , Fred Morstatter , Greg Ver Steeg , Aram Galstyan

Reliable models should not only predict correctly, but also justify decisions with acceptable evidence. Yet conventional supervised learning typically provides only class-level labels, allowing models to achieve high accuracy through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Ruoyu Chen , Shangquan Sun , Xiaoqing Guo , Sanyi Zhang , Kangwei Liu , Shiming Liu , Zhangcheng Wang , Qunli Zhang , Hua Zhang , Xiaochun Cao

Attribution methods explain neural network predictions by identifying influential input features, but their evaluation suffers from threshold selection bias that can reverse method rankings and undermine conclusions. Current protocols…

Machine Learning · Computer Science 2025-09-04 Serra Aksoy

Deep neural networks are very successful on many vision tasks, but hard to interpret due to their black box nature. To overcome this, various post-hoc attribution methods have been proposed to identify image regions most influential to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Sukrut Rao , Moritz Böhle , Bernt Schiele

Deep neural networks are very successful on many vision tasks, but hard to interpret due to their black box nature. To overcome this, various post-hoc attribution methods have been proposed to identify image regions most influential to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Sukrut Rao , Moritz Böhle , Bernt Schiele

We show that utilizing attribution maps for training neural networks can improve regularization of models and thus increase performance. Regularization is key in deep learning, especially when training complex models on relatively small…

Machine Learning · Computer Science 2022-05-31 Christian Tomani , Daniel Cremers

Widespread adoption of deep models has motivated a pressing need for approaches to interpret network outputs and to facilitate model debugging. Instance attribution methods constitute one means of accomplishing these goals by retrieving…

Computation and Language · Computer Science 2021-04-12 Pouya Pezeshkpour , Sarthak Jain , Byron C. Wallace , Sameer Singh

Attribution methods explain which input features drive a model's prediction, making them central to model debugging and mechanistic interpretability. Yet backward attribution methods, including gradients, LRP, and transformer-specific…

Machine Learning · Computer Science 2026-05-08 Jakob Paul Zimmermann , Jim Berend , Georg Loho , Sebastian Lapuschkin , Wojciech Samek

Feature attribution aims to explain the reasoning behind a black-box model's prediction by identifying the impact of each feature on the prediction. Recent work has extended feature attribution to interactions between multiple features.…

Machine Learning · Computer Science 2023-05-17 Yifan Jiang , Shane Steinert-Threlkeld

While SHAP (SHapley Additive exPlanations) and other feature attribution methods are commonly employed to explain model predictions, their application within information retrieval (IR), particularly for complex outputs such as ranked lists,…

Information Retrieval · Computer Science 2025-05-01 Maria Heuss , Maarten de Rijke , Avishek Anand

The study of the attribution of input features to the output of neural network models is an active area of research. While numerous Explainable AI (XAI) techniques have been proposed to interpret these models, the systematic and automated…

Computation and Language · Computer Science 2026-03-13 Aria Nourbakhsh , Salima Lamsiyah , Adelaide Danilov , Christoph Schommer

Deep learning provides a new avenue for image restoration, which demands a delicate balance between fine-grained details and high-level contextualized information during recovering the latent clear image. In practice, however, existing…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Man Zhou , Zeyu Xiao , Xueyang Fu , Aiping Liu , Gang Yang , Zhiwei Xiong

While large text-to-image models are able to synthesize "novel" images, these images are necessarily a reflection of the training data. The problem of data attribution in such models -- which of the images in the training set are most…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Sheng-Yu Wang , Alexei A. Efros , Jun-Yan Zhu , Richard Zhang