English
Related papers

Related papers: SAM: The Sensitivity of Attribution Methods to Hyp…

200 papers

We show that there may exist an inherent tension between the goal of adversarial robustness and that of standard generalization. Specifically, training robust models may not only be more resource-consuming, but also lead to a reduction of…

Machine Learning · Statistics 2019-09-10 Dimitris Tsipras , Shibani Santurkar , Logan Engstrom , Alexander Turner , Aleksander Madry

This work presents a new classifier that is specifically designed to be fully interpretable. This technique determines the probability of a class outcome, based directly on probability assignments measured from the training data. The…

Machine Learning · Statistics 2017-10-31 Sapan Agarwal , Corey M. Hudson

Despite the excelling performance of machine learning models, understanding their decisions remains a long-standing goal. Although commonly used attribution methods from explainable AI attempt to address this issue, they typically rely on…

Machine Learning · Computer Science 2025-11-20 Juan Miguel Lopez Alcaraz , Nils Strodthoff

Recent work uncovered potential flaws in \eg attribution or heatmap based saliency methods. A typical flaw is a confirmations bias, where the scores are compared to human expectation. Since measuring the quality of saliency methods is hard…

Machine Learning · Computer Science 2025-01-27 Leonid Schwenke , Martin Atzmueller

The increasing incorporation of Artificial Intelligence in the form of automated systems into decision-making procedures highlights not only the importance of decision theory for automated systems but also the need for these decision…

Artificial Intelligence · Computer Science 2018-08-23 Tarek R. Besold , Sara L. Uckelman

Attribution algorithms are essential for enhancing the interpretability and trustworthiness of deep learning models by identifying key features driving model decisions. Existing frameworks, such as InterpretDL and OmniXAI, integrate…

Machine Learning · Computer Science 2025-05-13 Zhiyu Zhu , Jiayu Zhang , Zhibo Jin , Fang Chen , Jianlong Zhou

Algorithmic fairness has aroused considerable interests in data mining and machine learning communities recently. So far the existing research has been mostly focusing on the development of quantitative metrics to measure algorithm…

Machine Learning · Computer Science 2021-08-12 Weishen Pan , Sen Cui , Jiang Bian , Changshui Zhang , Fei Wang

Data attribution methods aim to answer useful counterfactual questions like "what would a ML model's prediction be if it were trained on a different dataset?" However, estimation of data attribution models through techniques like empirical…

Machine Learning · Computer Science 2025-08-19 Ari Karchmer , Martin Pawelczyk , Seth Neel

While SHAP (SHapley Additive exPlanations) and other feature attribution methods are commonly employed to explain model predictions, their application within information retrieval (IR), particularly for complex outputs such as ranked lists,…

Information Retrieval · Computer Science 2025-05-01 Maria Heuss , Maarten de Rijke , Avishek Anand

The truthfulness of existing explanation methods in authentically elucidating the underlying model's decision-making process has been questioned. Existing methods have deviated from faithfully representing the model, thus susceptible to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Sangyu Han , Yearim Kim , Nojun Kwak

Selecting an optimizer is a central step in the contemporary deep learning pipeline. In this paper, we demonstrate the sensitivity of optimizer comparisons to the hyperparameter tuning protocol. Our findings suggest that the hyperparameter…

Machine Learning · Computer Science 2020-06-17 Dami Choi , Christopher J. Shallue , Zachary Nado , Jaehoon Lee , Chris J. Maddison , George E. Dahl

Feature attribution a.k.a. input salience methods which assign an importance score to a feature are abundant but may produce surprisingly different results for the same model on the same input. While differences are expected if disparate…

Computation and Language · Computer Science 2022-11-10 Jasmijn Bastings , Sebastian Ebert , Polina Zablotskaia , Anders Sandholm , Katja Filippova

Associative memory models are content-addressable memory systems fundamental to biological intelligence and are notable for their high interpretability. However, existing models evaluate the quality of retrieval based on proximity, which…

Machine Learning · Computer Science 2025-11-26 Shurong Wang , Yuqi Pan , Zhuoyang Shen , Meng Zhang , Hongwei Wang , Guoqi Li

AI explainability improves the transparency of models, making them more trustworthy. Such goals are motivated by the emergence of deep learning models, which are obscure by nature; even in the domain of images, where deep learning has…

Machine Learning · Computer Science 2022-03-01 Anna Arias-Duart , Ferran Parés , Dario Garcia-Gasulla , Victor Gimenez-Abalos

Subset selection-based methods are widely used to explain deep vision models: they attribute predictions by highlighting the most influential image regions and support object-level explanations. While these methods perform well in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Madhav Gupta , Vishak Prasad C , Ganesh Ramakrishnan

Learning algorithms need bias to generalize and perform better than random guessing. We examine the flexibility (expressivity) of biased algorithms. An expressive algorithm can adapt to changing training data, altering its outcome based on…

Machine Learning · Statistics 2019-11-13 Julius Lauw , Dominique Macias , Akshay Trikha , Julia Vendemiatti , George D. Montanez

Sampling is a common strategy for generating text from probabilistic models, yet standard ancestral sampling often results in text that is incoherent or ungrammatical. To alleviate this issue, various modifications to a model's sampling…

Computation and Language · Computer Science 2024-01-08 Clara Meister , Tiago Pimentel , Luca Malagutti , Ethan G. Wilcox , Ryan Cotterell

Large Language Models (LLMs) are becoming increasingly popular in pervasive computing due to their versatility and strong performance. However, despite their ubiquitous use, the exact mechanisms underlying their outstanding performance…

Computation and Language · Computer Science 2026-02-02 Alhassan Abdelhalim , Janick Edinger , Sören Laue , Michaela Regneri

Explainability has become a valuable tool in the last few years, helping humans better understand AI-guided decisions. However, the classic explainability tools are sometimes quite limited when considering high-dimensional inputs and neural…

Machine Learning · Computer Science 2023-11-23 Odelia Melamed , Rich Caruana

Interpreting the decisions of complex computer vision models is crucial to establish trust and accountability, especially in safety-critical domains. An established approach to interpretability is generating visual attribution maps that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 David Schinagl , Christian Fruhwirth-Reisinger , Alexander Prutsch , Samuel Schulter , Horst Possegger