中文
相关论文

相关论文: How to safely discard features based on aggregate …

200 篇论文

Interpreting predictions from tree ensemble methods such as gradient boosting machines and random forests is important, yet feature attribution for trees is often heuristic and not individualized for each prediction. Here we show that…

机器学习 · 计算机科学 2019-03-08 Scott M. Lundberg , Gabriel G. Erion , Su-In Lee

Feature selection is an essential process in machine learning, especially when dealing with high-dimensional datasets. It helps reduce the complexity of machine learning models, improve performance, mitigate overfitting, and decrease…

机器学习 · 计算机科学 2024-10-10 Egor Kraev , Baran Koseoglu , Luca Traverso , Mohammed Topiwalla

Despite their ubiquitous use, Shapley value feature attributions can be misleading due to feature interaction in both model and data. We propose an alternative attribution approach, Shapley Sets, which awards value to sets of features.…

机器学习 · 计算机科学 2023-07-06 Torty Sivill , Peter Flach

SHAP (SHapley Additive exPlanations) has become a popular method to attribute the prediction of a machine learning model on an input to its features. One main challenge of SHAP is the computation time. An exact computation of Shapley values…

机器学习 · 统计学 2023-09-06 Linwei Hu , Ke Wang

Shapley values have emerged as a widely accepted and trustworthy tool, grounded in theoretical axioms, for addressing challenges posed by black-box models like deep neural networks. However, computing Shapley values encounters exponential…

机器学习 · 计算机科学 2024-05-24 Borui Zhang , Baotong Tian , Wenzhao Zheng , Jie Zhou , Jiwen Lu

Kernel methods are widely used in machine learning and statistics for their flexibility and expressive power, yet their black-box nature limits adoption in high-stakes applications. Shapley value-based attribution methods such as SHAP, and…

机器学习 · 计算机科学 2026-05-08 Majid Mohammadi , Siu Lun Chau , Krikamol Muandet

Recently, several fast algorithms have been proposed to decompose predicted value into Shapley values, enabling individualized feature contribution analysis in tree models. While such local decomposition offers valuable insights, it…

机器学习 · 统计学 2025-05-28 Zhongli Jiang , Min Zhang , Dabao Zhang

Attribution scores reflect how important the feature values in an input entity are for the output of a machine learning model. One of the most popular attribution scores is the SHAP score, which is an instantiation of the general Shapley…

Shapley values have emerged as a central game-theoretic tool in explainable AI (XAI). However, computing Shapley values exactly requires $2^d$ game evaluations for a model with $d$ features. Lundberg and Lee's KernelSHAP algorithm has…

人工智能 · 计算机科学 2026-05-14 Fabian Fumagalli , R. Teal Witter , Christopher Musco

Ensemble-based modifications of the well-known SHapley Additive exPlanations (SHAP) method for the local explanation of a black-box model are proposed. The modifications aim to simplify SHAP which is computationally expensive when there is…

机器学习 · 计算机科学 2021-03-08 Lev V. Utkin , Andrei V. Konstantinov

SHAP explanations aim at identifying which features contribute the most to the difference in model prediction at a specific input versus a background distribution. Recent studies have shown that they can be manipulated by malicious…

机器学习 · 计算机科学 2023-03-06 Gabriel Laberge , Ulrich Aïvodji , Satoshi Hara , Mario Marchand. , Foutse Khomh

Shapley values has established itself as one of the most appropriate and theoretically sound frameworks for explaining predictions from complex machine learning models. The popularity of Shapley values in the explanation setting is probably…

机器学习 · 统计学 2021-06-24 Martin Jullum , Annabelle Redelmeier , Kjersti Aas

The increasing complexity of foundational models underscores the necessity for explainability, particularly for fine-tuning, the most widely used training method for adapting models to downstream tasks. Instance attribution, one type of…

机器学习 · 计算机科学 2024-06-10 Jingtan Wang , Xiaoqiang Lin , Rui Qiao , Chuan-Sheng Foo , Bryan Kian Hsiang Low

Numerous works propose post-hoc, model-agnostic explanations for learning to rank, focusing on ordering entities by their relevance to a query through feature attribution methods. However, these attributions often weakly correlate or…

信息检索 · 计算机科学 2025-02-25 Tanya Chowdhury , Yair Zick , James Allan

Note that a newer expanded version of this paper is now available at: arXiv:1802.03888 It is critical in many applications to understand what features are important for a model, and why individual predictions were made. For tree ensemble…

人工智能 · 计算机科学 2018-02-20 Scott M. Lundberg , Su-In Lee

The Shapley value concept from cooperative game theory has become a popular technique for interpreting ML models, but efficiently estimating these values remains challenging, particularly in the model-agnostic setting. Here, we revisit the…

机器学习 · 计算机科学 2021-04-26 Ian Covert , Su-In Lee

Transparency of Machine Learning models used for decision support in various industries becomes essential for ensuring their ethical use. To that end, feature attribution methods such as SHAP (SHapley Additive exPlanations) are widely used…

机器学习 · 计算机科学 2022-12-08 Anna Bogdanova , Akira Imakura , Tetsuya Sakurai , Tomoya Fujii , Teppei Sakamoto , Hiroyuki Abe

Shapley values have been used extensively in machine learning, not only to explain black box machine learning models, but among other tasks, also to conduct model debugging, sensitivity and fairness analyses and to select important features…

机器学习 · 计算机科学 2024-11-22 Iqbal Madakkatel , Elina Hyppönen

Many existing interpretation methods are based on Partial Dependence (PD) functions that, for a pre-trained machine learning model, capture how a subset of the features affects the predictions by averaging over the remaining features.…

机器学习 · 计算机科学 2025-06-05 Jinyang Liu , Tessa Steensgaard , Marvin N. Wright , Niklas Pfister , Munir Hiabu

The Shapley value is one of the most widely used measures of feature importance partly as it measures a feature's average effect on a model's prediction. We introduce joint Shapley values, which directly extend Shapley's axioms and…

机器学习 · 统计学 2022-02-11 Chris Harris , Richard Pymar , Colin Rowat