English
Related papers

Related papers: Shapley-Inspired Feature Weighting in $k$-means wi…

200 papers

The SHAP (short for Shapley additive explanation) framework has become an essential tool for attributing importance to variables in predictive tasks. In model-agnostic settings, SHAP uses the concept of Shapley values from cooperative game…

Machine Learning · Statistics 2026-02-12 Justin Whitehouse , Ayush Sawarni , Vasilis Syrgkanis

Feature selection is one of the most relevant processes in any methodology for creating a statistical learning model. Usually, existing algorithms establish some criterion to select the most influential variables, discarding those that do…

Machine Learning · Statistics 2024-05-10 Carlos Sebastián , Carlos E. González-Guillén

SHAP (SHapley Additive exPlanations) has become a popular method to attribute the prediction of a machine learning model on an input to its features. One main challenge of SHAP is the computation time. An exact computation of Shapley values…

Machine Learning · Statistics 2023-09-06 Linwei Hu , Ke Wang

Clustering is a widely used and powerful machine learning technique, but its effectiveness is often limited by the need to specify the number of clusters, k, or by relying on thresholds that implicitly determine k. We introduce k*-means, a…

Machine Learning · Computer Science 2025-05-20 Louis Mahon , Mirella Lapata

While K-means is known to be a standard clustering algorithm, its performance may be compromised due to the presence of outliers and high-dimensional noisy variables. This paper proposes adaptively robust and sparse K-means clustering…

Computation · Statistics 2024-11-08 Hao Li , Shonosuke Sugasawa , Shota Katayama

Mean shift is a simple interactive procedure that gradually shifts data points towards the mode which denotes the highest density of data points in the region. Mean shift algorithms have been effectively used for data denoising, mode…

Machine Learning · Computer Science 2021-05-11 Saptarshi Chakraborty , Debolina Paul , Swagatam Das

Shapley values have emerged as a critical tool for explaining which features impact the decisions made by machine learning models. However, computing exact Shapley values is difficult, generally requiring an exponential (in the feature…

Shapley values has established itself as one of the most appropriate and theoretically sound frameworks for explaining predictions from complex machine learning models. The popularity of Shapley values in the explanation setting is probably…

Machine Learning · Statistics 2021-06-24 Martin Jullum , Annabelle Redelmeier , Kjersti Aas

Shapley values have seen widespread use in machine learning as a way to explain model predictions and estimate the importance of covariates. Accurately explaining models is critical in real-world models to both aid in decision making and to…

Machine Learning · Statistics 2024-08-19 Daniel de Marchi , Michael Kosorok , Scott de Marchi

Game-theoretic formulations of feature importance have become popular as a way to "explain" machine learning models. These methods define a cooperative game between the features of a model and distribute influence among these input elements…

Artificial Intelligence · Computer Science 2020-07-01 I. Elizabeth Kumar , Suresh Venkatasubramanian , Carlos Scheidegger , Sorelle Friedler

Note that a newer expanded version of this paper is now available at: arXiv:1802.03888 It is critical in many applications to understand what features are important for a model, and why individual predictions were made. For tree ensemble…

Artificial Intelligence · Computer Science 2018-02-20 Scott M. Lundberg , Su-In Lee

Shapley value is a classic notion from game theory, historically used to quantify the contributions of individuals within groups, and more recently applied to assign values to data points when training machine learning models. Despite its…

Machine Learning · Computer Science 2020-02-28 Amirata Ghorbani , Michael P. Kim , James Zou

Shapley effects are attracting increasing attention as sensitivity measures. When the value function is the conditional variance, they account for the individual and higher order effects of a model input. They are also well defined under…

Computation · Statistics 2021-10-13 Elmar Plischke , Giovanni Rabitti , Emanuele Borgonovo

We study the topic of dimensionality reduction for $k$-means clustering. Dimensionality reduction encompasses the union of two approaches: \emph{feature selection} and \emph{feature extraction}. A feature selection based algorithm for…

Data Structures and Algorithms · Computer Science 2015-03-19 Christos Boutsidis , Anastasios Zouzias , Michael W. Mahoney , Petros Drineas

We propose and study a framework for quantifying the importance of the choices of parameter values to the result of a query over a database. These parameters occur as constants in logical queries, such as conjunctive queries. In our…

Databases · Computer Science 2024-11-19 Amir Gilad , Martin Grohe , Benny Kimelfeld , Peter Lindner , Christoph Standke

Estimating feature importance is a significant aspect of explaining data-based models. Besides explaining the model itself, an equally relevant question is which features are important in the underlying data generating process. We present a…

Machine Learning · Computer Science 2021-09-21 Pål Vegard Johnsen , Inga Strümke , Signe Riemer-Sørensen , Andrew Thomas DeWan , Mette Langaas

Even though Shapley value provides an effective explanation for a DNN model prediction, the computation relies on the enumeration of all possible input feature coalitions, which leads to the exponentially growing complexity. To address this…

Machine Learning · Computer Science 2023-03-07 Guanchu Wang , Yu-Neng Chuang , Mengnan Du , Fan Yang , Quan Zhou , Pushkar Tripathi , Xuanting Cai , Xia Hu

When using machine learning techniques in decision-making processes, the interpretability of the models is important. In the present paper, we adopted the Shapley additive explanation (SHAP), which is based on fair profit allocation among…

Machine Learning · Computer Science 2022-03-03 Yasunobu Nohara , Koutarou Matsumoto , Hidehisa Soejima , Naoki Nakashima

This paper proposes a novel approach to explain the predictions made by data-driven methods. Since such predictions rely heavily on the data used for training, explanations that convey information about how the training data affects the…

Machine Learning · Statistics 2022-12-09 Andreas Brandsæter , Ingrid K. Glad

Shapley values are widely used for model-agnostic data valuation and feature attribution, yet they implicitly assume contributors are interchangeable. This can be problematic when contributors are dependent (e.g., reused/augmented data or…

Machine Learning · Computer Science 2026-02-11 Kiljae Lee , Ziqi Liu , Weijing Tang , Yuan Zhang