English
Related papers

Related papers: Shapley-Inspired Feature Weighting in $k$-means wi…

200 papers

Explaining AI systems is fundamental both to the development of high performing models and to the trust placed in them by their users. The Shapley framework for explainability has strength in its general applicability combined with its…

Machine Learning · Statistics 2021-12-21 Christopher Frye , Colin Rowat , Ilya Feige

Increasing the size of embedding layers has shown to be effective in improving the performance of recommendation models, yet gradually causing their sizes to exceed terabytes in industrial recommender systems, and hence the increase of…

Information Retrieval · Computer Science 2023-08-21 Beichuan Zhang , Chenggen Sun , Jianchao Tan , Xinjun Cai , Jun Zhao , Mengqi Miao , Kang Yin , Chengru Song , Na Mou , Yang Song

Measuring contributions is a classical problem in cooperative game theory where the Shapley value is the most well-known solution concept. In this paper, we establish the convergence property of the Shapley value in parametric Bayesian…

Machine Learning · Computer Science 2022-06-15 Lucas Agussurja , Xinyi Xu , Bryan Kian Hsiang Low

Unpacking and comprehending how black-box machine learning algorithms make decisions has been a persistent challenge for researchers and end-users. Explaining time-series predictive models is useful for clinical applications with high…

Machine Learning · Computer Science 2023-05-09 Amin Nayebi , Sindhu Tipirneni , Chandan K Reddy , Brandon Foreman , Vignesh Subbian

This paper introduces the shapr R package, a versatile tool for generating Shapley value-based prediction explanations for machine learning and statistical regression models. Moreover, the shaprpy Python library brings the core capabilities…

Machine Learning · Computer Science 2026-02-03 Martin Jullum , Lars Henry Berge Olsen , Jon Lachmann , Annabelle Redelmeier

The Shapley value has become popular in the Explainable AI (XAI) literature, thanks, to a large extent, to a solid theoretical foundation, including four "favourable and fair" axioms for attribution in transferable utility games. The…

Machine Learning · Computer Science 2021-02-23 Daniel Fryer , Inga Strümke , Hien Nguyen

Repository-level code completion benefits from retrieval-augmented generation (RAG). However, controlling cross-file evidence is difficult because chunk utility is often interaction-dependent: some snippets help only when paired with…

Software Engineering · Computer Science 2026-04-20 Yu Huo , Kun Zeng , Siyu Zhang , Yuquan Lu , Cheng Yang , Yifu Guo , Xiaoying Tang

Explainable AI~(XAI) methods such as SHAP can help discover feature attributions in black-box models. If the method reveals a significant attribution from a ``protected feature'' (e.g., gender, race) on the model output, the model is…

Machine Learning · Computer Science 2024-08-14 Jun Yuan , Aritra Dasgupta

We develop new algorithmic methods with provable guarantees for feature selection in regard to categorical data clustering. While feature selection is one of the most common approaches to reduce dimensionality in practice, most of the known…

Data Structures and Algorithms · Computer Science 2021-08-20 Sayan Bandyapadhyay , Fedor V. Fomin , Petr A. Golovach , Kirill Simonov

Estimating the number of clusters (K) is a critical and often difficult task in cluster analysis. Many methods have been proposed to estimate K, including some top performers using resampling approach. When performing cluster analysis in…

Methodology · Statistics 2019-09-05 Yujia Li , Xiangrui Zeng , Chien-Wei Lin , George Tseng

In this paper, the traditional k-modes clustering algorithm is extended by weighting attribute value matches in dissimilarity computation. The use of attribute value weighting technique makes it possible to generate clusters with stronger…

Artificial Intelligence · Computer Science 2007-05-23 Zengyou He , Xaiofei Xu , Shengchun Deng

Bayesian models offer great flexibility for clustering applications---Bayesian nonparametrics can be used for modeling infinite mixtures, and hierarchical Bayesian models can be utilized for sharing clusters across multiple data sets. For…

Machine Learning · Computer Science 2012-06-15 Brian Kulis , Michael I. Jordan

Interpretability of learning algorithms is crucial for applications involving critical decisions, and variable importance is one of the main interpretation tools. Shapley effects are now widely used to interpret both tree ensembles and…

Machine Learning · Statistics 2022-02-03 Clément Bénard , Gérard Biau , Sébastien da Veiga , Erwan Scornet

In this article, we provide an axiomatic characterization of feature attribution for multi-output predictors within the Shapley framework. While SHAP explanations are routinely computed independently for each output coordinate, the…

Feature selection is a critical step in data-driven applications, reducing input dimensionality to enhance learning accuracy, computational efficiency, and interpretability. Existing state-of-the-art methods often require post-selection…

Machine Learning · Computer Science 2025-08-18 Pedram Pad , Hadi Hammoud , Mohamad Dia , Nadim Maamari , L. Andrea Dunbar

We introduce the aggregated clustering problem, where one is given $T$ instances of a center-based clustering task over the same $n$ points, but under different metrics. The goal is to open $k$ centers to minimize an aggregate of the…

Data Structures and Algorithms · Computer Science 2025-10-10 Deeparnab Chakrabarty , Jonathan Conroy , Ankita Sarkar

Graph-based clustering methods like spectral clustering and SpectralNet are very efficient in detecting clusters of non-convex shapes. Unlike the popular $k$-means, graph-based clustering methods do not assume that each cluster has a single…

Machine Learning · Computer Science 2023-02-28 Mashaan Alshammari , John Stavrakakis , Masahiro Takatsuka

We analyze an algorithm for assigning weights prior to scalarization in discrete multi-objective problems arising from data analysis. The algorithm evolves weights (interpreted as the relevance of features) by a replicator-type dynamic on…

Optimization and Control · Mathematics 2026-05-08 Aris Daniilidis , Alberto Domínguez Corella , Philipp Wissgott

The analysis of continously larger datasets is a task of major importance in a wide variety of scientific fields. In this sense, cluster analysis algorithms are a key element of exploratory data analysis, due to their easiness in the…

Machine Learning · Statistics 2018-01-10 Marco Capó , Aritz Pérez , Jose A. Lozano

The Shapley value is one of the most widely used measures of feature importance partly as it measures a feature's average effect on a model's prediction. We introduce joint Shapley values, which directly extend Shapley's axioms and…

Machine Learning · Statistics 2022-02-11 Chris Harris , Richard Pymar , Colin Rowat