English
Related papers

Related papers: GRASP: group-Shapley feature selection for patient…

200 papers

Understanding why a model makes a certain prediction can be as crucial as the prediction's accuracy in many applications. However, the highest accuracy for large modern datasets is often achieved by complex models that even experts struggle…

Artificial Intelligence · Computer Science 2017-11-28 Scott Lundberg , Su-In Lee

Sparse modelling or model selection with categorical data is challenging even for a moderate number of variables, because one parameter is roughly needed to encode one category or level. The Group Lasso is a well known efficient algorithm…

Methodology · Statistics 2022-11-14 Szymon Nowakowski , Piotr Pokarowski , Wojciech Rejchel , Agnieszka Sołtys

Graph sparsification is a key technique for improving inference efficiency in Graph Neural Networks by removing edges with minimal impact on predictions. GNN explainability methods generate local importance scores, which can be aggregated…

Machine Learning · Computer Science 2025-07-29 Selahattin Akkas , Ariful Azad

Shapley value is a widely used tool in explainable artificial intelligence (XAI), as it provides a principled way to attribute contributions of input features to model outputs. However, estimation of Shapley value requires capturing…

Machine Learning · Computer Science 2025-11-05 Cheng Lu , Jiusun Zeng , Yu Xia , Jinhui Cai , Shihua Luo

Sparse prediction with categorical data is challenging even for a moderate number of variables, because one parameter is roughly needed to encode one category or level. The Group Lasso is a well known efficient algorithm for selection…

Methodology · Statistics 2021-12-22 Szymon Nowakowski , Piotr Pokarowski , Wojciech Rejchel

Machine and deep learning have grown in popularity and use in biological research over the last decade but still present challenges in interpretability of the fitted model. The development and use of metrics to determine features driving…

Machine Learning · Statistics 2025-07-31 Daniel Claborne , Javier Flores , Samantha Erwin , Luke Durell , Rachel Richardson , Ruby Fore , Lisa Bramer

Feature attribution for kernel methods is often heuristic and not individualised for each prediction. To address this, we turn to the concept of Shapley values~(SV), a coalition game theoretical framework that has previously been applied to…

Machine Learning · Statistics 2022-05-27 Siu Lun Chau , Robert Hu , Javier Gonzalez , Dino Sejdinovic

Learning meaningful graphs from data plays important roles in many data mining and machine learning tasks, such as data representation and analysis, dimension reduction, data clustering, and visualization, etc. In this work, for the first…

Machine Learning · Computer Science 2020-07-30 Yongyu Wang , Zhiqiang Zhao , Zhuo Feng

Machine learning with missing data has been approached in two different ways, including feature imputation where missing feature values are estimated based on observed values, and label prediction where downstream labels are learned…

Machine Learning · Computer Science 2020-11-02 Jiaxuan You , Xiaobai Ma , Daisy Yi Ding , Mykel Kochenderfer , Jure Leskovec

We revisit the use of probabilistic values, which include the well-known Shapley and Banzhaf values, to rank features for explaining the local predicted values of decision trees. The quality of feature rankings is typically assessed with…

Machine Learning · Computer Science 2026-04-22 Weida Li , Yaoliang Yu , Bryan Kian Hsiang Low

Feature selection is a crucial step in developing robust and powerful machine learning models. Feature selection techniques can be divided into two categories: filter and wrapper methods. While wrapper methods commonly result in strong…

Machine Learning · Computer Science 2022-07-07 Jarne Verhaeghe , Jeroen Van Der Donckt , Femke Ongenae , Sofie Van Hoecke

This paper addresses the multi-faceted problem of robot grasping, where multiple criteria may conflict and differ in importance. We introduce a probabilistic framework, Grasp Ranking and Criteria Evaluation (GRaCE), which employs…

Robotics · Computer Science 2024-05-30 Tasbolat Taunyazov , Kelvin Lin , Harold Soh

Existing feature attribution methods like SHAP often suffer from global dependence, failing to capture true local model behavior. This paper introduces VARSHAP, a novel model-agnostic local feature attribution method which uses the…

Machine Learning · Computer Science 2025-06-10 Mateusz Gajewski , Mikołaj Morzy , Adam Karczmarz , Piotr Sankowski

Despite their ubiquitous use, Shapley value feature attributions can be misleading due to feature interaction in both model and data. We propose an alternative attribution approach, Shapley Sets, which awards value to sets of features.…

Machine Learning · Computer Science 2023-07-06 Torty Sivill , Peter Flach

Shapley values are widely used for model-agnostic data valuation and feature attribution, yet they implicitly assume contributors are interchangeable. This can be problematic when contributors are dependent (e.g., reused/augmented data or…

Machine Learning · Computer Science 2026-02-11 Kiljae Lee , Ziqi Liu , Weijing Tang , Yuan Zhang

In the context of unsupervised learning, effective clustering plays a vital role in revealing patterns and insights from unlabeled data. However, the success of clustering algorithms often depends on the relevance and contribution of…

Machine Learning · Computer Science 2025-03-18 Fabian Galis , Darian Onchis

Shapley values have emerged as a critical tool for explaining which features impact the decisions made by machine learning models. However, computing exact Shapley values is difficult, generally requiring an exponential (in the feature…

Sorted L-One Penalized Estimation (SLOPE) is a relatively new convex optimization procedure which allows for adaptive selection of regressors under sparse high dimensional designs. Here we extend the idea of SLOPE to deal with the situation…

Methodology · Statistics 2016-10-18 Damian Brzyski , Alexej Gossmann , Weijie Su , Malgorzata Bogdan

One of the most important steps toward interpretability and explainability of neural network models is feature selection, which aims to identify the subset of relevant features. Theoretical results in the field have mostly focused on the…

Machine Learning · Computer Science 2020-10-19 Vu Dinh , Lam Si Tung Ho

Interpretable machine learning has emerged as central in leveraging artificial intelligence within high-stakes domains such as healthcare, where understanding the rationale behind model predictions is as critical as achieving high…

Machine Learning · Computer Science 2024-04-30 Christel Sirocchi , Martin Urschler , Bastian Pfeifer