English
Related papers

Related papers: LLpowershap: Logistic Loss-based Automated Shapley…

200 papers

The value and copyright of training data are crucial in the artificial intelligence industry. Service platforms should protect data providers' legitimate rights and fairly reward them for their contributions. Shapley value, a potent tool…

Machine Learning · Computer Science 2025-11-21 Haifeng Sun , Yu Xiong , Runze Wu , Xinyu Cai , Changjie Fan , Lan Zhang , Xiang-Yang Li

Feature attribution analysis is critical for interpreting machine learning models and supporting reliable data-driven decisions. However, feature attribution measures often exhibit stochastic variation: different train--test splits, random…

Machine Learning · Statistics 2026-05-15 Lanxin Xiang , Liang Shi , Youhui Ye , Boyu Jiang , Dawei Zhou , Feng Guo

Hyperparameter optimization (HPO) is a crucial step in achieving strong predictive performance. Yet, the impact of individual hyperparameters on model generalization is highly context-dependent, prohibiting a one-size-fits-all solution and…

Machine Learning · Computer Science 2025-11-11 Marcel Wever , Maximilian Muschalik , Fabian Fumagalli , Marius Lindauer

When using machine learning techniques in decision-making processes, the interpretability of the models is important. In the present paper, we adopted the Shapley additive explanation (SHAP), which is based on fair profit allocation among…

Machine Learning · Computer Science 2022-03-03 Yasunobu Nohara , Koutarou Matsumoto , Hidehisa Soejima , Naoki Nakashima

A common approach for feature selection is to examine the variable importance scores for a machine learning model, as a way to understand which features are the most relevant for making predictions. Given the significance of feature…

Machine Learning · Computer Science 2021-05-13 Jack Dunn , Luca Mingardi , Ying Daisy Zhuo

Recently, several fast algorithms have been proposed to decompose predicted value into Shapley values, enabling individualized feature contribution analysis in tree models. While such local decomposition offers valuable insights, it…

Machine Learning · Statistics 2025-05-28 Zhongli Jiang , Min Zhang , Dabao Zhang

Explainable artificial intelligence promises to yield insights into relevant features, thereby enabling humans to examine and scrutinize machine learning models or even facilitating scientific discovery. Considering the widespread technique…

Machine Learning · Computer Science 2026-03-30 Jörg Martin , Stefan Haufe

In this paper, we demonstrate a surprising capability of large language models (LLMs): given only input feature names and a description of a prediction task, they are capable of selecting the most predictive features, with performance…

Machine Learning · Computer Science 2025-04-21 Daniel P. Jeong , Zachary C. Lipton , Pradeep Ravikumar

Shapley values have become one of the go-to methods to explain complex models to end-users. They provide a model agnostic post-hoc explanation with foundations in game theory: what is the worth of a player (in machine learning, a feature…

Machine Learning · Computer Science 2023-06-21 Joran Michiels , Maarten De Vos , Johan Suykens

Shapley value and its priority-aware extensions are widely used for valuation in machine learning, but existing methods require pairwise priority to be binary and acyclic, a restriction spectacularly violated in real-data examples such as…

Machine Learning · Computer Science 2026-05-15 Kiljae Lee , Ziqi Liu , Weijing Tang , Yuan Zhang

Feature selection is crucial for pinpointing relevant features in high-dimensional datasets, mitigating the 'curse of dimensionality,' and enhancing machine learning performance. Traditional feature selection methods for classification use…

Machine Learning · Computer Science 2025-04-08 Rittwika Kansabanik , Adrian Barbu

Feature selection problems have been extensively studied for linear estimation, for instance, Lasso, but less emphasis has been placed on feature selection for non-linear functions. In this study, we propose a method for feature selection…

Machine Learning · Computer Science 2020-07-28 Yutaro Yamada , Ofir Lindenbaum , Sahand Negahban , Yuval Kluger

The purpose of partial multi-label feature selection is to select the most representative feature subset, where the data comes from partial multi-label datasets that have label ambiguity issues. For label disambiguation, previous methods…

Machine Learning · Computer Science 2025-03-14 Hanlin Pan , Kunpeng Liu , Wanfu Gao

Learning management systems (LMSs) have become essential in higher education and play an important role in helping educational institutions to promote student success. Traditionally, LMSs have been used by postsecondary institutions in…

Computers and Society · Computer Science 2022-05-02 Ying Guo , Cengiz Gunay , Sairam Tangirala , David Kerven , Wei Jin , Jamye Curry Savage , Seungjin Lee

Scientific observations may consist of a large number of variables (features). Identifying a subset of meaningful features is often ignored in unsupervised learning, despite its potential for unraveling clear patterns hidden in the ambient…

Machine Learning · Computer Science 2020-11-10 Ofir Lindenbaum , Uri Shaham , Jonathan Svirsky , Erez Peterfreund , Yuval Kluger

Random subspace method has wide security applications such as providing certified defenses against adversarial and backdoor attacks, and building robustly aligned LLM against jailbreaking attacks. However, the explanation of random subspace…

Cryptography and Security · Computer Science 2026-04-01 Yanting Wang , Jinyuan Jia

The Shapley value is one of the most widely used measures of feature importance partly as it measures a feature's average effect on a model's prediction. We introduce joint Shapley values, which directly extend Shapley's axioms and…

Machine Learning · Statistics 2022-02-11 Chris Harris , Richard Pymar , Colin Rowat

Feature selection is essential for effective visual recognition. We propose an efficient joint classifier learning and feature selection method that discovers sparse, compact representations of input features from a vast sea of candidates,…

Computer Vision and Pattern Recognition · Computer Science 2015-12-03 Marius Leordeanu , Alexandra Radu , Shumeet Baluja , Rahul Sukthankar

Besides accuracy, recent studies on machine learning models have been addressing the question on how the obtained results can be interpreted. Indeed, while complex machine learning models are able to provide very good results in terms of…

Machine Learning · Computer Science 2022-11-07 Guilherme Dean Pelegrina , Leonardo Tomazeli Duarte , Michel Grabisch

Feature attribution methods such as SHapley Additive exPlanations (SHAP) have become instrumental in understanding machine learning models, but their role in guiding model optimization remains underexplored. In this paper, we propose a…

Machine Learning · Computer Science 2025-08-01 Amal Saadallah