English

Shift-Invariant Attribute Scoring for Kolmogorov-Arnold Networks via Shapley Value

Machine Learning 2025-10-03 v1 Artificial Intelligence

Abstract

For many real-world applications, understanding feature-outcome relationships is as crucial as achieving high predictive accuracy. While traditional neural networks excel at prediction, their black-box nature obscures underlying functional relationships. Kolmogorov--Arnold Networks (KANs) address this by employing learnable spline-based activation functions on edges, enabling recovery of symbolic representations while maintaining competitive performance. However, KAN's architecture presents unique challenges for network pruning. Conventional magnitude-based methods become unreliable due to sensitivity to input coordinate shifts. We propose \textbf{ShapKAN}, a pruning framework using Shapley value attribution to assess node importance in a shift-invariant manner. Unlike magnitude-based approaches, ShapKAN quantifies each node's actual contribution, ensuring consistent importance rankings regardless of input parameterization. Extensive experiments on synthetic and real-world datasets demonstrate that ShapKAN preserves true node importance while enabling effective network compression. Our approach improves KAN's interpretability advantages, facilitating deployment in resource-constrained environments.

Keywords

Cite

@article{arxiv.2510.01663,
  title  = {Shift-Invariant Attribute Scoring for Kolmogorov-Arnold Networks via Shapley Value},
  author = {Wangxuan Fan and Ching Wang and Siqi Li and Nan Liu},
  journal= {arXiv preprint arXiv:2510.01663},
  year   = {2025}
}

Comments

15 pages, 6 figures, 9 tables