Shift-Invariant Attribute Scoring for Kolmogorov-Arnold Networks via Shapley Value
Abstract
For many real-world applications, understanding feature-outcome relationships is as crucial as achieving high predictive accuracy. While traditional neural networks excel at prediction, their black-box nature obscures underlying functional relationships. Kolmogorov--Arnold Networks (KANs) address this by employing learnable spline-based activation functions on edges, enabling recovery of symbolic representations while maintaining competitive performance. However, KAN's architecture presents unique challenges for network pruning. Conventional magnitude-based methods become unreliable due to sensitivity to input coordinate shifts. We propose \textbf{ShapKAN}, a pruning framework using Shapley value attribution to assess node importance in a shift-invariant manner. Unlike magnitude-based approaches, ShapKAN quantifies each node's actual contribution, ensuring consistent importance rankings regardless of input parameterization. Extensive experiments on synthetic and real-world datasets demonstrate that ShapKAN preserves true node importance while enabling effective network compression. Our approach improves KAN's interpretability advantages, facilitating deployment in resource-constrained environments.
Keywords
Cite
@article{arxiv.2510.01663,
title = {Shift-Invariant Attribute Scoring for Kolmogorov-Arnold Networks via Shapley Value},
author = {Wangxuan Fan and Ching Wang and Siqi Li and Nan Liu},
journal= {arXiv preprint arXiv:2510.01663},
year = {2025}
}
Comments
15 pages, 6 figures, 9 tables