English

SIM-Shapley: A Stable and Computationally Efficient Approach to Shapley Value Approximation

Machine Learning 2025-10-03 v2 Machine Learning

Abstract

Explainable artificial intelligence (XAI) is essential for trustworthy machine learning (ML), particularly in high-stakes domains such as healthcare and finance. Shapley value (SV) methods provide a principled framework for feature attribution in complex models but incur high computational costs, limiting their scalability in high-dimensional settings. We propose Stochastic Iterative Momentum for Shapley Value Approximation (SIM-Shapley), a stable and efficient SV approximation method inspired by stochastic optimization. We analyze variance theoretically, prove linear QQ-convergence, and demonstrate improved empirical stability and low bias in practice on real-world datasets. In our numerical experiments, SIM-Shapley reduces computation time by up to 85% relative to state-of-the-art baselines while maintaining comparable feature attribution quality. Beyond feature attribution, our stochastic mini-batch iterative framework extends naturally to a broader class of sample average approximation problems, offering a new avenue for improving computational efficiency with stability guarantees. Code is publicly available at https://github.com/nliulab/SIM-Shapley.

Keywords

Cite

@article{arxiv.2505.08198,
  title  = {SIM-Shapley: A Stable and Computationally Efficient Approach to Shapley Value Approximation},
  author = {Wangxuan Fan and Siqi Li and Doudou Zhou and Yohei Okada and Chuan Hong and Molei Liu and Nan Liu},
  journal= {arXiv preprint arXiv:2505.08198},
  year   = {2025}
}

Comments

21 pages, 6 figures, 5 tables

R2 v1 2026-06-28T23:30:47.152Z