English

Shapley Neuron Values for Continual Learning: Which Neurons Matter Most?

Machine Learning 2026-05-18 v1 Artificial Intelligence

Abstract

Continual learning enables neural networks to learn tasks sequentially without forgetting previously acquired knowledge. However, neural networks suffer from catastrophic forgetting, where learning new tasks degrades performance on earlier ones. We address this problem with Shapley Neuron Valuation (SNV), a principled framework that quantifies Neuron importance in continual learning, grounded in cooperative game theory. SNV selectively freezes important Neurons while keeping others plastic, enabling buffer-free continual learning without expanding architecture. Experiments on ImageNet-1k show that SNV consistently outperforms existing buffer-free methods. In particular, SNV improves accuracy by +2.88% in the class incremental learning and +6.46% in the task incremental learning scenarios compared to the second baseline.

Keywords

Cite

@article{arxiv.2605.15877,
  title  = {Shapley Neuron Values for Continual Learning: Which Neurons Matter Most?},
  author = {Mohammad Ali Vahedifar and Abhisek Ray and Qi Zhang},
  journal= {arXiv preprint arXiv:2605.15877},
  year   = {2026}
}

Comments

This paper has been accepted to ICML 2026

R2 v1 2026-07-22T07:14:19.193Z