English

Sparse Memory Finetuning as a Low-Forgetting Alternative to LoRA and Full Finetuning

Computation and Language 2026-05-06 v1 Machine Learning

Abstract

Adapting a pretrained language model to a new task often hurts the general capabilities it already had, a problem known as catastrophic forgetting. Sparse Memory Finetuning (SMF) tries to avoid this by adding key-value memory layers to the model and, on each training step, updating only the small set of memory rows that the current batch reads most heavily. We re-implement SMF on Qwen-2.5-0.5B-Instruct and compare it with LoRA and full finetuning on MedMCQA, a 4-choice medical exam task, using WikiText perplexity and TriviaQA accuracy as forgetting probes. SMF improves MedMCQA by 2.5 percentage points while keeping both forgetting probes within roughly 1 point of the base model, whereas LoRA and full finetuning achieve larger gains but with clear drift on both. We also compare two row-selection rules (KL-divergence and TF-IDF), which balance the two forgetting metrics differently.

Keywords

Cite

@article{arxiv.2605.03229,
  title  = {Sparse Memory Finetuning as a Low-Forgetting Alternative to LoRA and Full Finetuning},
  author = {Prakhar Gupta and Garv Shah and Satyam Goyal and Anirudh Kanchi},
  journal= {arXiv preprint arXiv:2605.03229},
  year   = {2026}
}
R2 v1 2026-07-01T12:49:37.536Z