English

Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence

Computation and Language 2025-11-11 v1 Artificial Intelligence Machine Learning

Abstract

Recent advances in depth-recurrent language models show that recurrence can decouple train-time compute and parameter count from test-time compute. In this work, we study how to convert existing pretrained non-recurrent language models into depth-recurrent models. We find that using a curriculum of recurrences to increase the effective depth of the model over the course of training preserves performance while reducing total computational cost. In our experiments, on mathematics, we observe that converting pretrained models to recurrent ones results in better performance at a given compute budget than simply post-training the original non-recurrent language model.

Keywords

Cite

@article{arxiv.2511.07384,
  title  = {Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence},
  author = {Sean McLeish and Ang Li and John Kirchenbauer and Dayal Singh Kalra and Brian R. Bartoldson and Bhavya Kailkhura and Avi Schwarzschild and Jonas Geiping and Tom Goldstein and Micah Goldblum},
  journal= {arXiv preprint arXiv:2511.07384},
  year   = {2025}
}

Comments

code: https://github.com/mcleish7/retrofitting-recurrence, models: https://huggingface.co/collections/tomg-group-umd/retrofitting-recurrence

R2 v1 2026-07-01T07:30:21.571Z