Recent advances in foundation models have highlighted the significant benefits of multi-stage training, with a particular emphasis on the emergence of mid-training as a vital stage that bridges pre-training and post-training. Mid-training is distinguished by its use of intermediate data and computational resources, systematically enhancing specified capabilities such as mathematics, coding, reasoning, and long-context extension, while maintaining foundational competencies. This survey provides a formal definition of mid-training for large language models (LLMs) and investigates optimization frameworks that encompass data curation, training strategies, and model architecture optimization. We analyze mainstream model implementations in the context of objective-driven interventions, illustrating how mid-training serves as a distinct and critical stage in the progressive development of LLM capabilities. By clarifying the unique contributions of mid-training, this survey offers a comprehensive taxonomy and actionable insights, supporting future research and innovation in the advancement of LLMs.
@article{arxiv.2510.23081,
title = {A Survey on LLM Mid-Training},
author = {Chengying Tu and Xuemiao Zhang and Rongxiang Weng and Rumei Li and Chen Zhang and Yang Bai and Hongfei Yan and Jingang Wang and Xunliang Cai},
journal= {arXiv preprint arXiv:2510.23081},
year = {2025}
}