English

TimelyFreeze: Adaptive Parameter Freezing Mechanism for Pipeline Parallelism

Distributed, Parallel, and Cluster Computing 2026-02-09 v2 Artificial Intelligence

Abstract

Pipeline parallelism enables training models that exceed single-device memory, but practical throughput remains limited by pipeline bubbles. Although parameter freezing can improve training throughput by adaptively skipping backward computation, existing methods often over-freeze parameters, resulting in unnecessary accuracy degradation. To address this issue, we propose TimelyFreeze, which models the pipeline schedule as a directed acyclic graph and solves a linear program to compute optimal freeze ratios that minimize batch execution time under accuracy constraints. Experiments show that TimelyFreeze achieves up to 40% training throughput improvement on LLaMA-8B with comparable accuracy. Overall, it enables faster large-scale model training without compromising convergence and generalizes across diverse pipeline-parallel settings.

Keywords

Cite

@article{arxiv.2602.05754,
  title  = {TimelyFreeze: Adaptive Parameter Freezing Mechanism for Pipeline Parallelism},
  author = {Seonghye Cho and Jaemin Han and Hyunjin Kim and Euisoo Jung and Jae-Gil Lee},
  journal= {arXiv preprint arXiv:2602.05754},
  year   = {2026}
}
R2 v1 2026-07-01T09:38:05.437Z