English

Non-Asymptotic Global Convergence of PPO-Clip

Optimization and Control 2025-12-19 v1 Machine Learning

Abstract

Reinforcement learning (RL) has gained attention for aligning large language models (LLMs) via reinforcement learning from human feedback (RLHF). The actor-only variants of Proximal Policy Optimization (PPO) are widely applied for their efficiency. These algorithms incorporate a clipping mechanism to improve stability. Besides, a regularization term, such as the reverse KL-divergence or a more general ff-divergence, is introduced to prevent policy drift. Despite their empirical success, a rigorous theoretical understanding of the problem and the algorithm's properties is limited. This paper advances the theoretical foundations of the PPO-Clip algorithm by analyzing a deterministic actor-only PPO algorithm within the general RL setting with ff-divergence regularization under the softmax policy parameterization. We derive a non-uniform Lipschitz smoothness condition and a {\L}ojasiewicz inequality for the considered problem. Based on these, a non-asymptotic linear convergence rate to the globally optimal policy is established for the forward KL-regularizer. Furthermore, stationary convergence and local linear convergence are derived for the reverse KL-regularizer.

Keywords

Cite

@article{arxiv.2512.16565,
  title  = {Non-Asymptotic Global Convergence of PPO-Clip},
  author = {Yin Liu and Qiming Dai and Junyu Zhang and Zaiwen Wen},
  journal= {arXiv preprint arXiv:2512.16565},
  year   = {2025}
}