English
Related papers

Related papers: TRACE: Distilling Where It Matters via Token-Route…

200 papers

On-policy distillation (OPD) has become a promising paradigm for reasoning-oriented post-training of large language models (LLMs), especially when combined with reinforcement learning from verifiable rewards (RLVR). Existing OPD methods…

Reinforcement learning for multi-turn agents suffers from a credit-assignment mismatch: rewards are sparse and trajectory-level, while success often hinges on a few local decisions. Existing online policy distillation (OPD) provides denser…

Artificial Intelligence · Computer Science 2026-05-27 Yanfei Zhang , Xu Lin , Chenglin Wu

On-policy distillation (OPD), which aligns the student with the teacher's logit distribution on student-generated trajectories, has demonstrated strong empirical gains in improving student performance and often outperforms off-policy…

Machine Learning · Computer Science 2026-02-27 Wenkai Yang , Weijie Liu , Ruobing Xie , Kai Yang , Saiyong Yang , Yankai Lin

On-policy self-distillation (OPSD) improves the reasoning performance of large language models (LLMs) by providing dense token-level supervision for on-policy rollouts. However, existing OPSD methods often yield limited gains on in-domain…

Computation and Language · Computer Science 2026-05-28 Ziqi Zhao , Xinyu Ma , Liu Yang , Yujie Feng , Daiting Shi , Jingzhou He , Xin Xin , Zhaochun Ren , Xiao-Ming Wu

While recent work in Reinforcement Learning with Verifiable Rewards (RLVR) has shown that a small subset of critical tokens disproportionately drives reasoning gains, an analogous token-level understanding of On-Policy Distillation (OPD)…

Computation and Language · Computer Science 2026-05-12 Yuxuan Jiang , Runchao Li , Shubhashis Roy Dipta , Dawei Li , Zhao Yang

On-policy knowledge distillation (OPD) trains a student on its own rollouts under token-level supervision from a teacher. Not all token positions matter equally, but existing views of token importance are incomplete. We ask a direct…

Machine Learning · Computer Science 2026-05-22 Yuanda Xu , Hejian Sang , Zhengze Zhou , Ran He , Zhipeng Wang , Alborz Geramifard

In settings where labeled verifiable training data is the binding constraint, each checked example should be allocated to the model and reward density where it is most informative. We identify a reward-density principle that governs this…

Machine Learning · Computer Science 2026-05-21 Yuanda Xu , Hejian Sang , Zhengze Zhou , Ran He , Zhipeng Wang , Alborz Geramifard

On-policy distillation (OPD) trains a student on its own trajectories with token-level teacher feedback and often outperforms off-policy distillation and standard reinforcement learning. However, we find that its standard advantage weighted…

Machine Learning · Computer Science 2026-05-14 Nan Jia , Haojin Yang , Xing Ma , Jiesong Lian , Shuailiang Zhang , Weipeng Zhang , Ke Zeng , Xunliang Cai , Zequn Sun

On-policy distillation offers dense, per-token supervision for training reasoning models; however, it remains unclear under which conditions this signal is beneficial and under which it is detrimental. Which teacher model should be used,…

Reinforcement learning (RL) has emerged as a central paradigm for post-training LLM agents, yet its trajectory-level reward signal provides only coarse supervision for long-horizon interaction. On-Policy Self-Distillation (OPSD) complements…

Machine Learning · Computer Science 2026-05-15 Zhengxi Lu , Zhiyuan Yao , Zhuowen Han , Zi-Han Wang , Jinyang Wu , Qi Gu , Xunliang Cai , Weiming Lu , Jun Xiao , Yueting Zhuang , Yongliang Shen

On-policy self-distillation has become a strong recipe for LLM reasoning, where a privileged teacher supervises the student's own rollouts while conditioning on the reference solution. A design choice shared by nearly all such methods,…

Artificial Intelligence · Computer Science 2026-05-28 Zihao Han , Tiangang Zhang , Huaibin Wang , Yilun Sun

On-policy distillation is an efficient alternative to reinforcement learning, offering dense token-level training signals. However, its reliance on a stronger external teacher has driven recent work on on-policy self-distillation, where the…

Machine Learning · Computer Science 2026-05-07 Xin Yu , Liuchen Liao , Yiwen Zhang , Yingchen Yu , Lingzhou Xue , Qinzhen Guo

Moving beyond simple scalar rewards toward richer world feedback is a natural path to more scalable RL post-training. On-policy self-distillation (OPSD) is a promising recent approach that uses arbitrary feedback as learning signal, yet its…

Machine Learning · Computer Science 2026-05-29 Tommy He , Jerome Sieber , Matteo Saponati

Reinforcement learning with verifiable rewards has become the standard recipe for improving LLM reasoning, but the dominant algorithm GRPO assigns a single trajectory-level advantage to every token, diluting the signal at pivotal reasoning…

Machine Learning · Computer Science 2026-05-25 Yu Li , Rui Miao , Tian Lan , Zhengling Qi

Reinforcement learning for large language models faces a fundamental trade-off between sample efficiency and asymptotic performance: strictly on-policy methods discard trajectories after a single update, while off-policy reuse introduces…

Machine Learning · Computer Science 2026-05-26 Changyu Chen , Xiting Wang , Rui Yan

Recent advances in model distillation show that data from advanced reasoning models can effectively train smaller student models. However, standard practices discard incorrect reasoning traces -- valuable, yet underutilized data. This paper…

Machine Learning · Computer Science 2025-12-16 Shuyao Xu , Cheng Peng , Jiangxuan Long , Weidi Xu , Wei Chu , Yuan Qi

On-Policy Self-Distillation (OPSD) has recently emerged as an alternative to Reinforcement Learning with Verifiable Rewards (RLVR), promising higher accuracy and shorter responses through token-level credit assignment from a self-teacher…

Artificial Intelligence · Computer Science 2026-05-08 Jaehoon Kim , Dongha Lee

Offline Reinforcement Learning (RL) aims to learn effective policies from a static dataset without requiring further agent-environment interactions. However, its practical adoption is often hindered by the need for explicit reward…

Machine Learning · Computer Science 2025-12-23 Gaurav Chaudhary , Laxmidhar Behera

On-policy distillation (OPD), which samples trajectories from the student model and supervises them with a teacher at the token level, avoids relying solely on verifiable terminal rewards and can yield better generalization than off-policy…

On-policy distillation (OPD) is widely used for LLM post-training. When pushed with a reward-extrapolation coefficient lambda > 1, the student can lift past the teacher in domain, but past a threshold lambda* the same step violates the…

Machine Learning · Computer Science 2026-05-12 Xin Li , Hao Jiang , Annan Wang , Yichi Zhang , Chau Yuen