English
Related papers

Related papers: Scaling Reasoning Efficiently via Relaxed On-Polic…

200 papers

On-policy distillation (OPD), which aligns the student with the teacher's logit distribution on student-generated trajectories, has demonstrated strong empirical gains in improving student performance and often outperforms off-policy…

Machine Learning · Computer Science 2026-02-27 Wenkai Yang , Weijie Liu , Ruobing Xie , Kai Yang , Saiyong Yang , Yankai Lin

Knowledge distillation improves large language model (LLM) reasoning by compressing the knowledge of a teacher LLM to train smaller LLMs. On-policy distillation advances this approach by having the student sample its own trajectories while…

Machine Learning · Computer Science 2026-03-23 Siyan Zhao , Zhihui Xie , Mengchen Liu , Jing Huang , Guan Pang , Feiyu Chen , Aditya Grover

On-policy distillation (OPD) is a powerful paradigm for model alignment, yet its reliance on teacher logits restricts its application to white-box scenarios. We contend that structured semantic rubrics can serve as a scalable alternative to…

Machine Learning · Computer Science 2026-05-11 Junfeng Fang , Zhepei Hong , Mao Zheng , Mingyang Song , Gengsheng Li , Houcheng Jiang , Dan Zhang , Haiyun Guo , Xiang Wang , Tat-Seng Chua

On-policy distillation (OPD), which samples trajectories from the student model and supervises them with a teacher at the token level, avoids relying solely on verifiable terminal rewards and can yield better generalization than off-policy…

Knowledge distillation offers a promising path to transfer reasoning capabilities from large teacher models to efficient student models; however, existing token-level on-policy distillation methods require token-level alignment between the…

Computation and Language · Computer Science 2026-01-30 Jing Xiong , Hui Shen , Shansan Gong , Yuxin Cheng , Jianghan Shen , Chaofan Tao , Haochen Tan , Haoli Bai , Lifeng Shang , Ngai Wong

On-policy distillation (OPD) has become a core technique in the post-training of large language models, yet its training dynamics remain poorly understood. This paper provides a systematic investigation of OPD dynamics and mechanisms. We…

Machine Learning · Computer Science 2026-04-16 Yaxuan Li , Yuxin Zuo , Bingxiang He , Jinqian Zhang , Chaojun Xiao , Cheng Qian , Tianyu Yu , Huan-ang Gao , Wenkai Yang , Zhiyuan Liu , Ning Ding

On-policy distillation (OPD) has become a promising paradigm for reasoning-oriented post-training of large language models (LLMs), especially when combined with reinforcement learning from verifiable rewards (RLVR). Existing OPD methods…

On-policy distillation (OPD) is increasingly used in LLM post-training because it can leverage a teacher model to provide dense supervision on student rollouts. The standard implementation, however, usually reduces distribution matching to…

Machine Learning · Computer Science 2026-04-28 Yuqian Fu , Haohuan Huang , Kaiwen Jiang , Jiacai Liu , Zhuo Jiang , Yuanheng Zhu , Dongbin Zhao

Large language models are often post-trained with sparse verifier rewards, which indicate whether a sampled trajectory succeeds but provide limited guidance about where reasoning succeeds or fails. On-policy distillation (OPD) offers denser…

Machine Learning · Computer Science 2026-05-14 Weichen Yu , Xiaomin Li , Yizhou Zhao , Xiaoze Liu , Ruowang Zhang , Haixin Wang , Yinyi Luo , Chen Henry Wu , Gaurav Mittal , Matt Fredrikson , Yu Hu

On-policy distillation is an efficient alternative to reinforcement learning, offering dense token-level training signals. However, its reliance on a stronger external teacher has driven recent work on on-policy self-distillation, where the…

Machine Learning · Computer Science 2026-05-07 Xin Yu , Liuchen Liao , Yiwen Zhang , Yingchen Yu , Lingzhou Xue , Qinzhen Guo

On-policy self-distillation (OPSD) trains a student on its own rollouts using a privileged teacher, but its standard objective weights all generated tokens equally, implicitly treating the privileged teacher target as equally reliable at…

Machine Learning · Computer Science 2026-05-22 Xiaogeng Liu , Xinyan Wang , Yingzi Ma , Yechao Zhang , Chaowei Xiao

Reasoning-centric large language models (LLMs) achieve strong performance by generating intermediate reasoning trajectories, but often incur excessive token usage and high inference-time decoding cost. We observe that, when solving the same…

Artificial Intelligence · Computer Science 2026-05-12 Han Yang , Mingyan Wu , Bailan He , Zeyu Cao , Sikuan Yan , Kevin Qinghong Lin , Zifeng Ding

On-policy self-distillation trains a reasoning model on its own rollouts while a teacher, often the same model conditioned on privileged context, provides dense token-level supervision. Existing objectives typically weight the teacher's…

Artificial Intelligence · Computer Science 2026-05-14 Junlong Ke , Zichen Wen , Weijia Li , Conghui He , Linfeng Zhang

On-policy self-distillation (OPSD) improves the reasoning performance of large language models (LLMs) by providing dense token-level supervision for on-policy rollouts. However, existing OPSD methods often yield limited gains on in-domain…

Computation and Language · Computer Science 2026-05-28 Ziqi Zhao , Xinyu Ma , Liu Yang , Yujie Feng , Daiting Shi , Jingzhou He , Xin Xin , Zhaochun Ren , Xiao-Ming Wu

Training vision-language models (VLMs) for complex reasoning remains a challenging task, i.a. due to the scarcity of high-quality image-text reasoning data. Conversely, text-based reasoning resources are abundant and scalable, but it is…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Walid Bousselham , Hilde Kuehne , Cordelia Schmid

We study {on-policy self-distillation} (OPSD), where a language model improves its reasoning ability by distilling privileged teacher distributions along its own on-policy trajectories. Despite the performance gains of OPSD, we identify a…

Machine Learning · Computer Science 2026-05-13 Yuxiao Yang , Xiaoyun Wang , Weitong Zhang

On-policy self-distillation (OPSD) is an emerging LLM post-training paradigm in which the model serves as its own teacher: conditioned on privileged information such as a reference trace or hint, the same policy provides dense token-level…

Machine Learning · Computer Science 2026-05-22 Hongbin Zhang , Chaozheng Wang , Kehai Chen , Youcheng Pan , Yang Xiang , Jinpeng Wang , Min Zhang

On-policy distillation (OPD) trains a student on its own trajectories with token-level teacher feedback and often outperforms off-policy distillation and standard reinforcement learning. However, we find that its standard advantage weighted…

Machine Learning · Computer Science 2026-05-14 Nan Jia , Haojin Yang , Xing Ma , Jiesong Lian , Shuailiang Zhang , Weipeng Zhang , Ke Zeng , Xunliang Cai , Zequn Sun

Standard knowledge distillation for autoregressive models often suffers from distribution mismatch. While on-policy methods mitigate this by leveraging student-generated outputs, they rely on computationally expensive Reinforcement Learning…

Machine Learning · Computer Science 2026-05-08 Miao Rang , Zhenni Bi , Hang Zhou , Kai Han , Xuechun Wang , An Xiao , Xinghao Chen , Yunhe Wang , Hanting Chen

On-policy distillation (OPD), which supervises a student on its own sampled trajectories, has emerged as a data-efficient post-training method for improving reasoning while avoiding the reward dependence of reinforcement learning and the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Ke Zhang , Yunjie Tian , Dongdi Zhao , Yijiang Li , Yuanye Liu , Vishal M Patel , Di Fu
‹ Prev 1 2 3 10 Next ›