English
Related papers

Related papers: Unmasking On-Policy Distillation: Where It Helps, …

200 papers

On-policy distillation is an efficient alternative to reinforcement learning, offering dense token-level training signals. However, its reliance on a stronger external teacher has driven recent work on on-policy self-distillation, where the…

Machine Learning · Computer Science 2026-05-07 Xin Yu , Liuchen Liao , Yiwen Zhang , Yingchen Yu , Lingzhou Xue , Qinzhen Guo

On-policy self-distillation (OPSD) trains a student on its own rollouts using a privileged teacher, but its standard objective weights all generated tokens equally, implicitly treating the privileged teacher target as equally reliable at…

Machine Learning · Computer Science 2026-05-22 Xiaogeng Liu , Xinyan Wang , Yingzi Ma , Yechao Zhang , Chaowei Xiao

Knowledge distillation improves large language model (LLM) reasoning by compressing the knowledge of a teacher LLM to train smaller LLMs. On-policy distillation advances this approach by having the student sample its own trajectories while…

Machine Learning · Computer Science 2026-03-23 Siyan Zhao , Zhihui Xie , Mengchen Liu , Jing Huang , Guan Pang , Feiyu Chen , Aditya Grover

On-policy distillation (OPD) is increasingly used in LLM post-training because it can leverage a teacher model to provide dense supervision on student rollouts. The standard implementation, however, usually reduces distribution matching to…

Machine Learning · Computer Science 2026-04-28 Yuqian Fu , Haohuan Huang , Kaiwen Jiang , Jiacai Liu , Zhuo Jiang , Yuanheng Zhu , Dongbin Zhao

On-policy self-distillation trains a reasoning model on its own rollouts while a teacher, often the same model conditioned on privileged context, provides dense token-level supervision. Existing objectives typically weight the teacher's…

Artificial Intelligence · Computer Science 2026-05-14 Junlong Ke , Zichen Wen , Weijia Li , Conghui He , Linfeng Zhang

On-policy distillation (OPD), which supervises a student on its own sampled trajectories, has emerged as a data-efficient post-training method for improving reasoning while avoiding the reward dependence of reinforcement learning and the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Ke Zhang , Yunjie Tian , Dongdi Zhao , Yijiang Li , Yuanye Liu , Vishal M Patel , Di Fu

Large language models are often post-trained with sparse verifier rewards, which indicate whether a sampled trajectory succeeds but provide limited guidance about where reasoning succeeds or fails. On-policy distillation (OPD) offers denser…

Machine Learning · Computer Science 2026-05-14 Weichen Yu , Xiaomin Li , Yizhou Zhao , Xiaoze Liu , Ruowang Zhang , Haixin Wang , Yinyi Luo , Chen Henry Wu , Gaurav Mittal , Matt Fredrikson , Yu Hu

On-policy distillation (OPD) has become a core technique in the post-training of large language models, yet its training dynamics remain poorly understood. This paper provides a systematic investigation of OPD dynamics and mechanisms. We…

Machine Learning · Computer Science 2026-04-16 Yaxuan Li , Yuxin Zuo , Bingxiang He , Jinqian Zhang , Chaojun Xiao , Cheng Qian , Tianyu Yu , Huan-ang Gao , Wenkai Yang , Zhiyuan Liu , Ning Ding

On-policy self-distillation (OPSD) is an emerging LLM post-training paradigm in which the model serves as its own teacher: conditioned on privileged information such as a reference trace or hint, the same policy provides dense token-level…

Machine Learning · Computer Science 2026-05-22 Hongbin Zhang , Chaozheng Wang , Kehai Chen , Youcheng Pan , Yang Xiang , Jinpeng Wang , Min Zhang

On-policy distillation (OPD) trains a student on its own rollouts with token-level teacher supervision. Recent selective OPD methods exploit the non-uniformity of OPD signals by prioritizing high-entropy or high-disagreement tokens. We…

Machine Learning · Computer Science 2026-05-27 Yuanyi Wang , Su Lu , Yanggan Gu , Pengkai Wang , Yifan Yang , Zhaoyi Yan , Congkai Xie , Jianmin Wu , Hongxia Yang

On-policy distillation (OPD) and on-policy self-distillation (OPSD) have emerged as promising post-training methods for large language models, offering dense token-level supervision on trajectories sampled from the model's own policy.…

Artificial Intelligence · Computer Science 2026-05-26 Siqi Zhu , Xuyan Ye , Hongyu Lu , Weiye Shi , Ge Liu

On-policy distillation is pivotal for transferring reasoning capabilities to capacity-constrained models, yet remains prone to instability and negative transfer. We show that on-policy distillation can be interpreted, both theoretically and…

Machine Learning · Computer Science 2026-03-13 Jongwoo Ko , Sara Abdali , Young Jin Kim , Tianyi Chen , Pashmina Cameron

On-policy distillation (OPD) has become a popular training paradigm in the LLM community. This paradigm selects a larger model as the teacher to provide dense, fine-grained signals for each sampled trajectory, in contrast to reinforcement…

Machine Learning · Computer Science 2026-04-09 Chenxu Yang , Chuanyu Qin , Qingyi Si , Minghui Chen , Naibin Gu , Dingyu Yao , Zheng Lin , Weiping Wang , Jiaqi Wang , Nan Duan

We study {on-policy self-distillation} (OPSD), where a language model improves its reasoning ability by distilling privileged teacher distributions along its own on-policy trajectories. Despite the performance gains of OPSD, we identify a…

Machine Learning · Computer Science 2026-05-13 Yuxiao Yang , Xiaoyun Wang , Weitong Zhang

On-policy self-distillation has emerged as a promising paradigm for post-training language models, in which the model conditions on environment feedback to serve as its own teacher, providing dense token-level rewards without external…

Machine Learning · Computer Science 2026-05-13 Guobin Shen , Lei Huang , Xiang Cheng , Chenxiao Zhao , Jindong Li , Dongcheng Zhao , Xing Yu

Policy distillation, which transfers a teacher policy to a student policy has achieved great success in challenging tasks of deep reinforcement learning. This teacher-student framework requires a well-trained teacher model which is…

Machine Learning · Computer Science 2020-06-09 Kwei-Herng Lai , Daochen Zha , Yuening Li , Xia Hu

Moving beyond simple scalar rewards toward richer world feedback is a natural path to more scalable RL post-training. On-policy self-distillation (OPSD) is a promising recent approach that uses arbitrary feedback as learning signal, yet its…

Machine Learning · Computer Science 2026-05-29 Tommy He , Jerome Sieber , Matteo Saponati

On-policy knowledge distillation (OPD) trains a student on its own rollouts under token-level supervision from a teacher. Not all token positions matter equally, but existing views of token importance are incomplete. We ask a direct…

Machine Learning · Computer Science 2026-05-22 Yuanda Xu , Hejian Sang , Zhengze Zhou , Ran He , Zhipeng Wang , Alborz Geramifard

Distilling reasoning traces from strong large language models into smaller ones is a promising route to improve intelligence in resource-constrained settings. Existing approaches face a fundamental trade-off: offline distillation from…

Computation and Language · Computer Science 2026-05-15 Yumeng Zhang , Zhengbang Yang , Yevin Nikhel Goonatilake , Zhuangdi Zhu

We propose a distillation scaling law that estimates distilled model performance based on a compute budget and its allocation between the student and teacher. Our findings mitigate the risks associated with large-scale distillation by…

Machine Learning · Computer Science 2025-07-28 Dan Busbridge , Amitis Shidani , Floris Weers , Jason Ramapuram , Etai Littwin , Russ Webb
‹ Prev 1 2 3 10 Next ›