English
Related papers

Related papers: Co-Evolving Policy Distillation

200 papers

Group Relative Policy Optimization (GRPO) has emerged as a powerful algorithm for improving the reasoning capabilities of language models, but often fails to improve small models due to sparse rewards on difficult tasks. Existing works…

Machine Learning · Computer Science 2026-05-12 Soo Min Kwon , Ziteng Sun , Ananda Theertha Suresh , Himanshu Jain , Sanjiv Kumar

On-policy distillation (OPD) trains a student on its own trajectories with token-level teacher feedback and often outperforms off-policy distillation and standard reinforcement learning. However, we find that its standard advantage weighted…

Machine Learning · Computer Science 2026-05-14 Nan Jia , Haojin Yang , Xing Ma , Jiesong Lian , Shuailiang Zhang , Weipeng Zhang , Ke Zeng , Xunliang Cai , Zequn Sun

Domain specialization can improve LLM behavior in vertical domains, but often weakens the general capabilities inherited from the original model. Recent Multi-Teacher On-Policy Distillation (MOPD) pipelines recover model capabilities by…

Artificial Intelligence · Computer Science 2026-05-27 Tianlei Chen , Jiao Ou , Ziyuan Liu , Ruiming Tang , Jian Liang , Han Li

On-policy distillation (OPD) has become a core technique in the post-training of large language models, yet its training dynamics remain poorly understood. This paper provides a systematic investigation of OPD dynamics and mechanisms. We…

Machine Learning · Computer Science 2026-04-16 Yaxuan Li , Yuxin Zuo , Bingxiang He , Jinqian Zhang , Chaojun Xiao , Cheng Qian , Tianyu Yu , Huan-ang Gao , Wenkai Yang , Zhiyuan Liu , Ning Ding

Knowledge distillation (KD) is an effective model compression technique where a compact student network is taught to mimic the behavior of a complex and highly trained teacher network. In contrast, Mutual Learning (ML) provides an…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Usma Niyaz , Deepti R. Bathula

Most deep reinforcement learning algorithms are data inefficient in complex and rich environments, limiting their applicability to many scenarios. One direction for improving data efficiency is multitask learning with shared neural network…

On-policy distillation (OPD) has emerged as an efficient post-training paradigm for large language models. However, existing studies largely attribute this advantage to denser and more stable supervision, while the parameter-level…

Computation and Language · Computer Science 2026-05-22 Yuchen Cai , Ding Cao , Liang Lin , Chunxi Luo , Xin Xu , Kai Yang , Weijie Liu , Saiyong Yang , Tianxiang Zhao , Guangzhong Sun , Guiquan Liu , Junfeng Fang

On-policy distillation (OPD) trains a student on its own trajectories under token-level teacher supervision, but existing methods are capped by a single-teacher capability ceiling: when the teacher errs, the student inherits the error. OPD…

Computation and Language · Computer Science 2026-05-05 Jianze Wang , Ying Liu , Jinlong Chen , Xuchun Hu , Qilong Zhang , Yu Cao , Jun Wang , Hua Yang , Yong Xie , Qianglong Chen

On-Policy Self-Distillation (OPSD) is a unified learning framework in which a single large language model acts simultaneously as both teacher and student. Unlike conventional knowledge distillation that relies on a separate, often larger…

Human-Computer Interaction · Computer Science 2026-05-22 Fangming Cui , Sunan Li , Jiahong Li

Large language models (LLMs) have achieved remarkable progress in mathematical reasoning, but this ability is not equally accessible across languages. Especially low-resource languages exhibit much lower reasoning performance. To address…

Computation and Language · Computer Science 2026-05-12 Yihong Liu , Raoyuan Zhao , Michael A. Hedderich , Hinrich Schütze

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as the standard paradigm for improving reasoning capability of large language models, while Multi-Token Prediction (MTP) has been a widely adopted module in pretraining.…

Machine Learning · Computer Science 2026-05-28 Zili Wang , Jiajun Chai , Lin Chen , Xiaohan Wang , Shiming Xiang , Guojun Yin

Continual learning (CL) aims to learn new tasks without erasing previous knowledge. However, current CL methods primarily emphasize improving accuracy while often neglecting training efficiency, which consequently restricts their practical…

Machine Learning · Computer Science 2026-01-30 RuiQi Liu , Boyu Diao , Libo Huang , Zijia An , Hangda Liu , Zhulin An , Yongjun Xu

On-policy distillation is pivotal for transferring reasoning capabilities to capacity-constrained models, yet remains prone to instability and negative transfer. We show that on-policy distillation can be interpreted, both theoretically and…

Machine Learning · Computer Science 2026-03-13 Jongwoo Ko , Sara Abdali , Young Jin Kim , Tianyi Chen , Pashmina Cameron

On-Policy Distillation (OPD) has gained wide attraction as an LLM post-training paradigm due to its effectiveness in improving capabilities without introducing model distribution drift, and consequently, regression in general tasks.…

Artificial Intelligence · Computer Science 2026-05-25 Aristotelis Lazaridis , Dylan Bates , Aman Sharma , Brian King , Vincent Lu , Jack FitzGerald

On-policy distillation (OPD) has shown strong potential for transferring reasoning ability from frontier or domain-specific models to smaller students. While effective on static single-turn tasks, its behavior in multi-turn agent settings…

Machine Learning · Computer Science 2026-04-30 Jiaqi Wang , Wenhao Zhang , Weijie Shi , Yaliang Li , James Cheng

Reinforcement learning with verifiable rewards (RLVR) has become a standard paradigm for post-training large language models. While Group Relative Policy Optimization (GRPO) is widely adopted, its coarse credit assignment uniformly…

Machine Learning · Computer Science 2026-04-03 Gengsheng Li , Tianyu Yang , Junfeng Fang , Mingyang Song , Mao Zheng , Haiyun Guo , Dan Zhang , Jinqiao Wang , Tat-Seng Chua

Knowledge distillation improves large language model (LLM) reasoning by compressing the knowledge of a teacher LLM to train smaller LLMs. On-policy distillation advances this approach by having the student sample its own trajectories while…

Machine Learning · Computer Science 2026-03-23 Siyan Zhao , Zhihui Xie , Mengchen Liu , Jing Huang , Guan Pang , Feiyu Chen , Aditya Grover

Multi-teacher Knowledge Distillation (KD) transfers diverse knowledge from a teacher pool to a student network. The core problem of multi-teacher KD is how to balance distillation strengths among various teachers. Most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Chuanguang Yang , Xinqiang Yu , Han Yang , Zhulin An , Chengqing Yu , Libo Huang , Yongjun Xu

Reinforcement learning (RL) has emerged as a promising paradigm for inducing explicit reasoning behaviors in large language and vision-language models. However, reasoning-oriented RL post-training remains fundamentally challenging due to…

Artificial Intelligence · Computer Science 2026-05-13 Fan Yang , Rui Meng , Trudi Di Qi , Ali Ezzati , Yuxin Wen

On-policy distillation (OPD) is an effective post-training paradigm for large language models but requires a live teacher server throughout training, resulting in substantial infrastructure overhead. We investigate whether OPD can be…

Machine Learning · Computer Science 2026-05-11 Yecheng Wu , Song Han , Hai Cai