English
Related papers

Related papers: Self-Distilled Reasoner: On-Policy Self-Distillati…

200 papers

Knowledge distillation offers a promising path to transfer reasoning capabilities from large teacher models to efficient student models; however, existing token-level on-policy distillation methods require token-level alignment between the…

Computation and Language · Computer Science 2026-01-30 Jing Xiong , Hui Shen , Shansan Gong , Yuxin Cheng , Jianghan Shen , Chaofan Tao , Haochen Tan , Haoli Bai , Lifeng Shang , Ngai Wong

On-policy distillation (OPD), which supervises a student on its own sampled trajectories, has emerged as a data-efficient post-training method for improving reasoning while avoiding the reward dependence of reinforcement learning and the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Ke Zhang , Yunjie Tian , Dongdi Zhao , Yijiang Li , Yuanye Liu , Vishal M Patel , Di Fu

On-policy distillation (OPD) has recently emerged as an effective post-training paradigm for consolidating the capabilities of specialized expert models into a single student model. Despite its empirical success, the conditions under which…

On-policy distillation (OPD) is increasingly used in LLM post-training because it can leverage a teacher model to provide dense supervision on student rollouts. The standard implementation, however, usually reduces distribution matching to…

Machine Learning · Computer Science 2026-04-28 Yuqian Fu , Haohuan Huang , Kaiwen Jiang , Jiacai Liu , Zhuo Jiang , Yuanheng Zhu , Dongbin Zhao

On-policy self-distillation trains a reasoning model on its own rollouts while a teacher, often the same model conditioned on privileged context, provides dense token-level supervision. Existing objectives typically weight the teacher's…

Artificial Intelligence · Computer Science 2026-05-14 Junlong Ke , Zichen Wen , Weijia Li , Conghui He , Linfeng Zhang

Training-time privileged information (PI) can enable language models to succeed on tasks they would otherwise fail, making it a powerful tool for reinforcement learning in hard, long-horizon settings. However, transferring capabilities…

Machine Learning · Computer Science 2026-02-17 Emiliano Penaloza , Dheeraj Vattikonda , Nicolas Gontier , Alexandre Lacoste , Laurent Charlin , Massimo Caccia

On-policy distillation (OPD) is a powerful paradigm for model alignment, yet its reliance on teacher logits restricts its application to white-box scenarios. We contend that structured semantic rubrics can serve as a scalable alternative to…

Machine Learning · Computer Science 2026-05-11 Junfeng Fang , Zhepei Hong , Mao Zheng , Mingyang Song , Gengsheng Li , Houcheng Jiang , Dan Zhang , Haiyun Guo , Xiang Wang , Tat-Seng Chua

On-policy distillation (OPD), which samples trajectories from the student model and supervises them with a teacher at the token level, avoids relying solely on verifiable terminal rewards and can yield better generalization than off-policy…

On-policy self-distillation (OPSD) trains a student on its own rollouts using a privileged teacher, but its standard objective weights all generated tokens equally, implicitly treating the privileged teacher target as equally reliable at…

Machine Learning · Computer Science 2026-05-22 Xiaogeng Liu , Xinyan Wang , Yingzi Ma , Yechao Zhang , Chaowei Xiao

On-policy distillation is pivotal for transferring reasoning capabilities to capacity-constrained models, yet remains prone to instability and negative transfer. We show that on-policy distillation can be interpreted, both theoretically and…

Machine Learning · Computer Science 2026-03-13 Jongwoo Ko , Sara Abdali , Young Jin Kim , Tianyi Chen , Pashmina Cameron

Large language models (LLMs) are increasingly adapted to proprietary and domain-specific corpora that contain sensitive information, creating a tension between formal privacy guarantees and efficient deployment through model compression.…

Machine Learning · Computer Science 2026-04-07 Fatemeh Khadem , Sajad Mousavi , Yi Fang , Yuhong Liu

Adapting large language models (LLMs) to long-context tasks requires post-training methods that remain accurate and coherent over thousands of tokens. Existing approaches are limited in several ways: 1) off-policy methods such as supervised…

Computation and Language · Computer Science 2026-05-13 Miguel Moura Ramos , Duarte M. Alves , André F. T. Martins

Inference-time harnesses substantially improve large language models on complex reasoning tasks. However, the intrinsic capabilities of the underlying model remain unchanged by the addition of these external workflows. To bridge this gap,…

Computation and Language · Computer Science 2026-05-12 Zhengyang Zhao , Lu Ma , Wentao Zhang

Large language models (LLMs) have recently demonstrated strong potential for autonomous vehicle motion planning by reformulating trajectory prediction as a language generation problem. However, deploying capable LLMs in resource-constrained…

Robotics · Computer Science 2026-04-10 Amirhossein Afsharrad , Amirhesam Abedsoltan , Ahmadreza Moradipari , Sanjay Lall

On-policy distillation (OPD) is an effective post-training paradigm for large language models but requires a live teacher server throughout training, resulting in substantial infrastructure overhead. We investigate whether OPD can be…

Machine Learning · Computer Science 2026-05-11 Yecheng Wu , Song Han , Hai Cai

Moving beyond simple scalar rewards toward richer world feedback is a natural path to more scalable RL post-training. On-policy self-distillation (OPSD) is a promising recent approach that uses arbitrary feedback as learning signal, yet its…

Machine Learning · Computer Science 2026-05-29 Tommy He , Jerome Sieber , Matteo Saponati

Reinforcement learning (RL) has been widely used to train LLM agents for multi-turn interactive tasks, but its sample efficiency is severely limited by sparse rewards and long horizons. On-policy self-distillation (OPSD) alleviates this by…

Machine Learning · Computer Science 2026-04-14 Hao Wang , Guozhi Wang , Han Xiao , Yufeng Zhou , Yue Pan , Jichao Wang , Ke Xu , Yafei Wen , Xiaohu Ruan , Xiaoxin Chen , Honggang Qi

Knowledge Distillation (KD) can transfer the reasoning abilities of large models to smaller ones, which can reduce the costs to generate Chain-of-Thoughts for reasoning tasks. KD methods typically ask the student to mimic the teacher's…

Computation and Language · Computer Science 2026-03-17 Minsang Kim , Seung Jun Baek

On-policy self-distillation (SD) improves LLM reasoning by using teacher-side privileged information (PI) to turn sparse verifier outcomes into dense token-level supervision. Existing methods usually assume trusted PI, such as reference…

Computation and Language · Computer Science 2026-05-28 Jiazhen Huang , Xiao Chen , Xiao Luo , Yong Dai , Senkang Hu , Yuzhi Zhao

The landscape of high-performance image generation models is currently shifting from the inefficient multi-step ones to the efficient few-step counterparts (e.g, Z-Image-Turbo and FLUX.2-klein). However, these models present significant…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Dengyang Jiang , Xin Jin , Dongyang Liu , Zanyi Wang , Mingzhe Zheng , Ruoyi Du , Xiangpeng Yang , Qilong Wu , Zhen Li , Peng Gao , Harry Yang , Steven Hoi