English
Related papers

Related papers: Near-Policy: Accelerating On-Policy Distillation v…

200 papers

Black-box knowledge distillation for large language models presents a strict trade-off. Simple off-policy methods (e.g., sequence-level knowledge distillation) struggle to correct the student's inherent errors. Fully on-policy methods…

Machine Learning · Computer Science 2026-04-24 Xiwen Chen , Jingjing Wang , Wenhui Zhu , Peijie Qiu , Xuanzhao Dong , Hejian Sang , Zhipeng Wang , Alborz Geramifard , Feng Luo

LLM-based generation of SystemVerilog Assertions (SVA) is often reported as nearing saturation, with the strongest specialized model reaching ${\sim}76\%$ accuracy on NL2SVA-Human. We show that this aggregate hides a temporal gap: models…

Hardware Architecture · Computer Science 2026-05-14 Qingyun Zou , Yingze Li , Tianen Liu , Bingsheng He , Weng-Fai Wong

Scaling on-policy distillation (OPD) for large language models (LLMs) confronts a fundamental tension: asynchronous execution is necessary for system efficiency, but structurally deviates from the ideal on-policy objective. To address this…

Machine Learning · Computer Science 2026-05-19 Xianwei Chen , Shimin Zhang , Jibin Wu

On-policy distillation (OPD) has recently emerged as an effective post-training paradigm for consolidating the capabilities of specialized expert models into a single student model. Despite its empirical success, the conditions under which…

Vision-based deep reinforcement learning (RL) typically obtains performance benefit by using high capacity and relatively large convolutional neural networks (CNN). However, a large network leads to higher inference costs (power, latency,…

Machine Learning · Computer Science 2019-05-01 Sam Green , Craig M. Vineyard , Çetin Kaya Koç

Diffusion models have seen rapid adoption in robotic imitation learning, enabling autonomous execution of complex dexterous tasks. However, action synthesis is often slow, requiring many steps of iterative denoising, limiting the extent to…

Robotics · Computer Science 2024-10-14 Sigmund H. Høeg , Yilun Du , Olav Egeland

Decision transformer based sequential policies have emerged as a powerful paradigm in offline reinforcement learning (RL), yet their efficacy remains constrained by the quality of static datasets and inherent architectural limitations.…

Machine Learning · Computer Science 2026-03-05 Yihao Qin , Yuanfei Wang , Hang Zhou , Peiran Liu , Hao Dong , Yiding Ji

GRPO-style RLVR trains reasoning models from multiple on-policy attempts per prompt, but typically uses these attempts only through terminal rewards. We show that a mixed group contains a richer process signal: a correct completion is a…

Machine Learning · Computer Science 2026-05-19 Zhiquan Tan , Yinrong Hong

Advanced reasoning typically requires Chain-of-Thought prompting, which is accurate but incurs prohibitive latency and substantial test-time inference costs. The standard alternative, fine-tuning smaller models, often sacrifices…

Computation and Language · Computer Science 2026-02-25 Sanket Badhe , Deep Shah

Continual learning, enabling models to acquire new skills and knowledge without degrading existing capabilities, remains a fundamental challenge for foundation models. While on-policy reinforcement learning can reduce forgetting, it…

Machine Learning · Computer Science 2026-01-28 Idan Shenfeld , Mehul Damani , Jonas Hübotter , Pulkit Agrawal

Large language models are often post-trained with sparse verifier rewards, which indicate whether a sampled trajectory succeeds but provide limited guidance about where reasoning succeeds or fails. On-policy distillation (OPD) offers denser…

Machine Learning · Computer Science 2026-05-14 Weichen Yu , Xiaomin Li , Yizhou Zhao , Xiaoze Liu , Ruowang Zhang , Haixin Wang , Yinyi Luo , Chen Henry Wu , Gaurav Mittal , Matt Fredrikson , Yu Hu

Distillation addresses the slow sampling problem in diffusion models by creating models with smaller size or fewer steps that approximate the behavior of high-step teachers. In this work, we propose a reinforcement learning based…

Machine Learning · Computer Science 2025-12-30 Amirhossein Tighkhorshid , Zahra Dehghanian , Gholamali Aminian , Chengchun Shi , Hamid R. Rabiee

On-policy distillation is a promising approach for transferring knowledge between language models, where a student learns from dense token-level signals along its own trajectories. This framework typically uses reverse KL divergence,…

Machine Learning · Computer Science 2026-05-25 Woogyeol Jin , Taywon Min , Yongjin Yang , Swanand Ravindra Kadhe , Yi Zhou , Dennis Wei , Nathalie Baracaldo , Kimin Lee

Existing Flow Matching (FM) text-to-image models suffer from two critical bottlenecks under multi-task alignment: the reward sparsity induced by scalar-valued rewards, and the gradient interference arising from jointly optimizing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zhen Fang , Wenxuan Huang , Yu Zeng , Yiming Zhao , Shuang Chen , Kaituo Feng , Yunlong Lin , Lin Chen , Zehui Chen , Shaosheng Cao , Feng Zhao

Knowledge distillation offers a promising path to transfer reasoning capabilities from large teacher models to efficient student models; however, existing token-level on-policy distillation methods require token-level alignment between the…

Computation and Language · Computer Science 2026-01-30 Jing Xiong , Hui Shen , Shansan Gong , Yuxin Cheng , Jianghan Shen , Chaofan Tao , Haochen Tan , Haoli Bai , Lifeng Shang , Ngai Wong

Optimizing a deep neural network is a fundamental task in computer vision, yet direct training methods often suffer from over-fitting. Teacher-student optimization aims at providing complementary cues from a model trained previously, but…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Chenglin Yang , Lingxi Xie , Chi Su , Alan L. Yuille

Reasoning-centric large language models (LLMs) achieve strong performance by generating intermediate reasoning trajectories, but often incur excessive token usage and high inference-time decoding cost. We observe that, when solving the same…

Artificial Intelligence · Computer Science 2026-05-12 Han Yang , Mingyan Wu , Bailan He , Zeyu Cao , Sikuan Yan , Kevin Qinghong Lin , Zifeng Ding

On-policy distillation (OPD) and on-policy self-distillation (OPSD) have emerged as promising post-training methods for large language models, offering dense token-level supervision on trajectories sampled from the model's own policy.…

Artificial Intelligence · Computer Science 2026-05-26 Siqi Zhu , Xuyan Ye , Hongyu Lu , Weiye Shi , Ge Liu

Diffusion Policies (DPs) have attracted attention for their ability to achieve significant accuracy improvements in various imitation learning tasks. However, DPs depend on Diffusion Models, which require multiple noise removal steps to…

Machine Learning · Computer Science 2025-07-30 Sodtavilan Odonchimed , Tatsuya Matsushima , Simon Holk , Yusuke Iwasawa , Yutaka Matsuo

We address the problem of fine-tuning diffusion models for reward-guided generation in biomolecular design. While diffusion models have proven highly effective in modeling complex, high-dimensional data distributions, real-world…