English
Related papers

Related papers: Lightning OPD: Efficient Post-Training for Large R…

200 papers

Decision transformer based sequential policies have emerged as a powerful paradigm in offline reinforcement learning (RL), yet their efficacy remains constrained by the quality of static datasets and inherent architectural limitations.…

Machine Learning · Computer Science 2026-03-05 Yihao Qin , Yuanfei Wang , Hang Zhou , Peiran Liu , Hao Dong , Yiding Ji

On-Policy Distillation (OPD) has gained wide attraction as an LLM post-training paradigm due to its effectiveness in improving capabilities without introducing model distribution drift, and consequently, regression in general tasks.…

Artificial Intelligence · Computer Science 2026-05-25 Aristotelis Lazaridis , Dylan Bates , Aman Sharma , Brian King , Vincent Lu , Jack FitzGerald

Reinforcement learning has emerged as a principled post-training paradigm for Temporal Video Grounding (TVG) due to its on-policy optimization, yet existing GRPO-based methods remain fundamentally constrained by sparse reward signals and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Jiaze Li , Hao Yin , Haoran Xu , Boshen Xu , Wenhui Tan , Zewen He , Jianzhong Ju , Zhenbo Luo , Jian Luan

Context distillation enables language models to internalize in-context knowledge into their parameters. In our work, we propose On-Policy Context Distillation (OPCD), a framework that bridges on-policy distillation with context distillation…

Computation and Language · Computer Science 2026-03-24 Tianzhu Ye , Li Dong , Xun Wu , Shaohan Huang , Furu Wei

On-policy self-distillation (OPSD) improves the reasoning performance of large language models (LLMs) by providing dense token-level supervision for on-policy rollouts. However, existing OPSD methods often yield limited gains on in-domain…

Computation and Language · Computer Science 2026-05-28 Ziqi Zhao , Xinyu Ma , Liu Yang , Yujie Feng , Daiting Shi , Jingzhou He , Xin Xin , Zhaochun Ren , Xiao-Ming Wu

While the shift from cascaded dialogue systems to end-to-end (E2E) speech Large Language Models (LLMs) improves latency and paralinguistic modeling, E2E models often exhibit a significant performance degradation compared to their text-based…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-31 Di Cao , Dongjie Fu , Hai Yu , Siqi Zheng , Xu Tan , Tao Jin

Reinforcement learning has emerged as a powerful tool for improving diffusion-based text-to-image models, but existing methods are largely limited to single-task optimization. Extending RL to multiple tasks is challenging: joint…

Machine Learning · Computer Science 2026-05-15 Quanhao Li , Junqiu Yu , Kaixun Jiang , Yujie Wei , Zhen Xing , Pandeng Li , Ruihang Chu , Shiwei Zhang , Yu Liu , Zuxuan Wu

Large language models (LLMs) are increasingly adapted to proprietary and domain-specific corpora that contain sensitive information, creating a tension between formal privacy guarantees and efficient deployment through model compression.…

Machine Learning · Computer Science 2026-04-07 Fatemeh Khadem , Sajad Mousavi , Yi Fang , Yuhong Liu

On-policy reinforcement learning has become the dominant paradigm for reasoning alignment in large language models, yet its sparse, outcome-level rewards make token-level credit assignment notoriously difficult. On-Policy Distillation (OPD)…

Machine Learning · Computer Science 2026-04-14 Binbin Zheng , Xing Ma , Yiheng Liang , Jingqing Ruan , Xiaoliang Fu , Kepeng Lin , Benchang Zhu , Ke Zeng , Xunliang Cai

Training vision-language models (VLMs) for complex reasoning remains a challenging task, i.a. due to the scarcity of high-quality image-text reasoning data. Conversely, text-based reasoning resources are abundant and scalable, but it is…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Walid Bousselham , Hilde Kuehne , Cordelia Schmid

On-policy distillation (OPD) is a standard tool for transferring teacher behavior to a smaller student, but it implicitly assumes that teacher and student predictions are comparable token by token, an assumption that fails whenever the two…

Computation and Language · Computer Science 2026-05-22 Jie Sun , Mao Zheng , Mingyang Song , Qiyong Zhong , Yilin Cheng , Bichuan Feng , Pengfei Liu , Junfeng Fang , Xiang Wang

The rapid advancement of large language models (LLMs) has significantly advanced the capabilities of artificial intelligence across various domains. However, their massive scale and high computational costs render them unsuitable for direct…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Miao Rang , Zhenni Bi , Hang Zhou , Hanting Chen , An Xiao , Tianyu Guo , Kai Han , Xinghao Chen , Yunhe Wang

While recent work in Reinforcement Learning with Verifiable Rewards (RLVR) has shown that a small subset of critical tokens disproportionately drives reasoning gains, an analogous token-level understanding of On-Policy Distillation (OPD)…

Computation and Language · Computer Science 2026-05-12 Yuxuan Jiang , Runchao Li , Shubhashis Roy Dipta , Dawei Li , Zhao Yang

On-policy self-distillation has become a strong recipe for LLM reasoning, where a privileged teacher supervises the student's own rollouts while conditioning on the reference solution. A design choice shared by nearly all such methods,…

Artificial Intelligence · Computer Science 2026-05-28 Zihao Han , Tiangang Zhang , Huaibin Wang , Yilun Sun

Massive reinforcement learning (RL) data are typically collected to train policies offline without the need for interactions, but the large data volume can cause training inefficiencies. To tackle this issue, we formulate offline behavior…

Machine Learning · Computer Science 2024-10-31 Shiye Lei , Sen Zhang , Dacheng Tao

Large language models (LLMs) have recently demonstrated strong potential for autonomous vehicle motion planning by reformulating trajectory prediction as a language generation problem. However, deploying capable LLMs in resource-constrained…

Robotics · Computer Science 2026-04-10 Amirhossein Afsharrad , Amirhesam Abedsoltan , Ahmadreza Moradipari , Sanjay Lall

On-policy distillation offers dense, per-token supervision for training reasoning models; however, it remains unclear under which conditions this signal is beneficial and under which it is detrimental. Which teacher model should be used,…

On-policy distillation is pivotal for transferring reasoning capabilities to capacity-constrained models, yet remains prone to instability and negative transfer. We show that on-policy distillation can be interpreted, both theoretically and…

Machine Learning · Computer Science 2026-03-13 Jongwoo Ko , Sara Abdali , Young Jin Kim , Tianyi Chen , Pashmina Cameron

Reasoning-centric large language models (LLMs) achieve strong performance by generating intermediate reasoning trajectories, but often incur excessive token usage and high inference-time decoding cost. We observe that, when solving the same…

Artificial Intelligence · Computer Science 2026-05-12 Han Yang , Mingyan Wu , Bailan He , Zeyu Cao , Sikuan Yan , Kevin Qinghong Lin , Zifeng Ding

On-policy distillation is a promising approach for transferring knowledge between language models, where a student learns from dense token-level signals along its own trajectories. This framework typically uses reverse KL divergence,…

Machine Learning · Computer Science 2026-05-25 Woogyeol Jin , Taywon Min , Yongjin Yang , Swanand Ravindra Kadhe , Yi Zhou , Dennis Wei , Nathalie Baracaldo , Kimin Lee