English
Related papers

Related papers: Surgical Post-Training: Proximal On-Policy Distill…

200 papers

On-policy distillation (OPD) is an increasingly important paradigm for post-training language models. However, we identify a pervasive Scaling Law of Miscalibration: while OPD effectively improves task accuracy, it systematically traps…

Machine Learning · Computer Science 2026-04-21 Jiaxin Zhang , Xiangyu Peng , Qinglin Chen , Qinyuan Ye , Caiming Xiong , Chien-Sheng Wu

Pretraining language models directly on web-scale corpora is the de facto paradigm. We study an alternative where the model is initially exposed to abstract structured data to ease the subsequent acquisition of rich semantic knowledge, much…

Computation and Language · Computer Science 2026-05-29 Liangze Jiang , Zachary Shinnick , Anton van den Hengel , Hemanth Saratchandran , Damien Teney

Vision-based deep reinforcement learning (RL) typically obtains performance benefit by using high capacity and relatively large convolutional neural networks (CNN). However, a large network leads to higher inference costs (power, latency,…

Machine Learning · Computer Science 2019-05-01 Sam Green , Craig M. Vineyard , Çetin Kaya Koç

Large language models (LMs) beyond a certain scale, demonstrate the emergent capability of generating free-text rationales for their predictions via chain-of-thought (CoT) prompting. While CoT can yield dramatically improved performance,…

Computation and Language · Computer Science 2023-09-01 Peifeng Wang , Zhengyang Wang , Zheng Li , Yifan Gao , Bing Yin , Xiang Ren

Speculative decoding accelerates large language model inference by pairing a target model with a lightweight draft model whose proposed tokens are verified in parallel. A common way to build draft models, like EAGLE3 or DFlash is supervised…

Computation and Language · Computer Science 2026-05-29 Haodi Lei , Yafy Li , Haoran Zhang , Shunkai Zhang , Qianjia Cheng , Xiaoye Qu , Ganqu Cui , Bowen Zhou , Ning Ding , Yun Luo , Yu Cheng

On-policy distillation (OPD), which supervises a student on its own sampled trajectories, has emerged as a data-efficient post-training method for improving reasoning while avoiding the reward dependence of reinforcement learning and the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Ke Zhang , Yunjie Tian , Dongdi Zhao , Yijiang Li , Yuanye Liu , Vishal M Patel , Di Fu

Large Language Models (LLMs) have shown outstanding performance across wide range of downstream tasks. This competency is attributed to their substantial parameter size and pre-training on extensive corpus. Moreover, LLMs have exhibited…

Computation and Language · Computer Science 2023-08-10 Yuhan Ma , Haiqi Jiang , Chenyou Fan

While the rapid progress of deep learning fuels end-to-end reinforcement learning (RL), direct application, especially in high-dimensional space like robotic scenarios still suffers from low sample efficiency. Therefore State Representation…

On-policy knowledge distillation (OPD) trains a student on its own rollouts under token-level supervision from a teacher. Not all token positions matter equally, but existing views of token importance are incomplete. We ask a direct…

Machine Learning · Computer Science 2026-05-22 Yuanda Xu , Hejian Sang , Zhengze Zhou , Ran He , Zhipeng Wang , Alborz Geramifard

LLMs achieve remarkable multi-step reasoning capabilities, yet effectively transferring these skills via post-training distillation remains challenging. Existing data selection methods, ranging from manual curation to heuristics based on…

Computation and Language · Computer Science 2025-12-16 Jinrui Liu , Jeff Wu , Xuanguang Pan , Gavin Cheung , Shuai Ma , Chongyang Tao

Reinforcement learning (RL) post-training has increasingly demonstrated strong ability to elicit reasoning behaviors in large language models (LLMs). For training efficiency, rollouts are typically generated in an off-policy manner using an…

Artificial Intelligence · Computer Science 2026-02-02 Shiye Lei , Zhihao Cheng , Dacheng Tao

Large Reasoning Models (LRMs) achieve explicit chain-of-thought expansion by imitating deep thinking behaviors of humans, demonstrating excellent performance in complex task scenarios. However, the deep-thinking mode often leads to…

Machine Learning · Computer Science 2026-01-30 Qian Wan , Ziao Xu , Luona Wei , Xiaoxuan Shen , Jianwen Sun

Continual instruction tuning(CIT) during the post-training phase is crucial for adapting multimodal large language models (MLLMs) to evolving real-world demands. However, the progress is hampered by the lack of benchmarks with rigorous,…

Computation and Language · Computer Science 2026-02-16 Haiyun Guo , Zhiyan Hou , Yandu Sun , Jinghan He , Yu Chen , Yuzhe Zhou , Yuheng Jia , Jinqiao Wang , Tat-Seng Chua

Large language models have demonstrated impressive reasoning capabilities but are inherently limited by their knowledge reservoir. Retrieval-augmented reasoning mitigates this limitation by allowing LLMs to query external resources, but…

Computation and Language · Computer Science 2025-09-22 Yaorui Shi , Sihang Li , Chang Wu , Zhiyuan Liu , Junfeng Fang , Hengxing Cai , An Zhang , Xiang Wang

The prevailing paradigm for enhancing the reasoning abilities of LLMs revolves around post-training on high-quality, reasoning-intensive data. While emerging literature suggests that reasoning data is increasingly incorporated also during…

Post-training has greatly improved reasoning in frontier vision-language models, yet its gains for perception remain comparatively limited, creating a bottleneck for end-to-end visual reasoning. To investigate this gap, we introduce a…

Computation and Language · Computer Science 2026-05-29 Xueqing Wu , Yu-Chi Lin , Kai-Wei Chang , Nanyun Peng

Distillation enables compact Vision-Language Models (VLMs) to obtain strong reasoning capabilities, yet the prompts driving this process are typically chosen via simple heuristics or aggregated from off-the-shelf datasets. We reveal a…

Machine Learning · Computer Science 2026-05-20 Jaehun Jung , Hyunwoo Kim , Brandon Cui , Ximing Lu , David Acuna , Prithviraj Ammanabrolu , Yejin Choi

Despite the success of large language models (LLMs) in various natural language processing (NLP) tasks, the stored knowledge in these models may inevitably be incomplete, out-of-date, or incorrect. This motivates the need to utilize…

Computation and Language · Computer Science 2023-01-03 Hangfeng He , Hongming Zhang , Dan Roth

Moving beyond simple scalar rewards toward richer world feedback is a natural path to more scalable RL post-training. On-policy self-distillation (OPSD) is a promising recent approach that uses arbitrary feedback as learning signal, yet its…

Machine Learning · Computer Science 2026-05-29 Tommy He , Jerome Sieber , Matteo Saponati

Recent advances in post-training techniques have endowed Large Language Models (LLMs) with enhanced capabilities for tackling complex, logic-intensive tasks through the generation of supplementary planning tokens. This development raises a…

Computation and Language · Computer Science 2026-04-29 Pratham Singla , Shivank Garg , Ayush Singh , Ishan Garg , Ketan Suhaas Saichandran