English
Related papers

Related papers: TRACE: Distilling Where It Matters via Token-Route…

200 papers

Distilling the capabilities from a large reasoning model (LRM) to a smaller student model often involves training on substantial amounts of reasoning data. However, knowledge distillation (KD) over lengthy sequences with prompt (P),…

Computation and Language · Computer Science 2026-01-09 Wei-Rui Chen , Vignesh Kothapalli , Ata Fatahibaarzi , Hejian Sang , Shao Tang , Qingquan Song , Zhipeng Wang , Muhammad Abdul-Mageed

Vision-based deep reinforcement learning (RL) typically obtains performance benefit by using high capacity and relatively large convolutional neural networks (CNN). However, a large network leads to higher inference costs (power, latency,…

Machine Learning · Computer Science 2019-05-01 Sam Green , Craig M. Vineyard , Çetin Kaya Koç

Due to constraints on privacy, cost, and latency, on-premise deployment of small models is increasingly common. However, most practical pipelines stop at supervised fine-tuning (SFT) and fail to reach the reinforcement learning (RL)…

Large language models trained with reinforcement learning (RL) for mathematical reasoning face a fundamental challenge: on problems the model cannot solve at all - "cliff" prompts - the RL gradient vanishes entirely, preventing any learning…

Machine Learning · Computer Science 2026-03-26 Ken Ding

When a model produces a correct solution under reinforcement learning with verifiable rewards (RLVR), every token receives the same reward signal regardless of whether it was a decisive reasoning step or a grammatical filler. A natural fix…

Machine Learning · Computer Science 2026-05-20 Ahmed Heakl , Abdelrahman M. Shaker , Youssef Mohamed , Rania Elbadry , Omar Fetouh , Fahad Shahbaz Khan , Salman Khan

Knowledge distillation conducts an effective model compression method while holding some limitations:(1) the feature based distillation methods only focus on distilling the feature map but are lack of transferring the relation of data…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Muzhou Yu , Sia Huat Tan , Kailu Wu , Runpei Dong , Linfeng Zhang , Kaisheng Ma

Recent reinforcement learning (RL) post-training approaches primarily optimize the final output policy using sparse outcome-level rewards, while largely overlooking predictive signals encoded in intermediate representations. In this paper,…

Machine Learning · Computer Science 2026-05-29 Xinyu Liu , Darryl Cherian Jacob , Yang Zhou , Jindong Wang , Pan He

Consistency distillation is a prevalent way for accelerating diffusion models adopted in consistency (trajectory) models, in which a student model is trained to traverse backward on the probability flow (PF) ordinary differential equation…

Machine Learning · Computer Science 2025-05-01 Kaiwen Zheng , Guande He , Jianfei Chen , Fan Bao , Jun Zhu

Knowledge distillation offers a promising path to transfer reasoning capabilities from large teacher models to efficient student models; however, existing token-level on-policy distillation methods require token-level alignment between the…

Computation and Language · Computer Science 2026-01-30 Jing Xiong , Hui Shen , Shansan Gong , Yuxin Cheng , Jianghan Shen , Chaofan Tao , Haochen Tan , Haoli Bai , Lifeng Shang , Ngai Wong

On-policy distillation (OPD) trains a student on its own trajectories under token-level teacher supervision, but existing methods are capped by a single-teacher capability ceiling: when the teacher errs, the student inherits the error. OPD…

Computation and Language · Computer Science 2026-05-05 Jianze Wang , Ying Liu , Jinlong Chen , Xuchun Hu , Qilong Zhang , Yu Cao , Jun Wang , Hua Yang , Yong Xie , Qianglong Chen

Mainstream strategies for finetuning pretrained multimodal models often degrade out-of-distribution (OOD) robustness, a phenomenon known as catastrophic forgetting. In this paper, we develop a theoretical framework for multimodal…

Machine Learning · Computer Science 2026-05-29 Hesam Asadollahzadeh , Feng Liu , Christopher Leckie , Sarah M. Erfani

Reinforcement learning with verifiable rewards (RLVR) has become a standard paradigm for post-training large language models. While Group Relative Policy Optimization (GRPO) is widely adopted, its coarse credit assignment uniformly…

Machine Learning · Computer Science 2026-04-03 Gengsheng Li , Tianyu Yang , Junfeng Fang , Mingyang Song , Mao Zheng , Haiyun Guo , Dan Zhang , Jinqiao Wang , Tat-Seng Chua

Self-Distillation Policy Optimization (SDPO) provides dense token-level credit assignment for reinforcement learning with large language models by leveraging the model's own feedback-conditioned predictions as a self-teacher. Unlike GRPO,…

Machine Learning · Computer Science 2026-05-28 Zehao Liu , Yuanpu Cao , Jinghui Chen , Vasant G. Honavar

Distillation-based learning boosts the performance of the miniaturized neural network based on the hypothesis that the representation of a teacher model can be used as structured and relatively weak supervision, and thus would be easily…

Machine Learning · Computer Science 2019-04-22 Xiao Jin , Baoyun Peng , Yichao Wu , Yu Liu , Jiaheng Liu , Ding Liang , Junjie Yan , Xiaolin Hu

Chain-of-thought (CoT) distillation trains a smaller model to imitate a teacher's reasoning trace, but it is typically evaluated by final-answer metrics including accuracy. We ask whether gains in answer quality are accompanied by…

Artificial Intelligence · Computer Science 2026-05-28 Zhaoyang Jiang , Xuanqi Peng , Fei Teng , Zhizhong Fu , Yunsoo Kim , Jiacong Mi , Zicheng Li , Honghan Wu

Large language models are often post-trained with sparse verifier rewards, which indicate whether a sampled trajectory succeeds but provide limited guidance about where reasoning succeeds or fails. On-policy distillation (OPD) offers denser…

Machine Learning · Computer Science 2026-05-14 Weichen Yu , Xiaomin Li , Yizhou Zhao , Xiaoze Liu , Ruowang Zhang , Haixin Wang , Yinyi Luo , Chen Henry Wu , Gaurav Mittal , Matt Fredrikson , Yu Hu

Offline reinforcement learning (RL) allows robots to learn from offline datasets without risky exploration. Yet, offline RL's performance often hinges on a brittle trade-off between (1) return maximization, which can push policies outside…

Robotics · Computer Science 2026-03-06 Hokyun Im , Andrey Kolobov , Jianlong Fu , Youngwoon Lee

GRPO-style RLVR trains reasoning models from multiple on-policy attempts per prompt, but typically uses these attempts only through terminal rewards. We show that a mixed group contains a richer process signal: a correct completion is a…

Machine Learning · Computer Science 2026-05-19 Zhiquan Tan , Yinrong Hong

Training long-horizon LLM agents with reinforcement learning is challenging because sparse outcome rewards reveal whether a task succeeds, but not which intermediate actions caused the outcome or how they should be corrected. Recent methods…

Machine Learning · Computer Science 2026-05-19 Woongyeng Yeo , Yumin Choi , Taekyung Ki , Sung Ju Hwang

While deep reinforcement learning has achieved promising results in challenging decision-making tasks, the main bones of its success --- deep neural networks are mostly black-boxes. A feasible way to gain insight into a black-box model is…

Machine Learning · Computer Science 2021-08-17 Zhao-Hua Li , Yang Yu , Yingfeng Chen , Ke Chen , Zhipeng Hu , Changjie Fan