English
Related papers

Related papers: Learning from Language Feedback via Variational Po…

200 papers

Large language models are increasingly post-trained with reinforcement learning in verifiable domains such as code and math. Yet, current methods for reinforcement learning with verifiable rewards (RLVR) learn only from a scalar outcome…

On-policy distillation (OPD) has become a popular training paradigm in the LLM community. This paradigm selects a larger model as the teacher to provide dense, fine-grained signals for each sampled trajectory, in contrast to reinforcement…

Machine Learning · Computer Science 2026-04-09 Chenxu Yang , Chuanyu Qin , Qingyi Si , Minghui Chen , Naibin Gu , Dingyu Yao , Zheng Lin , Weiping Wang , Jiaqi Wang , Nan Duan

Knowledge distillation offers a promising path to transfer reasoning capabilities from large teacher models to efficient student models; however, existing token-level on-policy distillation methods require token-level alignment between the…

Computation and Language · Computer Science 2026-01-30 Jing Xiong , Hui Shen , Shansan Gong , Yuxin Cheng , Jianghan Shen , Chaofan Tao , Haochen Tan , Haoli Bai , Lifeng Shang , Ngai Wong

Vision-Language-Action Models (VLAs) have demonstrated remarkable generalization capabilities in real-world experiments. However, their success rates are often not on par with expert policies, and they require fine-tuning when the setup…

Robotics · Computer Science 2025-08-05 Tobias Jülg , Wolfram Burgard , Florian Walter

Training vision-language models (VLMs) for complex reasoning remains a challenging task, i.a. due to the scarcity of high-quality image-text reasoning data. Conversely, text-based reasoning resources are abundant and scalable, but it is…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Walid Bousselham , Hilde Kuehne , Cordelia Schmid

On-policy knowledge distillation has proven effective for language models, yet its application to vision-language models (VLMs) remains underexplored. We observe that standard on-policy distillation can improve a student's output quality…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Ruiqi Liu , Xiaolei Lv , Gengsheng Li , Ximo Zhu , Zhiheng Wang , Zhengbo Zhang , Junkai Chen , Zhiheng Li , Bo Li , Jun Gao , Shu Wu

Training VideoLLMs for complex reasoning remains challenging due to sparse sequence level rewards and the lack of fine grained credit assignment over long, temporally grounded reasoning trajectories. While reinforcement learning with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Hao Lin , Kunyang Lv , Xu Jiang , Jingqi Tian , Zhongjing Du , Jiayu Ding , Qiaoman Zhang , Hongbo Jin

Large language models are often post-trained with sparse verifier rewards, which indicate whether a sampled trajectory succeeds but provide limited guidance about where reasoning succeeds or fails. On-policy distillation (OPD) offers denser…

Machine Learning · Computer Science 2026-05-14 Weichen Yu , Xiaomin Li , Yizhou Zhao , Xiaoze Liu , Ruowang Zhang , Haixin Wang , Yinyi Luo , Chen Henry Wu , Gaurav Mittal , Matt Fredrikson , Yu Hu

Enabling Large Language Models (LLMs) to continuously improve from environmental interactions is a central challenge in post-training. While on-policy self-distillation offers a promising paradigm, existing methods predominantly treat…

Machine Learning · Computer Science 2026-05-14 Yuwei Zhang , Sha Li , Changlong Yu , Qin Lu , Shuowei Jin , Chengyu Dong , Haoran Liu , Ilgee Hong , Xintong Li , Zhenyu Shi , Bing Yin , Jingbo Shang

On-policy distillation is an efficient alternative to reinforcement learning, offering dense token-level training signals. However, its reliance on a stronger external teacher has driven recent work on on-policy self-distillation, where the…

Machine Learning · Computer Science 2026-05-07 Xin Yu , Liuchen Liao , Yiwen Zhang , Yingchen Yu , Lingzhou Xue , Qinzhen Guo

Self-distillation enables language models to learn on-policy from their own trajectories by using the same model as both student and teacher, with the teacher being conditioned on privileged information unavailable to the student. Such…

Reinforcement learning for large language models faces a fundamental trade-off between sample efficiency and asymptotic performance: strictly on-policy methods discard trajectories after a single update, while off-policy reuse introduces…

Machine Learning · Computer Science 2026-05-26 Changyu Chen , Xiting Wang , Rui Yan

Recent work has shown that augmenting environments with language descriptions improves policy learning. However, for environments with complex language abstractions, learning how to ground language to observations is difficult due to…

Machine Learning · Computer Science 2022-10-04 Victor Zhong , Jesse Mu , Luke Zettlemoyer , Edward Grefenstette , Tim Rocktäschel

When using reinforcement learning (RL) for contact-rich robotic manipulation, vision can provide task-relevant information that accelerates learning beyond what proprioception alone can achieve. However, vision-enabled policies tend to…

Robotics · Computer Science 2026-05-29 Victor Kowalski , Chengxi Li , Dongheui Lee

Reinforcement learning has emerged as a principled post-training paradigm for Temporal Video Grounding (TVG) due to its on-policy optimization, yet existing GRPO-based methods remain fundamentally constrained by sparse reward signals and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Jiaze Li , Hao Yin , Haoran Xu , Boshen Xu , Wenhui Tan , Zewen He , Jianzhong Ju , Zhenbo Luo , Jian Luan

On-policy distillation (OPD) has become a promising paradigm for reasoning-oriented post-training of large language models (LLMs), especially when combined with reinforcement learning from verifiable rewards (RLVR). Existing OPD methods…

Direct Preference Optimization (DPO) is a powerful paradigm to align language models with human preferences using pairwise comparisons. However, its binary win-or-loss supervision often proves insufficient for training small models with…

Computation and Language · Computer Science 2025-09-23 Minchan Kwon , Junwon Ko , Kangil Kim , Junmo Kim

Multimodal Large Language Models (MLLMs) still struggle with fine-grained visual understanding, where answers often depend on small but decisive evidence in the full image. We observe a regional-to-global perception gap: the same MLLM…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Qianhao Yuan , Jie Lou , Xing Yu , Hongyu Lin , Le Sun , Xianpei Han , Yaojie Lu

As Large Language Models (LLMs) continue to grow in both capability and cost, transferring frontier capabilities into smaller, deployable students has become a central engineering problem, and knowledge distillation remains the dominant…

Machine Learning · Computer Science 2026-05-19 Mingyang Song , Mao Zheng

Moving beyond simple scalar rewards toward richer world feedback is a natural path to more scalable RL post-training. On-policy self-distillation (OPSD) is a promising recent approach that uses arbitrary feedback as learning signal, yet its…

Machine Learning · Computer Science 2026-05-29 Tommy He , Jerome Sieber , Matteo Saponati
‹ Prev 1 2 3 10 Next ›