English
Related papers

Related papers: Flow-OPD: On-Policy Distillation for Flow Matching…

200 papers

Learning-based optical flow estimation has been dominated with the pipeline of cost volume with convolutions for flow regression, which is inherently limited to local correlations and thus is hard to address the long-standing challenge of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Haofei Xu , Jing Zhang , Jianfei Cai , Hamid Rezatofighi , Dacheng Tao

Off-policy model-free deep reinforcement learning methods using previously collected data can improve sample efficiency over on-policy policy gradient techniques. On the other hand, on-policy algorithms are often more stable and easier to…

Machine Learning · Computer Science 2017-06-02 Shixiang Gu , Timothy Lillicrap , Zoubin Ghahramani , Richard E. Turner , Bernhard Schölkopf , Sergey Levine

Reinforcement learning with verifiable rewards (RLVR) has become an effective paradigm for improving the reasoning ability of large language models. However, widely used RLVR algorithms, such as GRPO, often suffer from entropy collapse,…

Machine Learning · Computer Science 2026-05-13 Huimin Xu , Shuai Zhao , Xiaobao Wu , Anh Tuan Luu

Recent advances in flow matching models have significantly improved text-to-image generation quality, but also introduce growing safety risks due to the generation of harmful or undesirable content. Existing concept erasure methods are…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yi Sun , Zhiqi Zhang , Xinhao Zhong , Yimin Zhou , Shuoyang Sun , Bin Chen , Shu-Tao Xia , Ke Xu

Generating high-quality time-series data is challenging because real-world signals often exhibit multimodal patterns and multiscale dynamics, including oscillations and high-frequency variations. Flow Matching (FM) offers an efficient…

Machine Learning · Computer Science 2026-05-29 Junru Zhang , Lang Feng , Jinbo Wang , Xu Guo , Yucheng Wang , Han Yu , Min Wu , Yabo Dong , Duanqing Xu

Video style transfer techniques inspire many exciting applications on mobile devices. However, their efficiency and stability are still far from satisfactory. To boost the transfer stability across frames, optical flow is widely adopted,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Xinghao Chen , Yiman Zhang , Yunhe Wang , Han Shu , Chunjing Xu , Chang Xu

This study proposes a knowledge distillation algorithm based on large language models and feature alignment, aiming to effectively transfer the knowledge of large pre-trained models into lightweight student models, thereby reducing…

Computation and Language · Computer Science 2024-12-30 Shuo Wang , Chihang Wang , Jia Gao , Zhen Qi , Hongye Zheng , Xiaoxuan Liao

Accurate polyp segmentation remains challenging due to irregular lesion morphologies, ambiguous boundaries, and heterogeneous imaging conditions. While U-Net variants excel at local feature fusion, they often lack explicit mechanisms to…

Image and Video Processing · Electrical Eng. & Systems 2025-02-27 Pu Wang , Huaizhi Ma , Zhihua Zhang , Zhuoran Zheng

The Distribution Matching Distillation (DMD) has been successfully applied to text-to-image diffusion models such as Stable Diffusion (SD) 1.5. However, vanilla DMD suffers from convergence difficulties on large-scale flow-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xingtong Ge , Xin Zhang , Tongda Xu , Yi Zhang , Xinjie Zhang , Yan Wang , Jun Zhang

While online Reinforcement Learning has emerged as a crucial technique for aligning flow matching models with human preferences, current approaches are hindered by inefficient exploration during training rollouts. Relying on undirected…

Machine Learning · Computer Science 2026-02-09 Ruizhe Zhong , Jiesong Lian , Xiaoyue Mi , Zixiang Zhou , Yuan Zhou , Qinglin Lu , Junchi Yan

Vision-Language-Action Models (VLAs) have demonstrated remarkable generalization capabilities in real-world experiments. However, their success rates are often not on par with expert policies, and they require fine-tuning when the setup…

Robotics · Computer Science 2025-08-05 Tobias Jülg , Wolfram Burgard , Florian Walter

Diffusion-based imitation learning improves Behavioral Cloning (BC) on multi-modal decision-making, but comes at the cost of significantly slower inference due to the recursion in the diffusion process. It urges us to design efficient…

Machine Learning · Computer Science 2024-11-25 Xixi Hu , Bo Liu , Xingchao Liu , Qiang Liu

Safety alignment often improves robustness to harmful queries at the cost of reasoning ability, a tradeoff known as the safety tax. A common cause is distributional mismatch: supervised fine-tuning trains the target model on safety…

Machine Learning · Computer Science 2026-05-19 Yu Fu , Longxuan Yu , Haz Sameen Shahgir , Zhipeng Wei , Hui Liu , N. Benjamin Erichson , Yue Dong

Imitation learning is a promising approach for enabling generalist capabilities in humanoid robots, but its scaling is fundamentally constrained by the scarcity of high-quality expert demonstrations. This limitation can be mitigated by…

Robotics · Computer Science 2025-08-21 Quentin Rouxel , Clemente Donoso , Fei Chen , Serena Ivaldi , Jean-Baptiste Mouret

On-policy distillation is a promising approach for transferring knowledge between language models, where a student learns from dense token-level signals along its own trajectories. This framework typically uses reverse KL divergence,…

Machine Learning · Computer Science 2026-05-25 Woogyeol Jin , Taywon Min , Yongjin Yang , Swanand Ravindra Kadhe , Yi Zhou , Dennis Wei , Nathalie Baracaldo , Kimin Lee

State-of-the-art text-to-image models produce high-quality images, but inference remains expensive as generation requires several sequential ODE or denoising steps. Native one-step models aim to reduce this cost by mapping noise to an image…

Autoregressive video generators are attractive for streaming, long-horizon, and interactive applications, but distilling strong black-box teachers into causal students remains difficult. The student must learn under its own rollout…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yang Luo , Shengju Qian , Xiaohang Tang , Zirui Zhu , Yong Liu , Xin Wang , Yang You

Reinforcement learning (RL) has emerged as a promising paradigm for inducing explicit reasoning behaviors in large language and vision-language models. However, reasoning-oriented RL post-training remains fundamentally challenging due to…

Artificial Intelligence · Computer Science 2026-05-13 Fan Yang , Rui Meng , Trudi Di Qi , Ali Ezzati , Yuxin Wen

Instruction-guided image editing requires balancing target modification with non-target preservation. Recently, flow-based models have emerged as a strong and increasingly adopted backbone for instruction-guided image editing, thanks to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Zhuohan Ouyang , Zhe Qian , Wenhuo Cui , Chaoqun Wang

Prior research on out-of-distribution detection (OoDD) has primarily focused on single-modality models. Recently, with the advent of large-scale pretrained vision-language models such as CLIP, OoDD methods utilizing such multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Jeonghyeon Kim , Sangheum Hwang