English
Related papers

Related papers: SuperFlow: Training Flow Matching Models with RL o…

200 papers

Graph generation is a fundamental task with broad applications, such as drug discovery. Recently, discrete flow matching-based graph generation, \aka, graph flow model (GFM), has emerged due to its superior performance and flexible…

Machine Learning · Computer Science 2026-03-12 Baoheng Zhu , Deyu Bo , Delvin Ce Zhang , Xiao Wang

Training deep learning models takes an extremely long execution time and consumes large amounts of computing resources. At the same time, recent research proposed systems and compilers that are expected to decrease deep learning models…

Machine Learning · Computer Science 2022-05-11 Sean Parker , Sami Alabed , Eiko Yoneki

Reinforcement learning (RL) has become a pivotal technology in the post-training phase of large language models (LLMs). Traditional task-colocated RL frameworks suffer from significant scalability bottlenecks, while task-separated RL…

Alignment methodologies have emerged as a critical pathway for enhancing language model alignment capabilities. While SFT (supervised fine-tuning) accelerates convergence through direct token-level loss intervention, its efficacy is…

Super-resolution is an ill-posed problem, since it allows for multiple predictions for a given low-resolution image. This fundamental fact is largely ignored by state-of-the-art deep learning based approaches. These methods instead train a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Andreas Lugmayr , Martin Danelljan , Luc Van Gool , Radu Timofte

Flow matching has emerged as a powerful generative framework, with recent few-step methods achieving remarkable inference acceleration. However, we identify a critical yet overlooked limitation: these models suffer from severe diversity…

Machine Learning · Computer Science 2026-04-15 Yexiong Lin , Jia Shi , Shanshan Ye , Wanyu Wang , Yu Yao , Tongliang Liu

Diffusion and flow-matching models achieve remarkable generative performance but at the cost of many sampling steps, this slows inference and limits applicability to time-critical tasks. The ReFlow procedure can accelerate sampling by…

Machine Learning · Computer Science 2024-10-11 Beomsu Kim , Yu-Guan Hsieh , Michal Klein , Marco Cuturi , Jong Chul Ye , Bahjat Kawar , James Thornton

Flow Matching has limited ability in achieving one-step generation due to its reliance on learned curved trajectories. Previous studies have attempted to address this limitation by either modifying the coupling distribution to prevent…

Machine Learning · Computer Science 2025-11-25 Chenrui Ma , Xi Xiao , Tianyang Wang , Xiao Wang , Yanning Shen

The performance of text-to-image diffusion models may be improved at test-time by scaling computation to search for a generated image that maximizes a given reward function. While existing trajectory level exploration methods improve the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Qingtao Yu , Changlin Song , Minghao Sun , Zhengyang Yu , Vinay Kumar Verma , Soumya Roy , Sumit Negi , Hongdong Li , Dylan Campbell

Diffusion models have achieved significant progress in both image and video generation while still suffering from huge computation costs. As an effective solution, flow matching aims to reflow the diffusion process of diffusion models into…

Graphics · Computer Science 2025-03-13 Lei Ke , Haohang Xu , Xuefei Ning , Yu Li , Jiajun Li , Haoling Li , Yuxuan Lin , Dongsheng Jiang , Yujiu Yang , Linfeng Zhang

Diffusion models (DMs) have demonstrated remarkable success in real-world image super-resolution (SR), yet their reliance on time-consuming multi-step sampling largely hinders their practical applications. While recent efforts have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Jiaqi Xu , Wenbo Li , Haoze Sun , Fan Li , Zhixin Wang , Long Peng , Jingjing Ren , Haoran Yang , Xiaowei Hu , Renjing Pei , Pheng-Ann Heng

Group-based reinforcement learning algorithms such as Group Reward Policy Optimization (GRPO) have proven effective for fine-tuning large language models (LLMs) with human feedback. However, generating and storing multiple responses per…

Machine Learning · Computer Science 2025-07-01 Liangyu Wang , Huanyi Xie , Xinhai Wang , Tianjin Huang , Mengdi Li , Di Wang

Reinforcement learning (RL) post-training is crucial for aligning generative models with human preferences, but its prohibitive computational cost remains a major barrier to widespread adoption. We introduce \textbf{TreeGRPO}, a novel RL…

Machine Learning · Computer Science 2025-12-10 Zheng Ding , Weirui Ye

Recent work shows that flow matching can be effective for scalar Q-value function estimation in reinforcement learning (RL), but it remains unclear why or how this approach differs from standard critics. Contrary to conventional belief, we…

Machine Learning · Computer Science 2026-05-12 Bhavya Agrawalla , Michal Nauman , Aviral Kumar

Learning-based optical flow estimation has been dominated with the pipeline of cost volume with convolutions for flow regression, which is inherently limited to local correlations and thus is hard to address the long-standing challenge of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Haofei Xu , Jing Zhang , Jianfei Cai , Hamid Rezatofighi , Dacheng Tao

New technologies such as Rectified Flow and Flow Matching have significantly improved the performance of generative models in the past two years, especially in terms of control accuracy, generation quality, and generation efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Sen Fang , Hongbin Zhong , Yalin Feng , Yanxin Zhang , Dimitris N. Metaxas

While large-scale video diffusion models have demonstrated impressive capabilities in generating high-resolution and semantically rich content, a significant gap remains between their pretraining performance and real-world deployment…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Zeyue Xue , Siming Fu , Jie Huang , Shuai Lu , Haoran Li , Yijun Liu , Yuming Li , Xiaoxuan He , Mengzhao Chen , Haoyang Huang , Nan Duan , Ping Luo

MeanFlow promises high-quality generative modeling in few steps, by jointly learning instantaneous and average velocity fields. Yet, the underlying training dynamics remain unclear. We analyze the interaction between the two velocities and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jin-Young Kim , Hyojun Go , Lea Bogensperger , Julius Erbach , Nikolai Kalischek , Federico Tombari , Konrad Schindler , Dominik Narnhofer

Text-to-image diffusion models are a class of deep generative models that have demonstrated an impressive capacity for high-quality image generation. However, these models are susceptible to implicit biases that arise from web-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yinan Zhang , Eric Tzeng , Yilun Du , Dmitry Kislyuk

Existing post-training techniques are broadly categorized into supervised fine-tuning (SFT) and reinforcement learning (RL) methods; the former is stable during training but suffers from limited generalization, while the latter, despite its…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Daoan Zhang , Guangchen Lan , Dong-Jun Han , Wenlin Yao , Xiaoman Pan , Hongming Zhang , Mingxiao Li , Pengcheng Chen , Yu Dong , Christopher Brinton , Jiebo Luo