English
Related papers

Related papers: How to Guide Your Flow: Few-Step Alignment via Flo…

200 papers

Recent years have seen considerable advancements in multi-step reasoning with Large Language Models (LLMs). The previous studies have elucidated the merits of integrating feedback or search mechanisms during model inference to improve the…

Computation and Language · Computer Science 2023-10-17 Qianli Ma , Haotian Zhou , Tingkai Liu , Jianbo Yuan , Pengfei Liu , Yang You , Hongxia Yang

Classifier-free guidance (CFG) is a cornerstone of text-to-image diffusion models, yet its effectiveness is limited by the use of static guidance scales. This "one-size-fits-all" approach fails to adapt to the diverse requirements of…

Classifier-free guidance is a key component for enhancing the performance of conditional generative models across diverse tasks. While it has previously demonstrated remarkable improvements for the sample quality, it has only been…

Machine Learning · Computer Science 2023-12-11 Qinqing Zheng , Matt Le , Neta Shaul , Yaron Lipman , Aditya Grover , Ricky T. Q. Chen

Recent advancements in flow-matching have enabled high-quality text-to-image generation. However, the deterministic nature of flow-matching models makes them poorly suited for reinforcement learning, a key tool for improving image quality…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Benjamin Yu , Jackie Liu , Justin Cui

Current mainstream methods of aligning diffusion models with human preferences typically employ VLM-based reward models. However, these reward models, pre-trained for semantic alignment, struggle to capture the essential perceptual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jaxon Zhang , Binxin Yang , Hubery Yin , Chen Li , Jing Lyu

Recent advances in diffusion models have led to impressive image generation capabilities, but aligning these models with human preferences remains challenging. Reward-based fine-tuning using models trained on human feedback improves…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Dmitrii Sorokin , Maksim Nakhodnov , Andrey Kuznetsov , Aibek Alanov

Classifier-Free Guidance (CFG) has been a default technique in various visual generative models, yet it requires inference from both conditional and unconditional models during sampling. We propose to build visual models that are free from…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Huayu Chen , Kai Jiang , Kaiwen Zheng , Jianfei Chen , Hang Su , Jun Zhu

We present Preference Flow Matching (PFM), a new framework for preference-based reinforcement learning (PbRL) that streamlines the integration of preferences into an arbitrary class of pre-trained models. Existing PbRL methods require…

Machine Learning · Computer Science 2024-10-29 Minu Kim , Yongsik Lee , Sehyeok Kang , Jihwan Oh , Song Chong , Se-Young Yun

Flow matching (FM) learns vector fields by regressing stochastic velocity targets along intermediate distributions $p_t$. We identify a geometric optimization bottleneck in this regression problem: when the covariance $\Sigma_t$ of $p_t$ is…

Machine Learning · Computer Science 2026-05-14 Shadab Ahamed , Eshed Gal , Md Shahriar Rahim Siddiqui , Simon Ghyselincks , Moshe Eliasof , Eldad Haber

State-of-the-art text-to-image models produce high-quality images, but inference remains expensive as generation requires several sequential ODE or denoising steps. Native one-step models aim to reduce this cost by mapping noise to an image…

Flow-based generative modeling is a powerful tool for solving inverse problems in physical sciences that can be used for sampling and likelihood evaluation with much lower inference times than traditional methods. We propose to refine flows…

Machine Learning · Computer Science 2024-10-31 Benjamin Holzschuh , Nils Thuerey

Flow Matching has emerged as a powerful framework for learning continuous transformations between distributions, enabling high-fidelity generative modeling. This work introduces Symmetrical Flow Matching (SymmFlow), a new formulation that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Francisco Caetano , Christiaan Viviers , Peter H. N. De With , Fons van der Sommen

Fine-tuning flow matching models is a central challenge in settings with limited data, evolving distributions, or strict efficiency demands, where unconstrained fine-tuning can erode the accuracy and efficiency gains learned during…

Machine Learning · Computer Science 2026-02-02 Gudrun Thorkelsdottir , Arindam Banerjee

Designing reward functions for efficiently guiding reinforcement learning (RL) agents toward specific behaviors is a complex task. This is challenging since it requires the identification of reward structures that are not sparse and that…

Machine Learning · Computer Science 2023-11-01 Dhawal Gupta , Yash Chandak , Scott M. Jordan , Philip S. Thomas , Bruno Castro da Silva

We propose FlowRL: matching the full reward distribution via flow balancing instead of maximizing rewards in large language model (LLM) reinforcement learning (RL). Recent advanced reasoning models adopt reward-maximizing methods (\eg, PPO…

This paper proposes a novel method, Explicit Flow Matching (ExFM), for training and analyzing flow-based generative models. ExFM leverages a theoretically grounded loss function, ExFM loss (a tractable form of Flow Matching (FM) loss), to…

Machine Learning · Computer Science 2024-07-03 Gleb Ryzhakov , Svetlana Pavlova , Egor Sevriugov , Ivan Oseledets

Flow-based generative models have shown remarkable success in text-to-image generation, yet fine-tuning them with intermediate feedback remains challenging, especially for continuous-time flow matching models. Most existing approaches…

Machine Learning · Computer Science 2025-10-22 Jiajun Fan , Chaoran Cheng , Shuaike Shen , Xiangxin Zhou , Ge Liu

While Classifier-Free Guidance (CFG) has become standard for improving sample fidelity in conditional diffusion models, it can harm diversity and induce memorization by applying constant guidance regardless of whether a particular sample…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Felix Koulischer , Florian Handke , Johannes Deleu , Thomas Demeester , Luca Ambrogioni

Flow matching has demonstrated strong generative capabilities and has become a core component in modern Text-to-Speech (TTS) systems. To ensure high-quality speech synthesis, Classifier-Free Guidance (CFG) is widely used during the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-05 Yuzhe Liang , Wenzhe Liu , Chunyu Qiang , Zhikang Niu , Yushen Chen , Ziyang Ma , Wenxi Chen , Nan Li , Chen Zhang , Xie Chen

Diffusion-based unsupervised image registration has been explored for cardiac cine MR, but expensive multi-step inference limits practical use. We propose FlowReg, a flow-matching framework in displacement field space that achieves strong…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Yunguan Fu , Wenjia Bai , Wen Yan , Matthew J Clarkson , Rhodri Huw Davies , Yipeng Hu