English
Related papers

Related papers: Fine-tuning Flow Matching Generative Models with I…

200 papers

Data heterogeneity hinders clinical deployment of medical image analysis models, and generative data augmentation helps mitigate this issue. However, recent diffusion-based methods that synthesize image-mask pairs often ignore distribution…

Image and Video Processing · Electrical Eng. & Systems 2026-04-06 Jie Yang , Ziqi Ye , Aihua Ke , Jian Luo , Bo Cai , Xiaosong Wang

Recent advancements in reinforcement learning (RL) have achieved great success in fine-tuning diffusion-based generative models. However, fine-tuning continuous flow-based generative models to align with arbitrary user-defined reward…

Machine Learning · Computer Science 2025-02-11 Jiajun Fan , Shuaike Shen , Chaoran Cheng , Yuxin Chen , Chumeng Liang , Ge Liu

Dynamical generative models that produce samples through an iterative process, such as Flow Matching and denoising diffusion models, have seen widespread use, but there have not been many theoretically-sound methods for improving these…

Machine Learning · Computer Science 2025-01-08 Carles Domingo-Enrich , Michal Drozdzal , Brian Karrer , Ricky T. Q. Chen

We study the problem of training diffusion and flow generative models to sample from target distributions defined by an exponential tilting of a base density; a formulation that subsumes both sampling from unnormalized densities and reward…

Machine Learning · Statistics 2026-05-04 Carles Domingo-Enrich , Yuanqi Du , Michael S. Albergo

Flow models are effective at progressively generating realistic images, but they generally struggle to capture long-range dependencies during the generation process as they compress all the information from previous time steps into a single…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mude Hui , Rui-Jie Zhu , Songlin Yang , Yu Zhang , Zirui Wang , Yuyin Zhou , Jason Eshraghian , Cihang Xie

Existing reinforcement learning (RL) methods struggle with long-horizon robotic manipulation tasks, particularly those involving sparse rewards. While action chunking is a promising paradigm for robotic manipulation, using RL to directly…

Robotics · Computer Science 2026-03-02 Jiarui Yang , Bin Zhu , Jingjing Chen , Yu-Gang Jiang

Understanding the dependencies among features of a dataset is at the core of most unsupervised learning tasks. However, a majority of generative modeling approaches are focused solely on the joint distribution $p(x)$ and utilize models…

Machine Learning · Computer Science 2020-08-07 Yang Li , Shoaib Akbar , Junier B. Oliva

Diffusion models have achieved remarkable generation quality, but they suffer from significant inference cost due to their reliance on multiple sequential denoising steps, motivating recent efforts to distill this inference process into a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Zihan Yang , Shuyuan Tu , Licheng Zhang , Qi Dai , Yu-Gang Jiang , Zuxuan Wu

Continual learning in robotics seeks systems that can constantly adapt to changing environments and tasks, mirroring human adaptability. A key challenge is refining dynamics models, essential for planning and control, while addressing…

Robotics · Computer Science 2025-09-09 Alejandro Murillo-Gonzalez , Lantao Liu

A Flow is a collection of component models ("Agents") which constructs the solution to a complex problem via iterative communication. Flows have emerged as state of the art architectures for code generation, and are the raison d'etre for…

Machine Learning · Computer Science 2024-07-17 Paul Mineiro

Existing Flow Matching (FM) text-to-image models suffer from two critical bottlenecks under multi-task alignment: the reward sparsity induced by scalar-valued rewards, and the gradient interference arising from jointly optimizing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zhen Fang , Wenxuan Huang , Yu Zeng , Yiming Zhao , Shuang Chen , Kaituo Feng , Yunlong Lin , Lin Chen , Zehui Chen , Shaosheng Cao , Feng Zhao

Recent progress in flow-based generative models and reinforcement learning (RL) has improved text-image alignment and visual quality. However, current RL training for flow models still has two main problems: (i) GRPO-style fixed per-prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Kaijie Chen , Zhiyang Xu , Ying Shen , Zihao Lin , Yuguang Yao , Lifu Huang

Recent advances in diffusion models have led to impressive image generation capabilities, but aligning these models with human preferences remains challenging. Reward-based fine-tuning using models trained on human feedback improves…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Dmitrii Sorokin , Maksim Nakhodnov , Andrey Kuznetsov , Aibek Alanov

Online reinforcement learning is becoming increasingly important for aligning diffusion models with non-differentiable objectives. However, existing methods still face limitations in assigning fine-grained credit along denoising…

Machine Learning · Computer Science 2026-05-28 Zhengyang Liang , Qihang Zhang , Ceyuan Yang

The growing demand for text-to-image generation has led to rapid advances in generative modeling. Recently, text-to-image diffusion models trained with flow matching algorithms, such as FLUX, have achieved remarkable progress and emerged as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zikai Zhou , Muyao Wang , Shitong Shao , Lichen Bai , Haoyi Xiong , Bo Han , Zeke Xie

Existing rectified flow models are based on linear trajectories between data and noise distributions. This linearity enforces zero curvature, which can inadvertently force the image generation process through low-probability regions of the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yan Luo , Drake Du , Hao Huang , Yi Fang , Mengyu Wang

In image restoration, single-step discriminative mappings often lack fine details via expectation learning, whereas generative paradigms suffer from inefficient multi-step sampling and noise-residual coupling. To address this dilemma, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Zihao Fan , Xin Lu , Jie Xiao , Dong Li , Jie Huang , Xueyang Fu

Recent advancements in video generation models have significantly improved their ability to follow text prompts. However, the customization of dynamic visual effects, defined as temporally evolving and appearance-driven visual phenomena…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Rui Zhao , Mike Zheng Shou

Flow matching has emerged as a promising generative approach that addresses the lengthy sampling times associated with state-of-the-art diffusion models and enables a more flexible trajectory design, while maintaining high-quality image…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Arnela Hadzic , Franz Thaler , Lea Bogensperger , Simon Johannes Joham , Martin Urschler

Taming the generation outcome of state of the art Diffusion and Flow-Matching (FM) models without having to re-train a task-specific model unlocks a powerful tool for solving inverse problems, conditional generation, and controlled…

Machine Learning · Computer Science 2024-07-23 Heli Ben-Hamu , Omri Puny , Itai Gat , Brian Karrer , Uriel Singer , Yaron Lipman