English
Related papers

Related papers: How to Guide Your Flow: Few-Step Alignment via Flo…

200 papers

Deep generative models, particularly diffusion and flow matching models, have recently shown remarkable potential in learning complex policies through imitation learning. However, the safety of generated motions remains overlooked,…

Robotics · Computer Science 2025-08-13 Haoran Ding , Anqing Duan , Zezhou Sun , Leonel Rozo , Noémie Jaquier , Dezhen Song , Yoshihiko Nakamura

Reinforcement learning from human feedback (RLHF) with reward models has advanced alignment of generative models to human aesthetic and perceptual preferences. However, jointly optimizing multiple rewards often incurs an alignment tax,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Chieh-Yun Chen , Zhonghao Wang , Qi Chen , Zhifan Ye , Min Shi , Yue Zhao , Yinan Zhao , Hui Qu , Wei-An Lin , Yiru Shen , Ajinkya Kale , Irfan Essa , Humphrey Shi

Generative models can produce nonsensical text, unrealistic images, and unstable materials faster than simulation or human review can absorb; without per-sample confidence, trust erodes. Existing fixes run $k$ ensembles or stochastic…

Machine Learning · Statistics 2026-05-19 Friso de Kruiff , Dario Coscia , Max Welling , Erik Bekkers

Flow-based generative models achieve state-of-the-art sample quality, but require the expensive solution of a differential equation at inference time. Flow map models, commonly known as consistency models, encompass many recent efforts to…

Machine Learning · Computer Science 2025-10-07 Nicholas M. Boffi , Michael S. Albergo , Eric Vanden-Eijnden

Flow matching has recently emerged as a promising alternative to diffusion-based generative models, particularly for text-to-image generation. Despite its flexibility in allowing arbitrary source distributions, most existing approaches rely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Junwan Kim , Jiho Park , Seonghu Jeon , Seungryong Kim

Recent advances in human preference alignment have significantly improved multimodal generation and understanding. A key approach is to train reward models that provide supervision signals for preference optimization. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Yibin Wang , Yuhang Zang , Hao Li , Cheng Jin , Jiaqi Wang

Graph Retrieval-Augmented Generation (GraphRAG) has shown great effectiveness in enhancing the reasoning abilities of LLMs by leveraging graph structures for knowledge representation and modeling complex real-world relationships. However,…

Machine Learning · Computer Science 2026-01-28 Chuanyue Yu , Kuo Zhao , Yuhan Li , Heng Chang , Mingjian Feng , Xiangzhe Jiang , Yufei Sun , Jia Li , Yuzhi Zhang , Jianxin Li , Ziwei Zhang

Reconstructing PDE solutions from sparse observations is a core challenge in scientific computing. We present FM4PDE, a flow-matching generative framework that learns the joint distribution of PDE coefficients (or initial states) and…

Machine Learning · Statistics 2026-05-26 Xifeng Zhang , Jin Zhao

We introduce Categorical Flow Maps, a flow-matching method for accelerated few-step generation of categorical data via self-distillation. Building on recent variational formulations of flow matching and the broader trend towards accelerated…

Reward design is a fundamental problem in reinforcement learning (RL). A misspecified or poorly designed reward can result in low sample efficiency and undesired behaviors. In this paper, we propose the idea of programmatic reward design,…

Machine Learning · Computer Science 2022-01-10 Weichao Zhou , Wenchao Li

During the last decade, incremental sampling-based motion planning algorithms, such as the Rapidly-exploring Random Trees (RRTs) have been shown to work well in practice and to possess theoretical guarantees such as probabilistic…

Robotics · Computer Science 2010-05-05 Sertac Karaman , Emilio Frazzoli

Safety mechanisms for diffusion and flow models have recently been developed along two distinct paths. In robot planning, control barrier functions are employed to guide generative trajectories away from obstacles at every denoising step by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Mingyu Kim , Young-Heon Kim , Mijung Park

Generating high-quality time-series data is challenging because real-world signals often exhibit multimodal patterns and multiscale dynamics, including oscillations and high-frequency variations. Flow Matching (FM) offers an efficient…

Machine Learning · Computer Science 2026-05-29 Junru Zhang , Lang Feng , Jinbo Wang , Xu Guo , Yucheng Wang , Han Yu , Min Wu , Yabo Dong , Duanqing Xu

Diffusion models have demonstrated empirical successes in various applications and can be adapted to task-specific needs via guidance. This paper studies a form of gradient guidance for adapting a pre-trained diffusion model towards…

Machine Learning · Statistics 2024-10-17 Yingqing Guo , Hui Yuan , Yukang Yang , Minshuo Chen , Mengdi Wang

A key challenge in music generation models is their lack of direct alignment with human preferences, as music evaluation is inherently subjective and varies widely across individuals. We introduce MR-FlowDPO, a novel approach that enhances…

Sound · Computer Science 2025-12-16 Alon Ziv , Sanyuan Chen , Andros Tjandra , Yossi Adi , Wei-Ning Hsu , Bowen Shi

The accelerated method in solving optimization problems has always been an absorbing topic. Based on the fixed-time (FxT) stability of nonlinear dynamical systems, we provide a unified approach for designing FxT gradient flows (FxTGFs).…

Optimization and Control · Mathematics 2023-11-14 Xinli Shi , Xiangping Xu , Guanghui Wen , Jinde Cao

We present a framework for assistive robot manipulation, which focuses on two fundamental challenges: first, efficiently adapting large-scale models to downstream scene affordance understanding tasks, especially in daily living scenarios…

Robotics · Computer Science 2025-11-10 Fan Zhang , Michael Gienger

Generative query suggestion using large language models offers a powerful way to enhance conversational systems, but aligning outputs with nuanced user preferences remains a critical challenge. To address this, we introduce a multi-stage…

Computation and Language · Computer Science 2025-12-16 Junhao Yin , Haolin Wang , Peng Bao , Ju Xu , Yongliang Wang

Classifier-Free Guidance (CFG) is a widely adopted technique in diffusion/flow models to improve image fidelity and controllability. In this work, we first analytically study the effect of CFG on flow matching models trained on Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Weichen Fan , Amber Yijia Zheng , Raymond A. Yeh , Ziwei Liu

Building on the success of diffusion models in visual generation, flow-based models reemerge as another prominent family of generative models that have achieved competitive or better performance in terms of both visual quality and inference…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Wenliang Zhao , Minglei Shi , Xumin Yu , Jie Zhou , Jiwen Lu