English
Related papers

Related papers: CreFlow: Corrective Reflow for Sparse-Reward Embod…

200 papers

Learning behavior in legged robots presents a significant challenge due to its inherent instability and complex constraints. Recent research has proposed the use of a large language model (LLM) to generate reward functions in reinforcement…

Robotics · Computer Science 2025-07-01 Runhao Zeng , Dingjie Zhou , Qiwei Liang , Junlin Liu , Hui Li , Changxin Huang , Jianqiang Li , Xiping Hu , Fuchun Sun

Reinforcement learning (RL) has improved guided image generation with diffusion models by directly optimizing rewards that capture image quality, aesthetics, and instruction following capabilities. However, the resulting generative policies…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Owen Oertell , Jonathan D. Chang , Yiyi Zhang , Kianté Brantley , Wen Sun

Video diffusion alignment has been heavily relied on scalar rewards. These rewards are typically derived from learned reward models in human preference datasets, requiring additional training and extensive collection. Moreover, scalar…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yifan Wang , Yanyu Li , Gordon Guocheng Qian , Sergey Tulyakov , Yun Fu , Anil Kag

Diffusion models are powerful generative models that allow for precise control over the characteristics of the generated samples. While these diffusion models trained on large datasets have achieved success, there is often a need to…

Offline reinforcement learning (RL) provides a compelling paradigm for training autonomous systems without the risks of online exploration, particularly in safety-critical domains. However, jointly achieving strong safety and performance…

Machine Learning · Computer Science 2026-02-10 Manan Tayal , Mumuksh Tayal

While few-step generative models have enabled powerful image and video generation at significantly lower cost, generic reinforcement learning (RL) paradigms for few-step models remain an unsolved problem. Existing RL approaches for few-step…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yihong Luo , Tianyang Hu , Weijian Luo , Jing Tang

Reinforcement learning (RL) has become a standard approach for post-training large language models and, more recently, for improving image generation models, which uses reward functions to enhance generation quality and human preference…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Yunqi Hong , Kuei-Chun Kao , Hengguang Zhou , Cho-Jui Hsieh

Reinforcement learning (RL) has become a standard paradigm for refining large language models (LLMs) beyond pre-training and instruction tuning. A prominent line of work is RL with verifiable rewards (RLVR), which leverages automatically…

Machine Learning · Computer Science 2025-09-23 Bonan Zhang , Zhongqi Chen , Bowen Song , Qinya Li , Fan Wu , Guihai Chen

Diffusion and flow models achieve State-Of-The-Art (SOTA) generative performance, yet many practically important behaviors such as fine-grained prompt fidelity, compositional correctness, and text rendering are weakly specified by score or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yuanzhi Zhu , Xi Wang , Stéphane Lathuilière , Vicky Kalogeiton

Generative models have made significant progress in synthesizing visual content, including images, videos, and 3D/4D structures. However, they are typically trained with surrogate objectives such as likelihood or reconstruction loss, which…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yuanzhi Liang , Yijie Fang , Ke Hao , Rui Li , Ziqi Ni , Ruijie Su , Chi Zhang

Existing rectified flow models are based on linear trajectories between data and noise distributions. This linearity enforces zero curvature, which can inadvertently force the image generation process through low-probability regions of the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yan Luo , Drake Du , Hao Huang , Yi Fang , Mengyu Wang

Large-scale flow matching models have achieved strong performance across generative tasks such as text-to-image, video, 3D, and speech synthesis. However, aligning their outputs with human preferences and task-specific objectives remains…

Machine Learning · Computer Science 2026-03-10 Zexiang Liu , Xianglong He , Yangguang Li

Automatically generating training supervision for embodied tasks is crucial, as manual designing is tedious and not scalable. While prior works use large language models (LLMs) or vision-language models (VLMs) to generate rewards, these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Xiaowen Qiu , Yian Wang , Jiting Cai , Zhehuan Chen , Chunru Lin , Tsun-Hsuan Wang , Chuang Gan

Recent advances in flow matching models have significantly improved text-to-image generation quality, but also introduce growing safety risks due to the generation of harmful or undesirable content. Existing concept erasure methods are…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yi Sun , Zhiqi Zhang , Xinhao Zhong , Yimin Zhou , Shuoyang Sun , Bin Chen , Shu-Tao Xia , Ke Xu

Aligning generative diffusion models with human preferences via reinforcement learning (RL) is critical yet challenging. Most existing algorithms are often vulnerable to reward hacking, such as quality degradation, over-stylization, or…

Current mainstream methods of aligning diffusion models with human preferences typically employ VLM-based reward models. However, these reward models, pre-trained for semantic alignment, struggle to capture the essential perceptual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jaxon Zhang , Binxin Yang , Hubery Yin , Chen Li , Jing Lyu

Distilled autoregressive (AR) video models enable efficient streaming generation but frequently misalign with human visual preferences. Existing reinforcement learning (RL) frameworks are not naturally suited to these architectures,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Songchun Zhang , Zeyue Xue , Siming Fu , Jie Huang , Xianghao Kong , Y Ma , Haoyang Huang , Nan Duan , Anyi Rao

Recent advancements in video generation models have significantly improved their ability to follow text prompts. However, the customization of dynamic visual effects, defined as temporally evolving and appearance-driven visual phenomena…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Rui Zhao , Mike Zheng Shou

While most prior work in video generation relies on bidirectional architectures, recent efforts have sought to adapt these models into autoregressive variants to support near real-time generation. However, such adaptations often depend…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Jingran Zhang , Ning Li , Yuanhao Ban , Andrew Bai , Justin Cui

Reward Models (RMs) are critical for improving generation models via Reinforcement Learning (RL), yet the RM scaling paradigm in visual generation remains largely unexplored. It primarily due to fundamental limitations in existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Jie Wu , Yu Gao , Zilyu Ye , Ming Li , Liang Li , Hanzhong Guo , Jie Liu , Zeyue Xue , Xiaoxia Hou , Wei Liu , Yan Zeng , Weilin Huang