English
Related papers

Related papers: Taming Camera-Controlled Video Generation with Ver…

200 papers

Reinforcement fine-tuning with verifiable rewards (RLVR) has emerged as a powerful paradigm for equipping large vision-language models (LVLMs) with agentic capabilities such as tool use and multi-step reasoning. Despite striking empirical…

Machine Learning · Computer Science 2026-04-23 Carter Adams , Rafael Oliveira , Gabriel Almeida , Sofia Torres

Reward feedback learning (ReFL) has proven effective for aligning image generation with human preferences. However, its extension to video generation faces significant challenges. Existing video reward models rely on vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Xiaoyue Mi , Wenqing Yu , Jiesong Lian , Shibo Jie , Ruizhe Zhong , Zijun Liu , Guozhen Zhang , Zixiang Zhou , Zhiyong Xu , Yuan Zhou , Qinglin Lu , Fan Tang

Vision-Language-Action (VLA) models enable embodied decision-making but rely heavily on imitation learning, leading to compounding errors and poor robustness under distribution shift. Reinforcement learning (RL) can mitigate these issues…

Instruction-guided image editing has achieved remarkable progress, yet current models still face challenges with complex instructions and often require multiple samples to produce a desired result. Reinforcement Learning (RL) offers a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xin Luo , Jiahao Wang , Chenyuan Wu , Shitao Xiao , Xiyan Jiang , Defu Lian , Jiajun Zhang , Dong Liu , Zheng liu

Scalable Vector Graphics (SVG) offer a powerful format for representing visual designs as interpretable code. Recent advances in vision-language models (VLMs) have enabled high-quality SVG generation by framing the problem as a code…

Reinforcement learning (RL) has become a standard approach for post-training large language models and, more recently, for improving image generation models, which uses reward functions to enhance generation quality and human preference…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Yunqi Hong , Kuei-Chun Kao , Hengguang Zhou , Cho-Jui Hsieh

Reinforcement learning (RL) with verifiable rewards (RLVR) has demonstrated the great potential of enhancing the reasoning abilities in multimodal large language models (MLLMs). However, the reliance on language-centric priors and expensive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Jiahao Xie , Alessio Tonioni , Nathalie Rauschmayr , Federico Tombari , Bernt Schiele

Recent advancements adopt online reinforcement learning (RL) from LLMs to text-to-image rectified flow diffusion models for reward alignment. The use of group-level rewards successfully aligns the model with the targeted reward. However, it…

Machine Learning · Computer Science 2026-01-06 Yiyang Wang , Xi Chen , Xiaogang Xu , Yu Liu , Hengshuang Zhao

World models predict state transitions in response to actions and are increasingly developed across diverse modalities. However, standard training objectives such as maximum likelihood estimation (MLE) often misalign with task-specific…

Machine Learning · Computer Science 2025-10-28 Jialong Wu , Shaofeng Yin , Ningya Feng , Mingsheng Long

Recent advances in video reward models and post-training strategies have improved text-to-video (T2V) generation. While these models typically assess visual quality, motion quality, and text alignment, they often overlook key structural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yuan Wang , Borui Liao , Huijuan Huang , Jinda Lu , Ouxiang Li , Kuien Liu , Meng Wang , Xiang Wang

Recent unsupervised pre-training methods have shown to be effective on language and vision domains by learning useful representations for multiple downstream tasks. In this paper, we investigate if such unsupervised pre-training methods can…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Younggyo Seo , Kimin Lee , Stephen James , Pieter Abbeel

Automatically generating training supervision for embodied tasks is crucial, as manual designing is tedious and not scalable. While prior works use large language models (LLMs) or vision-language models (VLMs) to generate rewards, these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Xiaowen Qiu , Yian Wang , Jiting Cai , Zhehuan Chen , Chunru Lin , Tsun-Hsuan Wang , Chuang Gan

The stability of visual odometry (VO) systems is undermined by degraded image quality, especially in environments with significant illumination changes. This study employs a deep reinforcement learning (DRL) framework to train agents for…

Robotics · Computer Science 2024-12-24 Shuyang Zhang , Jinhao He , Yilong Zhu , Jin Wu , Jie Yuan

Large language models (LLMs) trained via pretraining and supervised fine-tuning (SFT) can still produce harmful and misaligned outputs, or struggle in domains like math and coding. Reinforcement learning (RL)-based post-training methods,…

Computation and Language · Computer Science 2026-05-19 Zhichao Wang , Kiran Ramnath , Bin Bi , Shiva Kumar Pentyala , Sougata Chaudhuri , Shubham Mehrotra , Zixu , Zhu , Xiang-Bo Mao , Sitaram Asur , Na , Cheng

Diffusion models excel at modeling complex data distributions, including those of images, proteins, and small molecules. However, in many cases, our goal is to model parts of the distribution that maximize certain properties: for example,…

Reward design remains a critical bottleneck in visual reinforcement learning (RL) for robotic manipulation. In simulated environments, rewards are conventionally designed based on the distance to a target position. However, such precise…

Machine Learning · Computer Science 2025-09-29 Nan Tang , Jing-Cheng Pang , Guanlin Li , Chao Qian , Yang Yu

A reliable reward function is essential for reinforcement learning (RL) in image generation. Most current RL approaches depend on pre-trained preference models that output scalar rewards to approximate human preferences. However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Weijia Mao , Hao Chen , Zhenheng Yang , Mike Zheng Shou

Diffusion and flow-matching models scale because pretraining is supervised regression: a clean sample is noised analytically, and a model regresses against a closed-form target. RL post-training aligns the model with a reward. In image…

Machine Learning · Computer Science 2026-05-19 Andreas Bergmeister , Stefanie Jegelka , Nikolas Nüsken , Carles Domingo-Enrich , Jakiw Pidstrigach

Online Reinforcement Learning (RL) offers a promising avenue for complex image editing but is currently constrained by the scarcity of reliable and fine-grained reward signals. Existing evaluators frequently struggle with a critical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Yancheng Long , Yankai Yang , Hongyang Wei , Wei Chen , Tianke Zhang , Haonan fan , Changyi Liu , Kaiyu Jiang , Jiankang Chen , Kaiyu Tang , Bin Wen , Fan Yang , Tingting Gao , Han Li , Shuo Yang

While few-step generative models have enabled powerful image and video generation at significantly lower cost, generic reinforcement learning (RL) paradigms for few-step models remain an unsolved problem. Existing RL approaches for few-step…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yihong Luo , Tianyang Hu , Weijian Luo , Jing Tang