English
Related papers

Related papers: Taming Camera-Controlled Video Generation with Ver…

200 papers

Reinforcement learning from verifiable rewards (RLVR) has recently been extended from text-only LLMs to vision-language models (VLMs) to elicit long-chain multimodal reasoning. However, RLVR-trained VLMs still exhibit two persistent failure…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Hoang Anh Just , Yifei Fan , Handong Zhao , Jiuxiang Gu , Ruiyi Zhang , Simon Jenni , Kushal Kafle , Ruoxi Jia , Jing Shi

This paper presents CLIP-RLDrive, a new reinforcement learning (RL)-based framework for improving the decision-making of autonomous vehicles (AVs) in complex urban driving scenarios, particularly in unsignalized intersections. To achieve…

Robotics · Computer Science 2024-12-24 Erfan Doroudian , Hamid Taghavifar

The strong performance of large vision-language models (VLMs) trained with reinforcement learning (RL) has motivated similar approaches for fine-tuning vision-language-action (VLA) models in robotics. Many recent works fine-tune VLAs…

Robotics · Computer Science 2026-03-31 Andrew Choi , Xinjie Wang , Zhizhong Su , Wei Xu

While recent advances in Reinforcement Fine-Tuning (RFT) have shown that rule-based reward schemes can enable effective post-training for large language models, their extension to cross-modal, vision-centric domains remains largely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Guangjing Yang , ZhangYuan Yu , Ziyuan Qin , Xinyuan Song , Huahui Yi , Qingbo Kang , Jun Gao , Yiyue Li , Chenlin Du , Qicheng Lao

Recent advances in vision-language models (VLMs) have significantly improved performance in embodied tasks such as goal decomposition and visual comprehension. However, providing accurate rewards for robotic manipulation without fine-tuning…

Robotics · Computer Science 2025-07-08 Yinuo Zhao , Jiale Yuan , Zhiyuan Xu , Xiaoshuai Hao , Xinyi Zhang , Kun Wu , Zhengping Che , Chi Harold Liu , Jian Tang

Advanced reasoning in LLMs on challenging domains like mathematical reasoning can be tackled using verifiable rewards based reinforced fine-tuning (ReFT). In standard ReFT frameworks, a behavior model generates multiple completions with…

Machine Learning · Computer Science 2025-11-25 Maxime Heuillet , Yufei Cui , Boxing Chen , Audrey Durand , Prasanna Parthasarathi

Neural video compression (NVC) has demonstrated superior compression efficiency, yet effective rate control remains a significant challenge due to complex temporal dependencies. Existing rate control schemes typically leverage frame content…

Image and Video Processing · Electrical Eng. & Systems 2026-02-03 Wuyang Cong , Junqi Shi , Lizhong Wang , Weijing Shi , Ming Lu , Hao Chen , Zhan Ma

The growing capability of video generation poses escalating security risks, making reliable detection increasingly essential. In this paper, we introduce VideoVeritas, a framework that integrates fine-grained perception and fact-based…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Hao Tan , Jun Lan , Senyuan Shi , Zichang Tan , Zijian Yu , Huijia Zhu , Weiqiang Wang , Jun Wan , Zhen Lei

We show that reinforcement learning with verifiable rewards (RLVR) can elicit strong mathematical reasoning in certain language models even with spurious rewards that have little, no, or even negative correlation with the correct answer.…

Multi-image reasoning and grounding require understanding complex cross-image relationships at both object levels and image levels. Current Large Visual Language Models (LVLMs) face two critical challenges: the lack of cross-image reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Lihao Zheng , Jiawei Chen , Xintian Shen , Hao Ma , Tao Wei

Recent advances in one-step text-to-image generation have enabled real-time synthesis with remarkable efficiency and quality. Previous reinforcement learning methods for one-step generators combine image-space reward optimization with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Junyi Wu , Weijian Luo , Haoyang Zheng , Ruizhe Zhang , Guang Lin

We present a novel method for generating geometrically realistic and consistent orbital videos from a single image of an object. Existing video generation works mostly rely on pixel-wise attention to enforce view consistency across frames.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Rong Wang , Ruyi Zha , Ziang Cheng , Jiayu Yang , Pulak Purkait , Hongdong Li

While Reinforcement Learning with Verifiable Rewards (RLVR) is effective for deterministically checkable tasks, many vision-language tasks are partially verifiable, demanding multi-criteria supervision (e.g., perceptual details, reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ya-Qi Yu , Hao Wang , Fangyu Hong , Xiangyang Qu , Gaojie Wu , Qiaoyu Luo , Nuo Xu , Huixin Wang , Wuheng Xu , Yongxin Liao , Zihao Chen , Haonan Li , Ziming Li , Dezhi Peng , Minghui Liao , Jihao Wu , Haoyu Ren , Dandan Tu

In principle, meta-reinforcement learning algorithms leverage experience across many tasks to learn fast reinforcement learning (RL) strategies that transfer to similar tasks. However, current meta-RL approaches rely on manually-defined…

Artificial Intelligence · Computer Science 2019-12-10 Allan Jabri , Kyle Hsu , Ben Eysenbach , Abhishek Gupta , Sergey Levine , Chelsea Finn

Reinforcement Learning with Verifiable Rewards (RLVR) replaces costly human labeling with automated verifiers. To reduce verifier hacking, many RLVR systems binarize rewards to $\{0,1\}$, but imperfect verifiers inevitably introduce…

Machine Learning · Computer Science 2026-05-25 Xin-Qiang Cai , Wei Wang , Feng Liu , Tongliang Liu , Gang Niu , Masashi Sugiyama

Video matting has traditionally been limited by the lack of high-quality ground-truth data. Most existing video matting datasets provide only human-annotated imperfect alpha and foreground annotations, which must be composited to background…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Yongtao Ge , Kangyang Xie , Guangkai Xu , Mingyu Liu , Li Ke , Longtao Huang , Hui Xue , Hao Chen , Chunhua Shen

Reinforcement learning from human feedback (RLHF) has proven effective in aligning large language models with human preferences, inspiring the development of reward-centric diffusion reinforcement learning (RDRL) to achieve similar…

Machine Learning · Computer Science 2026-03-24 Kwanyoung Kim , Byeongsu Sim

Large Vision-Language Models (LVLMs) typically follow a two-stage training paradigm-pretraining and supervised fine-tuning. Recently, preference optimization, derived from the language domain, has emerged as an effective post-training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yufei Zhan , Yousong Zhu , Shurong Zheng , Hongyin Zhao , Fan Yang , Ming Tang , Jinqiao Wang

In this paper we introduce a fully end-to-end approach for visual tracking in videos that learns to predict the bounding box locations of a target object at every frame. An important insight is that the tracking problem can be considered as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Da Zhang , Hamid Maei , Xin Wang , Yuan-Fang Wang

Recently, video-based world models that learn to simulate the dynamics have gained increasing attention in robot learning. However, current approaches primarily emphasize visual generative quality while overlooking physical fidelity,…

Robotics · Computer Science 2026-01-21 Baorui Peng , Wenyao Zhang , Liang Xu , Zekun Qi , Jiazhao Zhang , Hongsi Liu , Wenjun Zeng , Xin Jin