English
Related papers

Related papers: Identity-GRPO: Optimizing Multi-Human Identity-pre…

200 papers

Large Language Models (LLMs) are increasingly deployed in business-critical domains such as finance, education, healthcare, and customer support, where users expect consistent and reliable recommendations. Yet LLMs often exhibit variability…

Machine Learning · Computer Science 2026-04-20 Sonal Prabhune , Balaji Padmanabhan , Kaushik Dutta

The continuous development of foundational models for video generation is evolving into various applications, with subject-consistent video generation still in the exploratory stage. We refer to this as Subject-to-Video, which extracts…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Lijie Liu , Tianxiang Ma , Bingchuan Li , Zhuowei Chen , Jiawei Liu , Gen Li , Siyu Zhou , Qian He , Xinglong Wu

Consistent image generation requires faithfully preserving identities, styles, and logical coherence across multiple images, which is essential for applications such as storytelling and character design. Supervised training approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Bowen Ping , Chengyou Jia , Minnan Luo , Changliang Xia , Xin Shen , Zhuohang Dang , Hangwei Qian

Generative AI has significantly changed industries by enabling text-driven image generation, yet challenges remain in achieving high-resolution outputs that align with fine-grained user preferences. Consequently, multi-round interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Kun Li , Jianhui Wang , Yangfan He , Xinyuan Song , Ruoyu Wang , Hongyang He , Wenxin Zhang , Jiaqi Chen , Keqin Li , Sida Li , Miao Zhang , Tianyu Shi , Xueqian Wang

Recent advances in flow matching models, particularly with reinforcement learning (RL), have significantly enhanced human preference alignment in few step text to image generators. However, existing RL based approaches for flow matching…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Zhixiong Yue , Zixuan Ni , Feiyang Ye , Jinshan Zhang , Sheng Shen , Zhenpeng Mi

Recent advancements in multimodal reward models (RMs) have significantly propelled the development of visual generation. Existing frameworks typically adopt Bradley-Terry-style preference modeling or leverage generative VLMs as judges, and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Yibin Wang , Yuhang Zang , Feng Han , Jiazi Bu , Yujie Zhou , Cheng Jin , Jiaqi Wang

Video generation models produce visually coherent content but struggle with tasks requiring spatial reasoning and multi-step planning. Reinforcement learning (RL) offers a path to improve generalization, but its effectiveness in video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Ming Liu , Yunbei Zhang , Shilong Liu , Liwen Wang , Wensheng Zhang

Person re-identification (ReID) suffers from a lack of large-scale high-quality training data due to challenges in data privacy and annotation costs. While previous approaches have explored pedestrian generation for data augmentation, they…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Changxiao Ma , Chao Yuan , Xincheng Shi , Yuzhuo Ma , Yongfei Zhang , Longkun Zhou , Yujia Zhang , Shangze Li , Yifan Xu

Unified multimodal pretraining has emerged as a promising paradigm for jointly modeling language and vision within a single foundation model. However, existing approaches largely rely on implicit or indirect alignment signals and remain…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Shentong Mo , Sukmin Yun

Recent studies suggest that Reinforcement Fine-Tuning (RFT) is inherently more resilient to catastrophic forgetting than Supervised Fine-Tuning (SFT). However, whether RFT (e.g., GRPO) can effectively overcome forgetting in challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Meng Lou , Hanzhong Guo , Linwei Chen , Yizhou Yu

Recent advances in large video-language models (VLMs) rely on extensive fine-tuning techniques that strengthen alignment between textual and visual comprehension. Leading pipelines typically pair supervised fine-tuning (SFT) with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Derek Shi , Ruben Glatt , Christine Klymko , Shubham Mohole , Hongjun Choi , Shashank Kushwaha , Sam Sakla , Felipe Leno da Silva

Recent advances have demonstrated compelling capabilities in synthesizing real individuals into generated videos, reflecting the growing demand for identity-aware content creation. Nevertheless, an openly accessible framework enabling…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yingjie Chen , Shilun Lin , Cai Xing , Binxin Yang , Long Zhou , Qixin Yan , Wenjing Wang , Dingming Liu , Hao Liu , Chen Li , Jing Lyu

Recent advancements in Reinforcement Learning (RL), particularly Group Relative Policy Optimization (GRPO), have significantly enhanced the reasoning capabilities of Large Language Models. However, applying these problem-centric…

Computation and Language · Computer Science 2026-05-26 Yihong Tang , Kehai Chen , Liang Yue , Benyou Wang , Min Zhang

While recent text-to-video (T2V) diffusion models have achieved impressive quality and prompt alignment, they often produce low-diversity outputs when sampling multiple videos from a single text prompt. We tackle this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Tahira Kazimi , Connor Dunlop , Pinar Yanardag

While large-scale video diffusion models have demonstrated impressive capabilities in generating high-resolution and semantically rich content, a significant gap remains between their pretraining performance and real-world deployment…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Zeyue Xue , Siming Fu , Jie Huang , Shuai Lu , Haoran Li , Yijun Liu , Yuming Li , Xiaoxuan He , Mengzhao Chen , Haoyang Huang , Nan Duan , Ping Luo

Optimizing communication topology is fundamental to the efficiency and effectiveness of Large Language Model (LLM)-based Multi-Agent Systems (MAS). While recent approaches utilize reinforcement learning to dynamically construct…

Computation and Language · Computer Science 2026-03-04 Yueyang Cang , Xiaoteng Zhang , Erlu Zhao , Zehua Ji , Yuhang Liu , Yuchen He , Zhiyuan Ning , Chen Yijun , Wenge Que , Li Shi

Training robust and generalizable reward models for human visual preferences is essential for aligning text-to-image and text-to-video generative models with human intent. However, current reward models often fail to generalize, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Alexander Gambashidze , Li Pengyi , Matvey Skripkin , Andrey Galichin , Anton Gusarov , Konstantin Sobolev , Andrey Kuznetsov , Ivan Oseledets

Applying Reinforcement Learning (RL) to Video Large Language Models (Video-LLMs) shows significant promise for complex video reasoning. However, popular Reinforcement Fine-Tuning (RFT) methods, such as outcome-based Group Relative Policy…

Computation and Language · Computer Science 2025-05-27 Yunxin Li , Xinyu Chen , Zitao Li , Zhenyu Liu , Longyue Wang , Wenhan Luo , Baotian Hu , Min Zhang

Fine-tuning pre-trained generative models with Reinforcement Learning (RL) has emerged as an effective approach for aligning outputs more closely with nuanced human preferences. In this paper, we investigate the application of Group…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Matteo Gallici , Haitz Sáez de Ocáriz Borde

A reliable reward function is essential for reinforcement learning (RL) in image generation. Most current RL approaches depend on pre-trained preference models that output scalar rewards to approximate human preferences. However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Weijia Mao , Hao Chen , Zhenheng Yang , Mike Zheng Shou