English
Related papers

Related papers: From Sparse to Dense: Multi-View GRPO for Flow Mod…

200 papers

Traditional policy learning methods in cooperative pursuit face fundamental challenges in biomimetic underwater robots, where long-horizon decision making, partial observability, and inter-robot coordination require both expressiveness and…

Robotics · Computer Science 2026-04-22 Yukai Feng , Zhiheng Wu , Zhengxing Wu , Junwen Gu , Junzhi Yu

Graph routing problems play a vital role in web-related networks, where finding optimal paths across graphs is essential for efficient data transmission and content delivery. Classic routing formulations such as the Traveling Salesman…

Machine Learning · Computer Science 2025-10-13 Shiyan Liu , Bohan Tan , Zhiguang Cao , Yan Jin

Reinforcement Learning with Verifiable Rewards (RLVR), primarily driven by the Group Relative Policy Optimization (GRPO) algorithm, is a leading approach for enhancing the reasoning abilities of Large Language Models (LLMs). Despite its…

Machine Learning · Computer Science 2025-10-21 Kangqi Ni , Zhen Tan , Zijie Liu , Pingzhi Li , Tianlong Chen

Reinforcement learning, particularly Group Relative Policy Optimization (GRPO), has emerged as an effective framework for post-training visual generative models with human preference signals. However, its effectiveness is fundamentally…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Rui Li , Ke Hao , Yuanzhi Liang , Haibin Huang , Chi Zhang , Yun Gu , XueLong Li

Multi-subject personalized image generation aims to synthesize customized images containing multiple specified subjects without requiring test-time optimization. However, achieving fine-grained independent control over multiple subjects…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Qiaoqiao Jin , Siming Fu , Dong She , Weinan Jia , Hualiang Wang , Mu Liu , Jidong Jiang

Conventional Retrieval-Augmented Generation (RAG) systems often struggle with complex multi-hop queries over long documents due to their single-pass retrieval. We introduce MM-Doc-R1, a novel framework that employs an agentic, vision-aware…

Computation and Language · Computer Science 2026-04-16 Jiahang Lin , Kai Hu , Binghai Wang , Yuhao Zhou , Zhiheng Xi , Honglin Guo , Shichun Liu , Junzhe Wang , Shihan Dou , Enyu Zhou , Hang Yan , Zhenhua Han , Tao Gui , Qi Zhang , Xuanjing Huang

While Group Relative Policy Optimization (GRPO) offers a powerful framework for LLM post-training, its effectiveness in open-ended domains like Machine Translation hinges on accurate intra-group ranking. We identify that standard Scalar…

Computation and Language · Computer Science 2026-02-17 Sen Yang , Shanbo Cheng , Lu Xu , Jianbing Zhang , Shujian Huang

The evolution of Large Language Models (LLMs) has catalyzed a paradigm shift from superficial instruction following to rigorous long-horizon reasoning. While Group Relative Policy Optimization (GRPO) has emerged as a pivotal mechanism for…

Artificial Intelligence · Computer Science 2026-01-01 Xuan Xie , Xuan Wang , Wenjie Wang , Shuai Chen , Wei Lin

In text-video retrieval, auxiliary captions are often used to enhance video understanding, bridging the gap between the modalities. While recent advances in multi-modal large language models (MLLMs) have enabled strong zero-shot caption…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Ji Soo Lee , Byungoh Ko , Jaewon Cho , Howoong Lee , Jaewoon Byun , Hyunwoo J. Kim

Recent advances in large language models (LLMs) have shown strong reasoning capabilities through large-scale pretraining and post-training reinforcement learning, demonstrated by DeepSeek-R1. However, current post-training methods, such as…

Artificial Intelligence · Computer Science 2025-12-04 Boyang Gu , Hongjian Zhou , Bradley Max Segal , Jinge Wu , Zeyu Cao , Hantao Zhong , Lei Clifton , Fenglin Liu , David A. Clifton

Group Relative Policy Optimization (GRPO) has recently emerged as an effective approach for improving the reasoning capabilities of large language models through online multi-objective reinforcement learning. While personalization on…

Machine Learning · Computer Science 2026-02-03 Ziyao Wang , Daeun Jung , Yexiao He , Guoheng Sun , Zheyu Shen , Myungjin Lee , Ang Li

The performance of image generation has been significantly improved in recent years. However, the study of image screening is rare and its performance with Multimodal Large Language Models (MLLMs) is unsatisfactory due to the lack of data…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Zhiyuan Hu , Zheng Sun , Yi Wei , Long Yu

Reinforcement learning has significantly enhanced the reasoning capabilities of Large Language Models (LLMs) in complex problem-solving tasks. Recently, the introduction of DeepSeek R1 has inspired a surge of interest in leveraging…

Machine Learning · Computer Science 2025-08-07 Jinghang Han , Jiawei Chen , Hang Shao , Hao Ma , Mingcheng Li , Xintian Shen , Lihao Zheng , Wei Chen , Tao Wei , Lihua Zhang

Aligning text-to-image (T2I) diffusion models with Direct Preference Optimization (DPO) has shown notable improvements in generation quality. However, applying DPO to T2I faces two challenges: the sensitivity of DPO to preference pairs and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Renjie Chen , Wenfeng Lin , Yichen Zhang , Jiangchuan Wei , Boyuan Liu , Chao Feng , Jiao Ran , Mingyu Guo

The performance of image generation has been significantly improved in recent years. However, the study of image screening is rare, and its performance with Multimodal Large Language Models (MLLMs) is unsatisfactory due to the lack of data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zhiyuan Hu , Zheng Sun , Yi Wei , Long Yu

Group-relative policy optimization methods train language models by generating multiple rollouts per prompt and normalizing rewards with a shared mean reward baseline. In resource-constrained settings where the rollout budget is small,…

Machine Learning · Computer Science 2026-02-02 Youngeun Kim

This paper introduces TempSamp-R1, a new reinforcement fine-tuning framework designed to improve the effectiveness of adapting multimodal large language models (MLLMs) to video temporal grounding tasks. We reveal that existing reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Yunheng Li , Jing Cheng , Shaoyong Jia , Hangyi Kuang , Shaohui Jiao , Qibin Hou , Ming-Ming Cheng

Text-to-Visualization (Text2Vis) systems translate natural language queries over tabular data into concise answers and executable visualizations. While closed-source LLMs generate functional code, the resulting charts often lack semantic…

Computation and Language · Computer Science 2026-01-09 Mizanur Rahman , Mohammed Saidul Islam , Md Tahmid Rahman Laskar , Shafiq Joty , Enamul Hoque

Large-scale alignment pipelines typically pair a policy model with a separately trained reward model whose parameters remain frozen during reinforcement learning (RL). This separation creates a complex, resource-intensive pipeline and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Songshuo Lu , Hua Wang , Zhi Chen , Yaohua Tang

Reinforcement Learning with Verifiable Rewards (RLVR) and Group Relative Policy Optimization (GRPO) have significantly advanced the reasoning capabilities of large language models. Extending these methods to multimodal settings, however,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Jinghan Li , Junfeng Fang , Jinda Lu , Yuan Wang , Xiaoyan Guo , Tianyu Zhang , Xiang Wang , Xiangnan He