English
Related papers

Related papers: SVQA-R1: Reinforcing Spatial Reasoning in MLLMs vi…

200 papers

Medical visual grounding serves as a crucial foundation for fine-grained multimodal reasoning and interpretable clinical decision support. Despite recent advances in reinforcement learning (RL) for grounding tasks, existing approaches such…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Guangjing Yang , Ziyuan Qin , Chaoran Zhang , Chenlin Du , Jinlin Wang , Wanran Sun , Zhenyu Zhang , Bing Ji , Qicheng Lao

Reinforcement learning from verifiable rewards (RLVR), especially with Group Relative Policy Optimization (GRPO), has shown strong potential for improving the reasoning capabilities of large vision-language models (LVLMs). However, in…

Artificial Intelligence · Computer Science 2026-05-11 Bingqing Jiang , Difan Zou

The performance of image generation has been significantly improved in recent years. However, the study of image screening is rare, and its performance with Multimodal Large Language Models (MLLMs) is unsatisfactory due to the lack of data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zhiyuan Hu , Zheng Sun , Yi Wei , Long Yu

In vision-language models (VLMs), misalignment between textual descriptions and visual coordinates often induces hallucinations. This issue becomes particularly severe in dense prediction tasks such as spatial-temporal video grounding…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Xiaowen Zhang , Zhi Gao , Licheng Jiao , Lingling Li , Qing Li

Recent reinforcement learning approaches, such as outcome-supervised GRPO, have advanced Chain-of-Thought reasoning in large language models (LLMs), yet their adaptation to multimodal LLMs (MLLMs) is unexplored. To address the lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yi Chen , Yuying Ge , Rui Wang , Yixiao Ge , Junhao Cheng , Ying Shan , Xihui Liu

Spatial reasoning remains a fundamental challenge for Vision-Language Models (VLMs), with current approaches struggling to achieve robust performance despite recent advances. We identify that this limitation stems from a critical gap:…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Hongxing Li , Dingming Li , Zixuan Wang , Yuchen Yan , Hang Wu , Wenqi Zhang , Yongliang Shen , Weiming Lu , Jun Xiao , Yueting Zhuang

Vision-Language-Action (VLA) models excel in robotic manipulation but are constrained by their heavy reliance on expert demonstrations, leading to demonstration bias and limiting performance. Reinforcement learning (RL) is a vital…

Robotics · Computer Science 2025-12-02 Senyu Fei , Siyin Wang , Li Ji , Ao Li , Shiduo Zhang , Liming Liu , Jinlong Hou , Jingjing Gong , Xianzhong Zhao , Xipeng Qiu

Current post-training methodologies for adapting Large Vision-Language Models (LVLMs) generally fall into two paradigms: Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL). Despite their prevalence, both approaches suffer from…

Machine Learning · Computer Science 2026-04-21 Yuming Yan , Kai Tang , Sihong Chen , Ke Xu , Dan Hu , Qun Yu , Pengfei Hu

Online Reinforcement Learning (RL) offers a promising avenue for complex image editing but is currently constrained by the scarcity of reliable and fine-grained reward signals. Existing evaluators frequently struggle with a critical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Yancheng Long , Yankai Yang , Hongyang Wei , Wei Chen , Tianke Zhang , Haonan fan , Changyi Liu , Kaiyu Jiang , Jiankang Chen , Kaiyu Tang , Bin Wen , Fan Yang , Tingting Gao , Han Li , Shuo Yang

Despite advancements in Multi-modal Large Language Models (MLLMs) for scene understanding, their performance on complex spatial reasoning tasks requiring mental simulation remains significantly limited. Current methods often rely on passive…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Meng Cao , Xingyu Li , Xue Liu , Ian Reid , Xiaodan Liang

Multi-modal Large Language Models (MLLMs) show promise in video understanding. However, their reasoning often suffers from thinking drift and weak temporal comprehension, even when enhanced by Reinforcement Learning (RL) techniques like…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Peiyao Wang , Haotian Xu , Noranart Vesdapunt , Rui Hou , Jingyi Zhang , Haibin Ling , Oleksandr Obiednikov , Ning Zhou , Kah Kuen Fu

Spatial reasoning and visual grounding are core capabilities for vision-language models (VLMs), yet most medical VLMs produce predictions without transparent reasoning or spatial evidence. Existing benchmarks also evaluate VLMs on isolated…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Lama Moukheiber , Caleb M. Yeung , Haotian Xue , Alec Helbling , Zelin Zhao , Yongxin Chen

Video generation models produce visually coherent content but struggle with tasks requiring spatial reasoning and multi-step planning. Reinforcement learning (RL) offers a path to improve generalization, but its effectiveness in video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Ming Liu , Yunbei Zhang , Shilong Liu , Liwen Wang , Wensheng Zhang

Large vision-language models (VLMs) have made significant strides in 2D visual understanding tasks, sparking interest in extending these capabilities to 3D scene understanding. However, current 3D VLMs often struggle with robust reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ting Huang , Zeyu Zhang , Hao Tang

We introduce V-tableR1, a process-supervised reinforcement learning framework that elicits rigorous, verifiable reasoning from multimodal large language models (MLLMs). Current MLLMs trained solely on final outcomes often treat visual…

Artificial Intelligence · Computer Science 2026-04-23 Yubo Jiang , Yitong An , Xin Yang , Abudukelimu Wuerkaixi , Xuxin Cheng , Fengying Xie , Zhiguo Jiang , Cao Liu , Ke Zeng , Haopeng Zhang

In medical visual question answering (Med-VQA), achieving accurate responses relies on three critical steps: precise perception of medical imaging data, logical reasoning grounded in visual input and textual questions, and coherent answer…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Songtao Jiang , Yuan Wang , Ruizhe Chen , Yan Zhang , Ruilin Luo , Bohan Lei , Sibo Song , Yang Feng , Jimeng Sun , Jian Wu , Zuozhu Liu

Recent breakthroughs in reasoning language models have significantly advanced text-based reasoning. On the other hand, Multi-modal Large Language Models (MLLMs) still lag behind, hindered by their outdated internal LLMs. Upgrading these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yunhao Gou , Kai Chen , Zhili Liu , Lanqing Hong , Xin Jin , Zhenguo Li , James T. Kwok , Yu Zhang

Current state-of-the-art spatial reasoning-enhanced VLMs are trained to excel at spatial visual question answering (VQA). However, we believe that higher-level 3D-aware tasks, such as articulating dynamic scene changes and motion planning,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Chenyang Ma , Kai Lu , Ta-Ying Cheng , Niki Trigoni , Andrew Markham

Recent advances in multi-modal large language models (MLLMs) have significantly improved object-level grounding and region captioning. However, they remain limited in visual relation understanding, struggling even with binary relation…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Lin Li , Wei Chen , Jiahui Li , Kwang-Ting Cheng , Long Chen

Vision-Language-Action (VLA) models exhibit strong generalization in robotic manipulation, yet reinforcement learning (RL) fine-tuning often degrades robustness under spatial distribution shifts. For flow-matching VLA policies, this…

Robotics · Computer Science 2026-02-03 Xu Pan , Zhenglin Wan , Xingrui Yu , Xianwei Zheng , Youkai Ke , Ming Sun , Rui Wang , Ziwei Wang , Ivor Tsang