English
Related papers

Related papers: UniVG-R1: Reasoning Guided Universal Visual Ground…

200 papers

Vision-Language Models (VLMs) have achieved remarkable progress, yet their large scale often renders them impractical for resource-constrained environments. This paper introduces Unified Reinforcement and Imitation Learning (RIL), a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Byung-Kwan Lee , Ryo Hachiuma , Yong Man Ro , Yu-Chiang Frank Wang , Yueh-Hua Wu

Aligning Vision-Language Models (VLMs) with safety standards is essential to mitigate risks arising from their multimodal complexity, where integrating vision and language unveils subtle threats beyond the reach of conventional safeguards.…

Machine Learning · Computer Science 2025-10-14 Menglan Chen , Xianghe Pang , Jingjing Dong , WenHao Wang , Yaxin Du , Siheng Chen

Understanding and localizing objects in complex 3D environments from natural language descriptions, known as 3D Visual Grounding (3DVG), is a foundational challenge in embodied AI, with broad implications for robotics, augmented reality,…

Robotics · Computer Science 2026-03-10 Jiaxi Zhang , Yunheng Wang , Wei Lu , Taowen Wang , Weisheng Xu , Shuning Zhang , Yixiao Feng , Yuetong Fang , Renjing Xu

Recent Graphical User Interface (GUI) agents replicate the R1-Zero paradigm, coupling online Reinforcement Learning (RL) with explicit chain-of-thought reasoning prior to object grounding and thereby achieving substantial performance gains.…

Computation and Language · Computer Science 2025-05-23 Yuqi Zhou , Sunhao Dai , Shuai Wang , Kaiwen Zhou , Qinglin Jia , Jun Xu

The rise of Multimodal Large Language Models (MLLMs), renowned for their advanced instruction-following and reasoning capabilities, has significantly propelled the field of visual reasoning. However, due to limitations in their image…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Jiaxing Chen , Yuxuan Liu , Dehu Li , Xiang An , Weimo Deng , Ziyong Feng , Yongle Zhao , Yin Xie

Vision-language models (VLMs) have achieved remarkable success across diverse tasks. However, concerns about their trustworthiness persist, particularly regarding tendencies to lean more on textual cues than visual evidence and the risk of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Shizhan Gong , Minda Hu , Qiyuan Zhang , Chen Ma , Qi Dou

Recent advances in multimodal large language models (MLLMs) have demonstrated remarkable capabilities in vision-language tasks, yet they often struggle with vision-centric scenarios where precise visual focus is needed for accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yunze Man , De-An Huang , Guilin Liu , Shiwei Sheng , Shilong Liu , Liang-Yan Gui , Jan Kautz , Yu-Xiong Wang , Zhiding Yu

Spatial reasoning from monocular images is essential for autonomous driving, yet current Vision-Language Models (VLMs) still struggle with fine-grained geometric perception, particularly under large scale variation and ambiguous object…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yanchun Cheng , Rundong Wang , Xulei Yang , Alok Prakash , Daniela Rus , Marcelo H Ang , ShiJie Li

Multimodal large language models (MLLMs) perform well on many vision-language tasks but often struggle with vision-centric problems that require fine-grained visual reasoning. Recent evidence suggests that this limitation arises not from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Sophia Sirko-Galouchenko , Monika Wysoczanska , Andrei Bursuc , Nicolas Thome , Spyros Gidaris

Recent advancements in Vision-Language (VL) research have sparked new benchmarks for complex visual reasoning, challenging models' advanced reasoning ability. Traditional Vision-Language Models (VLMs) perform well in visual perception tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zhiyuan Li , Dongnan Liu , Chaoyi Zhang , Heng Wang , Tengfei Xue , Weidong Cai

While recent vision-language models (VLMs) demonstrate strong image understanding, their ability to "think with images", i.e., to reason through multi-step visual interactions, remains limited. We introduce VISTA-Gym, a scalable training…

Video reasoning, which requires multi-step deduction across frames, remains a major challenge for multimodal large language models (MLLMs). While reinforcement learning (RL)-based methods enhance reasoning capabilities, they often rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Kun Ouyang , Yuanxin Liu , Linli Yao , Yishuo Cai , Hao Zhou , Jie Zhou , Fandong Meng , Xu Sun

Spatio-temporal video grounding (STVG) requires localizing a target object in untrimmed videos both temporally and spatially from natural language descriptions. Despite their strong language understanding, multimodal large language models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Xin Gu , Haoji Zhang , Qihang Fan , Jingxuan Niu , Zhipeng Zhang , Libo Zhang , Guang Chen , Fan Chen , Longyin Wen , Sijie Zhu

Reinforcement learning (RL) has recently achieved remarkable success in eliciting visual reasoning within Multimodal Large Language Models (MLLMs). However, existing approaches typically train separate models for different tasks and treat…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Kaituo Feng , Manyuan Zhang , Hongyu Li , Kaixuan Fan , Shuang Chen , Yilei Jiang , Dian Zheng , Peiwen Sun , Yiyuan Zhang , Haoze Sun , Yan Feng , Peng Pei , Xunliang Cai , Xiangyu Yue

Vision--Language Models (VLMs) show significant promise for Medical Visual Question Answering (VQA), yet their deployment in clinical settings is hindered by severe vulnerability to adversarial attacks. Standard adversarial training, while…

Artificial Intelligence · Computer Science 2025-12-23 A. A. Gde Yogi Pramana , Jason Ray , Anthony Jaya , Michael Wijaya

We introduce InternVLA-M1, a unified framework for spatial grounding and robot control that advances instruction-following robots toward scalable, general-purpose intelligence. Its core idea is spatially guided vision-language-action…

Reinforcement learning has proven its effectiveness in enhancing the reasoning capabilities of large language models. Recent research efforts have progressively extended this paradigm to multimodal reasoning tasks. Due to the inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ruifeng Yuan , Chenghao Xiao , Sicong Leng , Jianyu Wang , Long Li , Weiwen Xu , Hou Pong Chan , Deli Zhao , Tingyang Xu , Zhongyu Wei , Hao Zhang , Yu Rong

Remote sensing (RS) large vision-language models (LVLMs) have shown strong promise across visual grounding (VG) tasks. However, existing RS VG datasets predominantly rely on explicit referring expressions-such as relative position, relative…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yue Zhou , Jue Chen , Zilun Zhang , Penghui Huang , Ran Ding , Zhentao Zou , PengFei Gao , Yuchen Wei , Ke Li , Xue Yang , Xue Jiang , Hongxin Yang , Jonathan Li

Inspired by DeepSeek-R1's success in eliciting reasoning abilities through rule-based reinforcement learning (RL), we introduce Video-R1 as the first attempt to systematically explore the R1 paradigm for incentivizing video reasoning within…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Kaituo Feng , Kaixiong Gong , Bohao Li , Zonghao Guo , Yibing Wang , Tianshuo Peng , Junfei Wu , Xiaoying Zhang , Benyou Wang , Xiangyu Yue

Multimodal Large Language Models (MLLMs) with unified architectures excel across a wide range of vision-language tasks, yet aligning them with personalized image generation remains a significant challenge. Existing methods for MLLMs are…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Qian Liang , Yujia Wu , Kuncheng Li , Jiwei Wei , Shiyuan He , Jinyu Guo , Ning Xie