English
Related papers

Related papers: GenSeg-R1: RL-Driven Vision-Language Grounding for…

200 papers

Video reasoning segmentation (VRS) endeavors to delineate referred objects in videos guided by implicit instructions that encapsulate human intent and temporal logic. Previous approaches leverage large vision language models (LVLMs) to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Sitong Gong , Lu Zhang , Yunzhi Zhuge , Xu Jia , Pingping Zhang , Huchuan Lu

We present Seg-R1, a preliminary exploration of using reinforcement learning (RL) to enhance the pixel-level understanding and reasoning capabilities of large multimodal models (LMMs). Starting with foreground segmentation tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zuyao You , Zuxuan Wu

Large Vision--Language Models (LVLMs) hold great promise for advancing optical remote sensing (RS) analysis, yet existing reasoning segmentation frameworks couple linguistic reasoning and pixel prediction through end-to-end supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xu Zhang , Junyao Ge , Yang Zheng , Kaitai Guo , Jimin Liang

Open-world referring segmentation requires grounding unconstrained language expressions to precise pixel-level regions. Existing multimodal large language models (MLLMs) exhibit strong open-world visual grounding, but their outputs remain…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Yuan Yao , Qiushi Yang , Humen Zhong , Jiangning Wei , Yifang Men , Shuai Bai , Miaomiao Cui , Zhibo Yang

Vision-Language Models (VLMs), such as CLIP, have demonstrated impressive zero-shot transfer capabilities in image-level visual perception. However, these models have shown limited performance in instance-level tasks that demand precise…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Lingfeng Yang , Yueze Wang , Xiang Li , Xinlong Wang , Jian Yang

Recent advances in vision-language models (VLMs) have demonstrated strong generalization in natural image tasks. However, their performance often degrades on unmanned aerial vehicle (UAV)-based aerial imagery, which features high…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jiajin Guan , Haibo Mei , Bonan Zhang , Dan Liu , Yuanshuang Fu , Yue Zhang

Text-prompted image segmentation enables fine-grained visual understanding and is critical for applications such as human-computer interaction and robotics. However, existing supervised fine-tuning methods typically ignore explicit…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Lianghui Zhu , Bin Ouyang , Yuxuan Zhang , Tianheng Cheng , Rui Hu , Haocheng Shen , Longjin Ran , Xiaoxin Chen , Li Yu , Wenyu Liu , Xinggang Wang

Vision-language models (VLMs) have achieved impressive progress in natural image reasoning, yet their potential in medical imaging remains underexplored. Medical vision-language tasks demand precise understanding and clinically coherent…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yuxiang Lai , Jike Zhong , Ming Li , Shitian Zhao , Yuheng Li , Konstantinos Psounis , Xiaofeng Yang

Volumetric Reasoning Segmentation (VRS) aims to segment a target region in a 3D medical scan from a free-form clinical query, where the referent is often implicit and requires both medical knowledge and volume-grounded reasoning. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Zichun Wang , Hairong Shi , Bingzheng Wei , Yan Xu , Zihua Wang

Efficient processing of high-resolution images is crucial for real-world vision-language applications. However, existing Large Vision-Language Models (LVLMs) incur substantial computational overhead due to the large number of vision tokens.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Jewon Lee , Wooksu Shin , Seungmin Yang , Ki-Ung Song , DongUk Lim , Jaeyeon Kim , Tae-Ho Kim , Bo-Kyeong Kim

Referring segmentation grounds natural-language queries to pixel-level masks, but extending it to complex scenarios with multiple instances, cross-category groups, or open-ended target sets remains challenging. Previous Large Vision…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Zhixiong Zhang , Yizhuo Li , Shuangrui Ding , Yuhang Zang , Shengyuan Ding , Long Xing , Yibin Wang , Qiaosheng Zhang , Jiaqi Wang

The diagnosis of pathological images is often limited by expert availability and regional disparities, highlighting the importance of automated diagnosis using Vision-Language Models (VLMs). Traditional multimodal models typically emphasize…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Jianyu Wu , Hao Yang , Xinhua Zeng , Guibing He , Zhiyu Chen , Zihui Li , Xiaochuan Zhang , Yangyang Ma , Run Fang , Yang Liu

Current Vision-Language Models (VLMs) struggle with fine-grained spatial reasoning, particularly when multi-step logic and precise spatial alignment are required. In this work, we introduce SpatialReasoner-R1, a vision-language reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yifan Shen , Yuanzhe Liu , Jingyuan Zhu , Xu Cao , Xiaofeng Zhang , Yixiao He , Wenming Ye , James Matthew Rehg , Ismini Lourentzou

Medical Image Grounding (MIG), which involves localizing specific regions in medical images based on textual descriptions, requires models to not only perceive regions but also deduce spatial relationships of these regions. Existing…

Machine Learning · Computer Science 2025-07-08 Huihui Xu , Yuanpeng Nie , Hualiang Wang , Ying Chen , Wei Li , Junzhi Ning , Lihao Liu , Hongqiu Wang , Lei Zhu , Jiyao Liu , Xiaomeng Li , Junjun He

Vision-language generative reward models (VL-GenRMs) play a crucial role in aligning and evaluating multimodal AI systems, yet their own evaluation remains under-explored. Current assessment methods primarily rely on AI-annotated preference…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Lei Li , Yuancheng Wei , Zhihui Xie , Xuqing Yang , Yifan Song , Peiyi Wang , Chenxin An , Tianyu Liu , Sujian Li , Bill Yuchen Lin , Lingpeng Kong , Qi Liu

Complex video reasoning remains a significant challenge for Multimodal Large Language Models (MLLMs), as current R1-based methodologies often prioritize text-centric reasoning derived from text-based and image-based developments. In video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Bo Fang , Yuxin Song , Qiangqiang Wu , Haoyuan Sun , Wenhao Wu , Antoni B. Chan

Leveraging multimodal large models for image segmentation has become a prominent research direction. However, existing approaches typically rely heavily on manually annotated datasets that include explicit reasoning processes, which are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiaqi Huang , Zunnan Xu , Jun Zhou , Ting Liu , Yicheng Xiao , Mingwen Ou , Bowen Ji , Xiu Li , Kehong Yuan

Referring expression segmentation (RES) aims at segmenting the foreground masks of the entities that match the descriptive natural language expression. Previous datasets and methods for classic RES task heavily rely on the prior assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Wenxuan Wang , Tongtian Yue , Yisi Zhang , Longteng Guo , Xingjian He , Xinlong Wang , Jing Liu

Traditional video reasoning segmentation methods rely on supervised fine-tuning, which limits generalization to out-of-distribution scenarios and lacks explicit reasoning. To address this, we propose \textbf{VideoSeg-R1}, the first…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zishan Xu , Yifu Guo , Yuquan Lu , Fengyu Yang , Junxin Li

Although multimodal large language models (MLLMs) excel in high-level vision-language reasoning, they lack inherent awareness of visual saliency, making it difficult to identify key visual elements. To bridge this gap, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Long Li , Shuichen Ji , Ziyang Luo , Zhihui Li , Dingwen Zhang , Junwei Han , Nian Liu
‹ Prev 1 2 3 10 Next ›