English
Related papers

Related papers: GenSeg-R1: RL-Driven Vision-Language Grounding for…

200 papers

Multimodal large language models (MLLMs) have advanced perception across text, vision, and audio, yet they often struggle with structured cross-modal reasoning, particularly when integrating audio and visual signals. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-06-20 Zhenghao Xing , Xiaowei Hu , Chi-Wing Fu , Wenhai Wang , Jifeng Dai , Pheng-Ann Heng

Recently DeepSeek R1 has shown that reinforcement learning (RL) can substantially improve the reasoning capabilities of Large Language Models (LLMs) through a simple yet effective design. The core of R1 lies in its rule-based reward…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Haozhan Shen , Peng Liu , Jingcheng Li , Chunxin Fang , Yibo Ma , Jiajia Liao , Qiaoli Shen , Zilun Zhang , Kangjia Zhao , Qianqian Zhang , Ruochen Xu , Tiancheng Zhao

Visual retrieval-augmented generation (VRAG) augments vision-language models (VLMs) with external visual knowledge to ground reasoning and reduce hallucinations. Yet current VRAG systems often fail to reliably perceive and integrate…

Computation and Language · Computer Science 2025-10-14 Yubo Sun , Chunyi Peng , Yukun Yan , Shi Yu , Zhenghao Liu , Chi Chen , Zhiyuan Liu , Maosong Sun

This study investigates the spatial reasoning capabilities of vision-language models (VLMs) through Chain-of-Thought (CoT) prompting and reinforcement learning. We begin by evaluating the impact of different prompting strategies and find…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Binbin Ji , Siddharth Agrawal , Qiance Tang , Yvonne Wu

Recent progress in promptable segmentation has shifted visual perception from object-level localization toward concept-level understanding. However, the notion of a concept remains under-specified, making it unclear whether current methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Yuan Zhao , Youwei Pang , Jiaming Zuo , Wei Ji , Kailai Zhou , Bin Fan , Yunkang Cao , Lihe Zhang , Xiaofeng Liu , Huchuan Lu , Weisi Lin , Dacheng Tao , Xiaoqi Zhao

Despite tremendous recent advances in large model reasoning ability, vision-language models (VLMs) still struggle with detailed visual reasoning, especially when compute resources are limited. To address this challenge, we draw inspiration…

Machine Learning · Computer Science 2025-08-06 Sunil Kumar , Bowen Zhao , Leo Dirac , Paulina Varshavskaya

Learning general-purpose reasoning capabilities has long been a challenging problem in AI. Recent research in large language models (LLMs), such as DeepSeek-R1, has shown that reinforcement learning techniques like GRPO can enable…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiaer Xia , Yuhang Zang , Peng Gao , Sharon Li , Kaiyang Zhou

This technical report presents our solution for the RoboSense Challenge at IROS 2025, which evaluates Vision-Language Models (VLMs) on autonomous driving scene understanding across perception, prediction, planning, and corruption detection…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Aodi Wu , Xubo Luo

Vision Language Models (VLMs) have recently achieved significant progress in bridging visual perception and linguistic reasoning. Recently, OpenAI o3 model introduced a zoom-in search strategy that effectively elicits active perception…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Wanfu Wang , Qipeng Huang , Guangquan Xue , Xiaobo Liang , Juntao Li

Multi-modal Large Language Models (MLLMs) have shown remarkable capabilities across a wide range of vision-language tasks. However, due to the restricted input resolutions, MLLMs face significant challenges in precisely understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Lu Zhang , Jiazuo Yu , Haomiao Xiong , Ping Hu , Yunzhi Zhuge , Huchuan Lu , You He

Group relative policy optimization (GRPO) has become a standard post-training paradigm for improving reasoning and preference alignment in large language models (LLMs), and has recently shown strong effectiveness in LLM-based recommender…

Information Retrieval · Computer Science 2026-03-09 Yu Wang , Yonghui Yang , Le Wu , Jiancan Wu , Hefei Xu , Hui Lin

Large Vision-Language Models (VLMs) are increasingly being regarded as foundation models that can be instructed to solve diverse tasks by prompting, without task-specific training. We examine the seemingly obvious question: how to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Niccolo Avogaro , Thomas Frick , Mattia Rigotti , Andrea Bartezzaghi , Filip Janicki , Cristiano Malossi , Konrad Schindler , Roy Assaf

Referring expression segmentation (RES) aims at segmenting the entities' masks that match the descriptive language expression. While traditional RES methods primarily address object-level grounding, real-world scenarios demand a more…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Jing Liu , Wenxuan Wang , Yisi Zhang , Yepeng Tang , Xingjian He , Longteng Guo , Tongtian Yue , Xinlong Wang

Recent advances in Vision-Language Models (VLMs) have benefited from Reinforcement Learning (RL) for enhanced reasoning. However, existing methods still face critical limitations, including the lack of low-level visual information and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zhiheng Wu , Tong Wang , Shuning Wang , Naiming Liu , Yumeng Zhang

The recent explosive interest in the reasoning capabilities of large language models, such as DeepSeek-R1, has demonstrated remarkable success through reinforcement learning-based fine-tuning frameworks, exemplified by methods like Group…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Chenbin Pan , Wenbin He , Zhengzhong Tu , Liu Ren

Segment Anything Model (SAM) has attracted widespread attention for its superior interactive segmentation capabilities with visual prompts while lacking further exploration of text prompts. In this paper, we empirically investigate what…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yuxuan Zhang , Tianheng Cheng , Lianghui Zhu , Rui Hu , Lei Liu , Heng Liu , Longjin Ran , Xiaoxin Chen , Wenyu Liu , Xinggang Wang

Vision language models (VLMs) are increasingly capable of reasoning over images, but robust visual reasoning often requires re-grounding intermediate steps in the underlying visual evidence. Recent approaches typically rely on external…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zeru Shi , Kai Mei , Yihao Quan , Dimitris N. Metaxas , Ruixiang Tang

Recent advancements in Chain of Thought (COT) generation have significantly improved the reasoning capabilities of Large Language Models (LLMs), with reinforcement learning (RL) emerging as an effective post-training approach. Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yi Chen , Yuying Ge , Rui Wang , Yixiao Ge , Lu Qiu , Ying Shan , Xihui Liu

Remote-sensing applications often run on edge hardware that cannot host today's 7B-parameter multimodal language models. This paper introduces TinyRS, the first 2B-parameter multimodal small language model (MSLM) optimized for remote…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Aybora Koksal , A. Aydin Alatan

Spatial reasoning remains a critical yet underdeveloped capability in existing vision-language models (VLMs), especially for Spatial Visual Question Answering (Spatial VQA) tasks that require understanding relative positions, distances, and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Peiyao Wang , Haibin Ling