English
Related papers

Related papers: GeoSeg: Training-Free Reasoning-Driven Segmentatio…

200 papers

Effective foundation modeling in remote sensing requires spatially aligned heterogeneous modalities coupled with semantically grounded supervision, yet such resources remain limited at scale. We present GeoMeld, a large-scale multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Maram Hasan , Md Aminur Hossain , Savitra Roy , Souparna Bhowmik , Ayush V. Patel , Mainak Singha , Subhasis Chaudhuri , Muhammad Haris Khan , Biplab Banerjee

This work tackles the problem of geo-localization with a new paradigm using a large vision-language model (LVLM) augmented with human inference knowledge. A primary challenge here is the scarcity of data for training the LVLM - existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Ling Li , Yu Ye , Yao Zhou , Bingchuan Jiang , Wei Zeng

We present Seg-R1, a preliminary exploration of using reinforcement learning (RL) to enhance the pixel-level understanding and reasoning capabilities of large multimodal models (LMMs). Starting with foreground segmentation tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zuyao You , Zuxuan Wu

Recently, automated medical image segmentation methods based on deep learning have achieved great success. However, they heavily rely on large annotated datasets, which are costly and time-consuming to acquire. Few-shot learning aims to…

Artificial Intelligence · Computer Science 2024-08-20 Jiayu Huo , Ruiqiang Xiao , Haotian Zheng , Yang Liu , Sebastien Ourselin , Rachel Sparks

Existing vision-language models (VLMs) have demonstrated impressive performance in reasoning-based segmentation. However, current benchmarks are primarily constructed from high-quality images captured under idealized conditions. This raises…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Wanjun Du , Zifeng Yuan , Tingting Chen , Fucai Ke , Beibei Lin , Shunli Zhang

Medical image segmentation is undergoing a paradigm shift from conventional visual pattern matching to cognitive reasoning analysis. Although Multimodal Large Language Models (MLLMs) have shown promise in integrating linguistic and visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Yuxin Xie , Yuming Chen , Yishan Yang , Yi Zhou , Tao Zhou , Zhen Zhao , Jiacheng Liu , Huazhu Fu

In human reading and communication, individuals tend to engage in geospatial reasoning, which involves recognizing geographic entities and making informed inferences about their interrelationships. To mimic such cognitive process, current…

Computation and Language · Computer Science 2024-08-22 Yibo Yan , Joey Lee

Traditional methods for reasoning segmentation rely on supervised fine-tuning with categorical labels and simple descriptions, limiting its out-of-domain generalization and lacking explicit reasoning processes. To address these limitations,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yuqi Liu , Bohao Peng , Zhisheng Zhong , Zihao Yue , Fanbin Lu , Bei Yu , Jiaya Jia

We introduce a method to train vision-language models for remote-sensing images without using any textual annotations. Our key insight is to use co-located internet imagery taken on the ground as an intermediary for connecting…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Utkarsh Mall , Cheng Perng Phoo , Meilin Kelsey Liu , Carl Vondrick , Bharath Hariharan , Kavita Bala

Recent advances in vision-language models have opened up new possibilities for reasoning-driven image geolocalization. However, existing approaches often rely on synthetic reasoning annotations or external image retrieval, which can limit…

Computation and Language · Computer Science 2026-01-06 Biao Wu , Meng Fang , Ling Chen , Ke Xu , Tao Cheng , Jun Wang

The remote sensing image intelligence understanding model is undergoing a new profound paradigm shift which has been promoted by multi-modal large language model (MLLM), i.e. from the paradigm learning a domain model (LaDM) shifts to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Linrui Xu , Ling Zhao , Wang Guo , Qiujun Li , Kewang Long , Kaiqi Zou , Yuhan Wang , Haifeng Li

Multi-modal Large Language Models (MLLMs) have shown remarkable capabilities across a wide range of vision-language tasks. However, due to the restricted input resolutions, MLLMs face significant challenges in precisely understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Lu Zhang , Jiazuo Yu , Haomiao Xiong , Ping Hu , Yunzhi Zhuge , Huchuan Lu , You He

This paper aims to address universal segmentation for image and video perception with the strong reasoning ability empowered by Visual Large Language Models (VLLMs). Despite significant progress in current unified segmentation methods,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Cong Wei , Yujie Zhong , Haoxian Tan , Yong Liu , Zheng Zhao , Jie Hu , Yujiu Yang

Remote sensing semantic segmentation is crucial for extracting detailed land surface information, enabling applications such as environmental monitoring, land use planning, and resource assessment. In recent years, advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Ning Zhou , Shanxiong Chen , Mingting Zhou , Haigang Sui , Lieyun Hu , Han Li , Li Hua , Qiming Zhou

The Reference Remote Sensing Image Segmentation (RRSIS) task generates segmentation masks for specified objects in images based on textual descriptions, which has attracted widespread attention and research interest. Current RRSIS methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shuyang Li , Shuang Wang , Zhuangzhuang Sun , Jing Xiao

Recent advances in reinforcement learning (RL) have delivered strong reasoning capabilities in natural image domains, yet their potential for Earth Observation (EO) remains largely unexplored. EO tasks introduce unique challenges, spanning…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Mustansar Fiaz , Hiyam Debary , Paolo Fraccaro , Danda Paudel , Luc Van Gool , Fahad Khan , Salman Khan

Existing works of reasoning segmentation often fall short in complex cases, particularly when addressing complicated queries and out-of-domain images. Inspired by the chain-of-thought reasoning, where harder problems require longer thinking…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Shiu-hong Kao , Chak Ho Huang , Huaiqian Liu , Yu-Wing Tai , Chi-Keung Tang

Despite recent advances in MLLM-based medical image segmentation, existing LISA-like methods cannot reliably reject false queries and often produce hallucinated segmentation masks for absent targets. This limitation reduces practical…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Ziqian Lu , Qinyue Tong , Jun Liu , Yunlong Yu

Advancing towards artificial superintelligence requires rich and intelligent perceptual capabilities. A critical frontier in this pursuit is overcoming the limited spatial understanding of Multimodal Large Language Models (MLLMs), where…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Ruiheng Liu , Haihong Hao , Mingfei Han , Xin Gu , Kecheng Zhang , Changlin Li , Xiaojun Chang

The development of high-resolution remote sensing satellites has provided great convenience for research work related to remote sensing. Segmentation and extraction of specific targets are essential tasks when facing the vast and complex…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Jie Zhang , Xubing Yang , Rui Jiang , Wei Shao , Li Zhang