English
Related papers

Related papers: GeoPixel: Pixel Grounding Large Multimodal Model i…

200 papers

Low-level visual perception underpins reliable remote sensing (RS) image analysis, yet current image quality assessment (IQA) methods output uninterpretable scalar scores rather than characterizing physics-driven RS degradations, deviating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Chen Zhong , Xiao An , Jiaxing Sun , Zihan Gui , Guangyi Yang , Wei He

Multi-modal large language models have demonstrated impressive performance across various tasks in different modalities. However, existing multi-modal models primarily emphasize capturing global information within each modality while…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Zhaowei Li , Qi Xu , Dong Zhang , Hang Song , Yiqing Cai , Qi Qi , Ran Zhou , Junting Pan , Zefeng Li , Van Tu Vu , Zhida Huang , Tao Wang

Visual grounding tasks aim to localize image regions based on natural language references. In this work, we explore whether generative VLMs predominantly trained on image-text data could be leveraged to scale up the text annotation of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Shijie Wang , Dahun Kim , Ali Taalimi , Chen Sun , Weicheng Kuo

Fine-grained high-resolution remote sensing mapping typically relies on localized visual features, which restricts cross-domain generalizability and often leads to fragmented predictions of large-scale land covers. While global geospatial…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Jienan Lyu , Miao Yang , Jinchen Cai , Yiwen Hu , Guanyi Lu , Junhao Qiu , Runmin Dong

Unified remote sensing multimodal models exhibit a pronounced spatial reversal curse: Although they can accurately recognize and describe object locations in images, they often fail to faithfully execute the same spatial relations during…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Weiyu Zhang , Yuan Hu , Yong Li , Yu Liu

Remote Sensing Visual Grounding (RSVG) aims to localize target objects in large-scale aerial imagery based on natural language descriptions. Owing to the vast spatial scale and high semantic ambiguity of remote sensing scenes, these…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Shiqi Huang , Shuting He , Bihan Wen

Referring Image Segmentation (RIS) is a challenging task that requires an algorithm to segment objects referred by free-form language expressions. Despite significant progress in recent years, most state-of-the-art (SOTA) methods still…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yong Xien Chng , Henry Zheng , Yizeng Han , Xuchong Qiu , Gao Huang

Masked Image Modeling (MIM) is a self-supervised learning technique that involves masking portions of an image, such as pixels, patches, or latent representations, and training models to predict the missing information using the visible…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Shabnam Choudhury , Akhil Vasim , Michael Schmitt , Biplab Banerjee

The ability to understand and reason about spatial relationships between objects in images is an important component of visual reasoning. This skill rests on the ability to recognize and localize objects of interest and determine their…

Computation and Language · Computer Science 2024-10-14 Navid Rajabi , Jana Kosecka

Geospatial technologies are becoming increasingly essential in our world for a wide range of applications, including agriculture, urban planning, and disaster response. To help improve the applicability and performance of deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Matias Mendieta , Boran Han , Xingjian Shi , Yi Zhu , Chen Chen

Worldwide image geolocalization, which aims to predict the GPS coordinates of any image on Earth, remains challenging due to global visual diversity. Recent generative approaches based on Retrieval-Augmented Generation (RAG) and Large…

Information Retrieval · Computer Science 2026-04-29 Tung-Duong Le-Duc , Hoang-Quoc Nguyen-Son , Minh-Son Dao

Multimodal large language models (MLLMs) have shown remarkable performance in vision-language tasks. However, existing MLLMs are primarily trained on generic datasets, limiting their ability to reason on domain-specific visual cues such as…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Hatef Otroshi Shahreza , Sébastien Marcel

Open-world referring segmentation requires grounding unconstrained language expressions to precise pixel-level regions. Existing multimodal large language models (MLLMs) exhibit strong open-world visual grounding, but their outputs remain…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Yuan Yao , Qiushi Yang , Humen Zhong , Jiangning Wei , Yifang Men , Shuai Bai , Miaomiao Cui , Zhibo Yang

Efficient vision-language understanding of large Remote Sensing Images (RSIs) is meaningful but challenging. Current Large Vision-Language Models (LVLMs) typically employ limited pre-defined grids to process images, leading to information…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Junwei Luo , Yingying Zhang , Xue Yang , Kang Wu , Qi Zhu , Lei Liang , Jingdong Chen , Yansheng Li

Geo-localization is the task of identifying the location of an image using visual cues alone. It has beneficial applications, such as improving disaster response, enhancing navigation, and geography education. Recently, Vision-Language…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Oliver Grainge , Sania Waheed , Jack Stilgoe , Michael Milford , Shoaib Ehsan

Masked Image Modeling (MIM) has emerged as a promising method for deriving visual representations from unlabeled image data by predicting missing pixels from masked portions of images. It excels in region-aware learning and provides strong…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yibing Wei , Abhinav Gupta , Pedro Morgado

Multi-modal Large Language Models (MLLMs) have shown remarkable capabilities across a wide range of vision-language tasks. However, due to the restricted input resolutions, MLLMs face significant challenges in precisely understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Lu Zhang , Jiazuo Yu , Haomiao Xiong , Ping Hu , Yunzhi Zhuge , Huchuan Lu , You He

Vision-language models (VLMs) are emerging as powerful generalist tools for remote sensing, capable of integrating information across diverse tasks and enabling flexible, instruction-based interactions via a chat interface. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Aysim Toker , Andreea-Maria Oncescu , Roy Miles , Ismail Elezi , Jiankang Deng

Remote sensing has evolved from simple image acquisition to complex systems capable of integrating and processing visual and textual data. This review examines the development and application of multi-modal language models (MLLMs) in remote…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Xintian Sun , Benji Peng , Charles Zhang , Fei Jin , Qian Niu , Junyu Liu , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Ming Liu , Xinyuan Song , Yichao Zhang

The emergence of Multimodal Large Language Models (MLLMs) has revolutionized image understanding by bridging textual and visual modalities. However, these models often struggle with capturing fine-grained semantic information, such as the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Jie Yang , Wang Zeng , Sheng Jin , Lumin Xu , Wentao Liu , Chen Qian , Zhen Li , Ruimao Zhang