English
Related papers

Related papers: Foundation Models for Remote Sensing: An Analysis …

200 papers

Visual target navigation in unknown environments is a crucial problem in robotics. Despite extensive investigation of classical and learning-based approaches in the past, robots lack common-sense knowledge about household objects and…

Robotics · Computer Science 2023-12-27 Bangguo Yu , Hamidreza Kasaei , Ming Cao

Multimodal large language models (MLLMs) have achieved remarkable performance across diverse vision-and-language tasks. However, their potential in face recognition remains underexplored. In particular, the performance of open-source MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Hatef Otroshi Shahreza , Sébastien Marcel

A robust Multimodal Large Language Model (MLLM) for Earth Observation should maintain consistent interpretation and reasoning under realistic input variations. However, current Remote Sensing MLLMs fail to meet this requirement. Trained on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Rui Min , Liang Yao , Shiyu Miao , Shengxiang Xu , Yuxuan Liu , Chuanyi Zhang , Shimin Di , Fan Liu

Large Vision-Language Models (LVLMs) have demonstrated impressive performance on vision-language reasoning tasks. However, their potential for zero-shot fine-grained image classification, a challenging task requiring precise differentiation…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Md. Atabuzzaman , Andrew Zhang , Chris Thomas

Large language models have recently reached near-parity with classical planners on well-known planning domains, yet this competence relies on world-knowledge exploitation rather than genuine symbolic reasoning. Goal recognition is a…

Artificial Intelligence · Computer Science 2026-05-18 Kin Max Piamolini Gusmão , Nathan Gavenski , Nir Oren , Felipe Meneguzzi

Generalist multimodal large language models (MLLMs) have achieved impressive performance across a wide range of vision-language tasks. However, their performance on medical tasks, particularly in zero-shot settings where generalization is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Guimeng Liu , Tianze Yu , Somayeh Ebrahimkhani , Lin Zhi Zheng Shawn , Kok Pin Ng , Ngai-Man Cheung

The task of image captioning demands an algorithm to generate natural language descriptions of visual inputs. Recent advancements have seen a convergence between image captioning research and the development of Large Language Models (LLMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Davide Bucciarelli , Nicholas Moratelli , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Multi-modal large language models (MLLMs) have recently achieved great success in processing and understanding information from diverse modalities (e.g., text, audio, and visual signals). Despite their growing popularity, there remains a…

Multimedia · Computer Science 2025-04-25 Yusheng Zhao , Junyu Luo , Xiao Luo , Weizhi Zhang , Zhiping Xiao , Wei Ju , Philip S. Yu , Ming Zhang

Vision-language models (VLMs) have demonstrated remarkable capabilities in understanding and reasoning about visual content, but significant challenges persist in tasks requiring cross-viewpoint understanding and spatial reasoning. We…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Dingming Li , Hongxing Li , Zixuan Wang , Yuchen Yan , Hang Zhang , Siqi Chen , Guiyang Hou , Shengpei Jiang , Wenqi Zhang , Yongliang Shen , Weiming Lu , Yueting Zhuang

Recent advances in multimodal large language models (MLLMs) have demonstrated impressive results in various visual tasks. However, in remote sensing (RS), high resolution and small proportion of objects pose challenges to existing MLLMs,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Hongxiang Jiang , Jihao Yin , Qixiong Wang , Jiaqi Feng , Guo Chen

This paper presents novel benchmarks for evaluating vision-language models (VLMs) in zero-shot recognition, focusing on granularity and specificity. Although VLMs excel in tasks like image captioning, they face challenges in open-world…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Zhenlin Xu , Yi Zhu , Tiffany Deng , Abhay Mittal , Yanbei Chen , Manchen Wang , Paolo Favaro , Joseph Tighe , Davide Modolo

Large language models (LLMs) and vision-language models (VLMs) have demonstrated remarkable performance across a wide range of tasks and domains. Despite this promise, spatial understanding and reasoning -- a fundamental component of human…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Jiayu Wang , Yifei Ming , Zhenmei Shi , Vibhav Vineet , Xin Wang , Yixuan Li , Neel Joshi

Visual grounding seeks to localize the image region corresponding to a free-form text description. Recently, the strong multimodal capabilities of Large Vision-Language Models (LVLMs) have driven substantial improvements in visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Seil Kang , Jinyeong Kim , Junhyeok Kim , Seong Jae Hwang

Multimodal Large Language Model (MLLMs) leverages Large Language Models as a cognitive framework for diverse visual-language tasks. Recent efforts have been made to equip MLLMs with visual perceiving and grounding capabilities. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Junwen He , Yifan Wang , Lijun Wang , Huchuan Lu , Jun-Yan He , Jin-Peng Lan , Bin Luo , Xuansong Xie

The advancement of Multimodal Large Language Models (MLLMs) has greatly accelerated the development of applications in understanding integrated texts and images. Recent works leverage image-caption datasets to train MLLMs, achieving…

Computation and Language · Computer Science 2024-11-22 Mingxu Tao , Quzhe Huang , Kun Xu , Liwei Chen , Yansong Feng , Dongyan Zhao

Spatial understanding is essential for Multimodal Large Language Models (MLLMs) to support perception, reasoning, and planning in embodied environments. Despite recent progress, existing studies reveal that MLLMs still struggle with spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Wanyue Zhang , Yibin Huang , Yangbin Xu , JingJing Huang , Helu Zhi , Shuo Ren , Wang Xu , Jiajun Zhang

Recent Vision Language Models (VLMs) have demonstrated strong performance across a wide range of multimodal reasoning tasks. This raises the question of whether such general-purpose models can also address specialized visual recognition…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Vaclav Javorek , Jakub Honzik , Ivan Gruber , Tomas Zelezny , Marek Hruz

Multi-modal large language models (MLLMs) have demonstrated remarkable success in vision and visual-language tasks within the natural image domain. Owing to the significant diversities between the natural and remote sensing (RS) images, the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Wei Zhang , Miaoxin Cai , Tong Zhang , Yin Zhuang , Xuerui Mao

Multilingual Large Language Models (LLMs) have recently shown great capabilities in a wide range of tasks, exhibiting state-of-the-art performance through zero-shot or few-shot prompting methods. While there have been extensive studies on…

Computation and Language · Computer Science 2023-10-24 Ruochen Zhang , Samuel Cahyawijaya , Jan Christian Blaise Cruz , Genta Indra Winata , Alham Fikri Aji

Recent advances in reinforcement learning (RL) have delivered strong reasoning capabilities in natural image domains, yet their potential for Earth Observation (EO) remains largely unexplored. EO tasks introduce unique challenges, spanning…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Mustansar Fiaz , Hiyam Debary , Paolo Fraccaro , Danda Paudel , Luc Van Gool , Fahad Khan , Salman Khan