English
Related papers

Related papers: OmniEarth: A Benchmark for Evaluating Vision-Langu…

200 papers

Recent progress in VLMs has demonstrated impressive capabilities across a variety of tasks in the natural image domain. Motivated by these advancements, the remote sensing community has begun to adopt VLMs for remote sensing vision-language…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Congcong Wen , Yiting Lin , Xiaokang Qu , Nan Li , Yong Liao , Xiang Li , Hui Lin

Vision-Language Models (VLMs) have emerged as powerful tools for image understanding tasks, yet their practical deployment remains hindered by significant architectural heterogeneity across model families. This paper introduces UVLM…

Machine Learning · Computer Science 2026-03-17 Joan Perez , Giovanni Fusco

Spatial reasoning is a fundamental capability of multimodal large language models (MLLMs), yet their performance in open aerial environments remains underexplored. In this work, we present Open3D-VQA, a novel benchmark for evaluating MLLMs'…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Weichen Zhang , Zile Zhou , Xin Zeng , Xuchen Liu , Jianjie Fang , Chen Gao , Yong Li , Jinqiang Cui , Xinlei Chen , Xiao-Ping Zhang

The fusion of language and vision in large vision-language models (LVLMs) has revolutionized deep learning-based object detection by enhancing adaptability, contextual reasoning, and generalization beyond traditional architectures. This…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Ranjan Sapkota , Manoj Karkee

As a powerful all-weather Earth observation tool, synthetic aperture radar (SAR) remote sensing enables critical military reconnaissance, maritime surveillance, and infrastructure monitoring. Although Vision language models (VLMs) have made…

Computation and Language · Computer Science 2025-03-05 Zhiming Ma , Xiayang Xiao , Sihao Dong , Peidong Wang , HaiPeng Wang , Qingyun Pan

Vision language models (VLMs) are an exciting emerging class of language models (LMs) that have merged classic LM capabilities with those of image processing systems. However, the ways that these capabilities combine are not always…

Computation and Language · Computer Science 2024-07-03 Qiucheng Wu , Handong Zhao , Michael Saxon , Trung Bui , William Yang Wang , Yang Zhang , Shiyu Chang

As Large Language Models (LLMs) increasingly power autonomous agents in robotics and embodied AI, understanding their spatial reasoning capabilities becomes crucial for ensuring reliable real-world deployment. Despite advances in language…

Artificial Intelligence · Computer Science 2025-07-29 Hafsteinn Einarsson

Vision-language models (VLMs) have advanced multimodal reasoning but still face challenges in spatial reasoning for 3D scenes and complex object configurations. To address this, we introduce SpatialViLT, an enhanced VLM that integrates…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Chashi Mahiul Islam , Oteo Mamo , Samuel Jacob Chacko , Xiuwen Liu , Weikuan Yu

Data-driven approaches like deep learning are rapidly advancing planetary science, particularly in Mars exploration. Despite recent progress, most existing benchmarks remain confined to closed-set supervised visual tasks and do not support…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Shuoyuan Wang , Yiran Wang , Hongxin Wei

Current evaluations of spatial intelligence can be systematically invalid under modern vision-language model (VLM) settings. First, many benchmarks derive question-answer (QA) pairs from point-cloud-based 3D annotations originally curated…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Yiming Zhang , Jiacheng Chen , Jiaqi Tan , Yongsen Mao , Wenhu Chen , Angel X. Chang

Advancements in Large Language Models (LLMs) drive interest in scientific applications, necessitating specialized benchmarks such as Earth science. Existing benchmarks either present a general science focus devoid of Earth science…

Computation and Language · Computer Science 2025-06-02 Wanghan Xu , Xiangyu Zhao , Yuhao Zhou , Xiaoyu Yue , Ben Fei , Fenghua Ling , Wenlong Zhang , Lei Bai

Remote sensing imagery, despite its broad applications in helping achieve Sustainable Development Goals and tackle climate change, has not yet benefited from the recent advancements of versatile, task-agnostic vision language models (VLMs).…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Zhecheng Wang , Rajanie Prabha , Tianyuan Huang , Jiajun Wu , Ram Rajagopal

Multimodal large language models (MLLMs) have shown remarkable capabilities across a broad range of tasks but their knowledge and abilities in the geographic and geospatial domains are yet to be explored, despite potential wide-ranging…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Jonathan Roberts , Timo Lüddecke , Rehan Sheikh , Kai Han , Samuel Albanie

Brain imaging analysis is crucial for diagnosing and treating brain disorders, and multimodal large language models (MLLMs) are increasingly supporting it. However, current brain imaging visual question-answering (VQA) benchmarks either…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Zhihao Peng , Cheng Wang , Shengyuan Liu , Zhiying Liang , Zanting Ye , Minjie Ju , PeterYM Woo , Yixuan Yuan

Earth Observation (EO) systems are essentially designed to support domain experts who often express their requirements through vague natural language rather than precise, machine-friendly instructions. Depending on the specific application…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Liang Yao , Shengxiang Xu , Fan Liu , Chuanyi Zhang , Bishun Yao , Rui Min , Yongjun Li , Chaoqian Ouyang , Shimin Di , Min-Ling Zhang

Remote Sensing Visual Question Answering (RSVQA) is a challenging task that involves interpreting complex satellite imagery to answer natural language questions. Traditional approaches often rely on separate visual feature extractors and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Surasakdi Siripong , Apirak Chaiyapan , Thanakorn Phonchai

Object search is a fundamental task for robots deployed in indoor building environments, yet challenges arise due to observation instability, especially for open-vocabulary models. While foundation models (LLMs/VLMs) enable reasoning about…

Robotics · Computer Science 2025-03-05 Qianwei Wang , Yifan Xu , Vineet Kamat , Carol Menassa

Recent advancements in Large Vision-Language Models (LVLMs) have demonstrated remarkable multimodal perception capabilities, garnering significant attention. While numerous evaluation studies have emerged, assessing LVLMs both holistically…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Hong-Tao Yu , Yuxin Peng , Serge Belongie , Xiu-Shen Wei

Multimodal Large Language Models (MLLMs) require comprehensive visual inputs to achieve dense understanding of the physical world. While existing MLLMs demonstrate impressive world understanding capabilities through limited field-of-view…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Yikang Zhou , Tao Zhang , Dizhe Zhang , Shunping Ji , Xiangtai Li , Lu Qi

Vision Language Models (VLMs) perform well on standard video tasks but struggle with physics-related reasoning involving motion dynamics and spatial interactions. We present a novel approach to address this gap by translating physical-world…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xiyang Wu , Zongxia Li , Jihui Jin , Guangyao Shi , Gouthaman KV , Vishnu Raj , Nilotpal Sinha , Jingxi Chen , Fan Du , Dinesh Manocha