中文
相关论文

相关论文: Regression in EO: Are VLMs Up to the Challenge?

200 篇论文

Vision-Language Models (VLMs) have recently gained attention due to their competitive performance on multiple downstream tasks, achieved by following user-input instructions. However, VLMs still exhibit several limitations in visual…

计算机视觉与模式识别 · 计算机科学 2025-10-23 Simone Alghisi , Gabriel Roccabruna , Massimo Rizzoli , Seyed Mahed Mousavi , Giuseppe Riccardi

The growing availability of Earth Observation (EO) data and recent advances in Computer Vision have driven rapid progress in machine learning for EO, producing domain-specific models at ever-increasing scales. Yet this progress risks…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Tasos Papazafeiropoulos , Nikolaos Ioannis Bountos , Nikolas Papadopoulos , Ioannis Papoutsis

Vision language models (VLMs) have shown remarkable capabilities in integrating linguistic and visual reasoning but remain fundamentally limited in understanding dynamic spatiotemporal interactions. Humans effortlessly track and reason…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Shijie Zhou , Alexander Vilesov , Xuehai He , Ziyu Wan , Shuwang Zhang , Aditya Nagachandra , Di Chang , Dongdong Chen , Xin Eric Wang , Achuta Kadambi

A significant amount of remotely sensed data is generated daily by many Earth observation (EO) spaceborne and airborne sensors over different countries of our planet. Different applications use those data, such as natural hazard monitoring,…

图像与视频处理 · 电气工程与系统科学 2024-10-23 Alessandro Sebastianelli , Francesco Mauro , Giulia Ciabatti , Dario Spiller , Bertrand Le Saux , Paolo Gamba , Silvia Ullo

Earth observation (EO) data such as satellite imagery can have far-reaching impacts on our understanding of the geography of poverty, especially when coupled with machine learning (ML) and computer vision. Early research used computer…

机器学习 · 计算机科学 2025-04-23 Kazuki Sakamoto , Connor T. Jerzak , Adel Daoud

Modern Vision-Language Models (VLMs) exhibit unprecedented capabilities in cross-modal semantic understanding between visual and textual modalities. Given the intrinsic need for multi-modal integration in clinical applications, VLMs have…

图像与视频处理 · 电气工程与系统科学 2025-06-24 Haoneng Lin , Cheng Xu , Jing Qin

The application of Vision-Language Models (VLMs) in remote sensing (RS) has demonstrated significant potential in traditional tasks such as scene classification, object detection, and image captioning. However, current models, which excel…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Zilun Zhang , Haozhan Shen , Tiancheng Zhao , Bin Chen , Zian Guan , Yuhao Wang , Xu Jia , Yuxiang Cai , Yongheng Shang , Jianwei Yin

Earth Observation (EO) data analysis has been significantly revolutionized by deep learning (DL), with applications typically limited to grid-like data structures. Graph Neural Networks (GNNs) emerge as an important innovation, propelling…

机器学习 · 计算机科学 2024-11-07 Shan Zhao , Zhaiyu Chen , Zhitong Xiong , Yilei Shi , Sudipan Saha , Xiao Xiang Zhu

Language provides a natural interface to specify and evaluate performance on visual tasks. To realize this possibility, vision language models (VLMs) must successfully integrate visual and linguistic information. Our work compares VLMs to a…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Stephanie Fu , Tyler Bonnen , Devin Guillory , Trevor Darrell

Recent advances have enabled large language model (LLM) agents to solve complex tasks by orchestrating external tools. However, these agents often struggle in specialized, tool-intensive domains that demand long-horizon execution, tight…

人工智能 · 计算机科学 2026-02-04 Pengyu Dai , Weihao Xuan , Junjue Wang , Hongruixuan Chen , Jian Song , Yafei Ou , Naoto Yokoya

Vision-language models (VLMs) have shown promise in earth observation (EO), yet they struggle with tasks that require grounding complex spatial reasoning in precise pixel-level visual representations. To address this problem, we introduce…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Yan Shu , Bin Ren , Zhitong Xiong , Xiao Xiang Zhu , Begüm Demir , Nicu Sebe , Paolo Rota

We explore the integration of large language models (LLMs) into visual analytics (VA) systems to transform their capabilities through intuitive natural language interactions. We survey current research directions in this emerging field,…

人机交互 · 计算机科学 2025-07-01 Maeve Hutchinson , Radu Jianu , Aidan Slingsby , Pranava Madhyastha

Vision-language models (VLMs) integrate visual and textual information, enabling a wide range of applications such as image captioning and visual question answering, making them crucial for modern AI systems. However, their high…

计算机视觉与模式识别 · 计算机科学 2025-07-03 Gaurav Shinde , Anuradha Ravi , Emon Dey , Shadman Sakib , Milind Rampure , Nirmalya Roy

Over the past decades, there has been an explosion in the amount of available Earth Observation (EO) data. The unprecedented coverage of the Earth's surface and atmosphere by satellite imagery has resulted in large volumes of data that must…

The advent of Large Language Models (LLMs) has significantly reshaped the trajectory of the AI revolution. Nevertheless, these LLMs exhibit a notable limitation, as they are primarily adept at processing textual information. To address this…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Akash Ghosh , Arkadeep Acharya , Sriparna Saha , Vinija Jain , Aman Chadha

When we are primarily interested in solving several problems jointly with a given prescribed high performance accuracy for each target application, then Foundation Models should for most cases be used rather than problem-specific models. We…

计算机视觉与模式识别 · 计算机科学 2024-06-27 Nikolaos Dionelis , Casper Fibaek , Luke Camilleri , Andreas Luyts , Jente Bosmans , Bertrand Le Saux

This paper explores capabilities of Vision Language Models on spreadsheet comprehension. We propose three self-supervised challenges with corresponding evaluation metrics to comprehensively evaluate VLMs on Optical Character Recognition…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Shiyu Xia , Junyu Xiong , Haoyu Dong , Jianbo Zhao , Yuzhang Tian , Mengyu Zhou , Yeye He , Shi Han , Dongmei Zhang

With the extremely rapid advances in remote sensing (RS) technology, a great quantity of Earth observation (EO) data featuring considerable and complicated heterogeneity is readily available nowadays, which renders researchers an…

计算机视觉与模式识别 · 计算机科学 2022-05-04 Jiaxin Li , Danfeng Hong , Lianru Gao , Jing Yao , Ke Zheng , Bing Zhang , Jocelyn Chanussot

Earth Observation (EO) is moving beyond static prediction toward multi-step analytical workflows that require coordinated reasoning over data, tools, and geospatial state. While foundation models and vision-language models have advanced…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Muhammad Akhtar Munir , Muhammad Umer Sheikh , Akashah Shabbir , Muhammad Haris Khan , Fahad Khan , Xiao Xiang Zhu , Begum Demir , Salman Khan

Earth observation (EO) is essential for understanding the evolving states of the Earth system. Although recent MLLMs have advanced EO research, they still lack the capability to tackle complex tasks that require multi-step reasoning and the…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Peilin Feng , Zhutao Lv , Junyan Ye , Xiaolei Wang , Xinjie Huo , Jinhua Yu , Wanghan Xu , Wenlong Zhang , Lei Bai , Conghui He , Weijia Li