English
Related papers

Related papers: DisasterInsight: A Multimodal Benchmark for Functi…

200 papers

Multimodal Large Language Models (MLLMs) have made significant strides in natural images and satellite remote sensing images. However, understanding low-altitude drone scenarios remains a challenge. Existing datasets primarily focus on a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yang Zhan , Yuan Yuan

Grounding language in the physical world requires AI systems to interpret references that emerge dynamically during conversation. While current vision-language models (VLMs) excel at static image tasks, they struggle to resolve ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Anna Deichler , Jim O'Regan , Fethiye Irmak Dogan , Lubos Marcinek , Anna Klezovich , Iolanda Leite , Jonas Beskow

High-resolution satellite imagery available immediately after disaster events is crucial for response planning as it facilitates broad situational awareness of critical infrastructure status such as building damage, flooding, and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Danil Kuzin , Olga Isupova , Brooke D. Simmons , Steven Reece

Remote sensing (RS) large vision-language models (LVLMs) have shown strong promise across visual grounding (VG) tasks. However, existing RS VG datasets predominantly rely on explicit referring expressions-such as relative position, relative…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yue Zhou , Jue Chen , Zilun Zhang , Penghui Huang , Ran Ding , Zhentao Zou , PengFei Gao , Yuchen Wei , Ke Li , Xue Yang , Xue Jiang , Hongxin Yang , Jonathan Li

Recent benchmarks and datasets have been proposed to improve spatial reasoning in vision-language models (VLMs), yet existing open resources remain limited in scale, visual diversity, and instruction expressiveness. In this work, we…

Remote sensing change understanding (RSCU) is essential for analyzing remote sensing images and understanding how human activities affect the environment. However, existing datasets lack deep understanding and interactions in the diverse…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Junxiao Xue , Quan Deng , Xuecheng Wu , Kelu Yao , Xinyi Yin , Fei Yu , Wei Zhou , Yanfei Zhong , Yang Liu , Dingkang Yang

Automated analysis of vast Earth observation data via interactive Vision-Language Models (VLMs) can unlock new opportunities for environmental monitoring, disaster response, and {resource management}. Existing generic VLMs do not perform…

Artificial intelligence has transformed the seismic community with deep learning models (DLMs) that are trained to complete specific tasks within workflows. However, there is still lack of robust evaluation frameworks for evaluating and…

Machine Learning · Computer Science 2025-06-03 Samuel Myren , Nidhi Parikh , Rosalyn Rael , Garrison Flynn , Dave Higdon , Emily Casleton

The rapid progress of Multimodal Large Language Models (MLLMs) has unlocked the potential for enhanced 3D scene understanding and spatial reasoning. A recent line of work explores learning spatial reasoning directly from multi-view images,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Kanghee Lee , Injae Lee , Minseok Kwak , Jungi Hong , Kwonyoung Ryu , Jaesik Park

We introduce InterChart, a diagnostic benchmark that evaluates how well vision-language models (VLMs) reason across multiple related charts, a task central to real-world applications such as scientific reporting, financial analysis, and…

Computation and Language · Computer Science 2026-05-04 Anirudh Iyengar Kaniyar Narayana Iyengar , Srija Mukhopadhyay , Adnan Qidwai , Shubhankar Singh , Dan Roth , Vivek Gupta

Fine-grained wildfire spread prediction is crucial for enhancing emergency response efficacy and decision-making precision. However, existing research predominantly focuses on coarse spatiotemporal scales and relies on low-resolution…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Nan Zhou , Huandong Wang , Jiahao Li , Han Li , Yali Song , Qiuhua Wang , Yong Li , Xinlei Chen

Geo-spatial analysis of our world benefits from a multimodal approach, as every single geographic location can be described in numerous ways (images from various viewpoints, textual descriptions, geographic coordinates, etc.). Current…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Oskar Kristoffersen , Alba Reinders Sánchez , Morten Rieger Hannemose , Anders Bjorholm Dahl , Dim P. Papadopoulos

In times of crisis, the prompt and precise classification of disaster-related information shared on social media platforms is crucial for effective disaster response and public safety. During such critical events, individuals use social…

Computers and Society · Computer Science 2025-10-21 Shahid Shafi Dar , Mohammad Zia Ur Rehman , Karan Bais , Mohammed Abdul Haseeb , Nagendra Kumara

This paper presents the largest known benchmark dataset for road damage assessment and road alignment, and provides 18 baseline models trained on the CRASAR-U-DRIODs dataset's post-disaster small uncrewed aerial systems (sUAS) imagery from…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Thomas Manzini , Priyankari Perali , Raisa Karnik , Robin R. Murphy

Psychological support hotlines serve as critical lifelines for crisis intervention but encounter significant challenges due to rising demand and limited resources. Large language models (LLMs) offer potential support in crisis assessments,…

Computation and Language · Computer Science 2025-12-19 Guifeng Deng , Shuyin Rao , Tianyu Lin , Anlu Dai , Pan Wang , Junyi Xie , Haidong Song , Ke Zhao , Dongwu Xu , Zhengdong Cheng , Tao Li , Haiteng Jiang

Nature disasters play a key role in shaping human-urban infrastructure interactions. Effective and efficient response to natural disasters is essential for building resilience and a sustainable urban environment. Two types of information…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Hao Li , Fabian Deuser , Wenping Yina , Xuanshu Luo , Paul Walther , Gengchen Mai , Wei Huang , Martin Werner

This thesis explores a multimodal AI framework for enhancing construction safety through the combined analysis of textual and visual data. In safety-critical environments such as construction sites, accident data often exists in multiple…

Artificial Intelligence · Computer Science 2025-11-21 Islem Sahraoui

Most post-disaster damage classifiers succeed only when destructive forces leave clear spectral or structural signatures -- conditions rarely present after inundation. Consequently, existing models perform poorly at identifying…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yu-Hsuan Ho , Ali Mostafavi

Low-latency delivery of satellite imagery is essential for time-critical applications such as disaster response, intelligence, and infrastructure monitoring. However, traditional pipelines rely on downlinking all captured images before…

Machine Learning · Computer Science 2026-04-21 Ansel Kaplan Erol , Seungjun Lee , Divya Mahajan

Recent advancements in Large Vision-Language Models (LVLMs) have significantly enhanced their ability to integrate visual and linguistic information, achieving near-human proficiency in tasks like object recognition, captioning, and visual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Zhikai Wang , Jiashuo Sun , Wenqi Zhang , Zhiqiang Hu , Xin Li , Fan Wang , Deli Zhao