中文
相关论文

相关论文: EarthDial: Turning Multi-sensory Earth Observation…

200 篇论文

Large vision and language assistants have enabled new capabilities for interpreting natural images. These approaches have recently been adapted to earth observation data, but they are only able to handle single image inputs, limiting their…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Jeremy Andrew Irvin , Emily Ruoyu Liu , Joyce Chuyi Chen , Ines Dormoy , Jinyoung Kim , Samar Khanna , Zhuo Zheng , Stefano Ermon

We present TerraMind, the first any-to-any generative, multimodal foundation model for Earth observation (EO). Unlike other multimodal models, TerraMind is pretrained on dual-scale representations combining both token-level and pixel-level…

Earth observation (EO) data spans a wide range of spatial, spectral, and temporal resolutions, from high-resolution optical imagery to low resolution multispectral products or radar time series. While recent foundation models have improved…

计算机视觉与模式识别 · 计算机科学 2025-12-05 Nicolas Houdré , Diego Marcos , Hugo Riffaud de Turckheim , Dino Ienco , Laurent Wendling , Camille Kurtz , Sylvain Lobry

The Internet of Things (IoT) network integrating billions of smart physical devices embedded with sensors, software, and communication technologies is a critical and rapidly expanding component of our modern world. The IoT ecosystem…

机器学习 · 计算机科学 2024-07-16 Shentong Mo , Russ Salakhutdinov , Louis-Philippe Morency , Paul Pu Liang

Recent advances in reinforcement learning (RL) have delivered strong reasoning capabilities in natural image domains, yet their potential for Earth Observation (EO) remains largely unexplored. EO tasks introduce unique challenges, spanning…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Mustansar Fiaz , Hiyam Debary , Paolo Fraccaro , Danda Paudel , Luc Van Gool , Fahad Khan , Salman Khan

Large Vision-Language Models (LVLMs) have shown impressive capabilities across a range of tasks that integrate visual and textual understanding, such as image captioning and visual question answering. These models are trained on large-scale…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Xiaomei Zhang , Hanyu Zheng , Xiangyu Zhu , Jinghuan Wei , Junhong Zou , Zhen Lei , Zhaoxiang Zhang

Earth Observation (EO) is moving beyond static prediction toward multi-step analytical workflows that require coordinated reasoning over data, tools, and geospatial state. While foundation models and vision-language models have advanced…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Muhammad Akhtar Munir , Muhammad Umer Sheikh , Akashah Shabbir , Muhammad Haris Khan , Fahad Khan , Xiao Xiang Zhu , Begum Demir , Salman Khan

Vision-Language Models (VLMs) increasingly operate on ultra-high-resolution (UHR) Earth observation imagery, yet they remain vulnerable to a severe scale mismatch between large-scale scene context and micro-scale targets. We refer to this…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Shuo Ni , Tong Wang , Jing Zhang , He Chen , Haonan Guo , Ning Zhang , Bo Du

The recent advancements introduced by Large Language Models (LLMs) have transformed how Artificial Intelligence (AI) can support complex, real world tasks, pushing research outside the text boundaries towards multi modal contexts and…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Federico Toschi , Nicolò Brunello , Andrea Sassella , Vincenzo Scotti , Mark James Carman

While numerous recent benchmarks focus on evaluating generic Vision-Language Models (VLMs), they do not effectively address the specific challenges of geospatial applications. Generic VLM benchmarks are not designed to handle the…

Recently, several multi-turn dialogue benchmarks have been proposed to evaluate the conversational abilities of large language models (LLMs). As LLMs are increasingly recognized as a key technology for advancing intelligent education, owing…

计算与语言 · 计算机科学 2025-10-16 Shouang Wei , Min Zhang , Xin Lin , Bo Jiang , Zhongxiang Dai , Kun Kuang

Vision-langugage models (VLMs) have shown strong performance in computer vision (CV), yet their performance on remote sensing (RS) data remains limited due to the lack of large-scale, multi-sensor RS image-text datasets with diverse textual…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Johann-Ludwig Herzog , Mathis Jürgen Adler , Leonard Hackel , Yan Shu , Angelos Zavras , Ioannis Papoutsis , Paolo Rota , Begüm Demir

The increasing frequency and severity of climate related disasters have intensified the need for real time monitoring, early warning, and informed decision-making. Earth Observation (EO), powered by satellite data and Machine Learning (ML),…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Stella Girtsou , Konstantinos Alexis , Giorgos Giannopoulos , Charalambos Kontoes

The rapid advancement of multimodal large language models (MLLMs) offers new opportunities for complex scientific challenges, yet their application in earth science-especially at the graduate level-remains underexplored due to a lack of…

人工智能 · 计算机科学 2026-05-05 Xiangyu Zhao , Wanghan Xu , Bo Liu , Yuhao Zhou , Fenghua Ling , Ben Fei , Xiaoyu Yue , Lei Bai , Wenlong Zhang , Xiao-Ming Wu

Remote sensing has evolved from simple image acquisition to complex systems capable of integrating and processing visual and textual data. This review examines the development and application of multi-modal language models (MLLMs) in remote…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Xintian Sun , Benji Peng , Charles Zhang , Fei Jin , Qian Niu , Junyu Liu , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Ming Liu , Xinyuan Song , Yichao Zhang

The fusion of language and vision in large vision-language models (LVLMs) has revolutionized deep learning-based object detection by enhancing adaptability, contextual reasoning, and generalization beyond traditional architectures. This…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Ranjan Sapkota , Manoj Karkee

Recent advancements in Large Language Models (LLMs) and Vision-Language Models (VLMs) have made them powerful tools in embodied navigation, enabling agents to leverage commonsense and spatial reasoning for efficient exploration in…

Grounding language in the physical world requires AI systems to interpret references that emerge dynamically during conversation. While current vision-language models (VLMs) excel at static image tasks, they struggle to resolve ambiguous…

计算机视觉与模式识别 · 计算机科学 2026-05-22 Anna Deichler , Jim O'Regan , Fethiye Irmak Dogan , Lubos Marcinek , Anna Klezovich , Iolanda Leite , Jonas Beskow

Modern Earth observation (EO) increasingly leverages deep learning to harness the scale and diversity of satellite imagery across sensors and regions. While recent foundation models have demonstrated promising generalization across EO…

Grounding language to a navigating agent's observations can leverage pretrained multimodal foundation models to match perceptions to object or event descriptions. However, previous approaches remain disconnected from environment mapping,…

机器人学 · 计算机科学 2025-06-10 Chenguang Huang , Oier Mees , Andy Zeng , Wolfram Burgard