English
Related papers

Related papers: MultiEarth 2023 -- Multimodal Learning for Earth a…

200 papers

Multi-modal remote sensing images are vital for Earth observation, yet complete paired observations are often scarce in practice. Existing generative methods commonly address this problem through isolated pairwise modality translation, but…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Zhiping Yu , Chenyang Liu , Jinqi Cao , Qinzhe Yang , Siwei Yu , Zhengxia Zou , Zhenwei Shi

Flooding is one of the most destructive and costly natural disasters, and climate changes would further increase risks globally. This work presents a novel multimodal machine learning approach for multi-year global flood risk prediction,…

Machine Learning · Computer Science 2023-01-31 Cynthia Zeng , Dimitris Bertsimas

Beyond the immediate biophysical benefits, urban trees play a foundational role in environmental sustainability and disaster mitigation. Precise mapping of urban trees is essential for environmental monitoring, post-disaster assessment, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 In Seon Kim , Ali Moghimi

Accurate monsoon rainfall prediction is vital for India's agriculture, water management, and climate risk planning, yet remains challenging due to sparse ground observations and complex regional variability. We present a multimodal deep…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Swaib Ilias Mazumder , Manish Kumar , Aparajita Khan

Forests are vital to ecosystems, supporting biodiversity and essential services, but are rapidly changing due to land use and climate change. Understanding and mitigating negative effects requires parsing data on forests at global scale…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Nikolaos Ioannis Bountos , Arthur Ouaknine , Ioannis Papoutsis , David Rolnick

Depth estimation and 3D reconstruction have been extensively studied as core topics in computer vision. Starting from rigid objects with relatively simple geometric shapes, such as vehicles, the research has expanded to address general…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Muhammad Aamir , Naoya Muramatsu , Sangyun Shin , Matthew Wijers , Jia-Xing Zhong , Xinyu Hou , Amir Patel , Andrew Loveridge , Andrew Markham

Our experience of the world is multimodal - we see objects, hear sounds, feel texture, smell odors, and taste flavors. Modality refers to the way in which something happens or is experienced and a research problem is characterized as…

Machine Learning · Computer Science 2017-08-02 Tadas Baltrušaitis , Chaitanya Ahuja , Louis-Philippe Morency

We present the DeepGlobe 2018 Satellite Image Understanding Challenge, which includes three public competitions for segmentation, detection, and classification tasks on satellite images. Similar to other challenges in computer vision domain…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Ilke Demir , Krzysztof Koperski , David Lindenbaum , Guan Pang , Jing Huang , Saikat Basu , Forest Hughes , Devis Tuia , Ramesh Raskar

With the rapid advancement of Multimodal Large Language Models (MLLMs), an increasing number of researchers are exploring their application in recommendation systems. However, the high latency associated with large models presents a…

Information Retrieval · Computer Science 2025-04-29 Junjie Zhou

With the widespread adoption of Extended Reality (XR) headsets, spatial computing technologies are gaining increasing attention. Spatial computing enables interaction with virtual elements through natural input methods such as eye tracking,…

Human-Computer Interaction · Computer Science 2025-06-16 Zhimin Wang , Maohang Rao , Shanghua Ye , Weitao Song , Feng Lu

This report summarizes the objectives, datasets, and top-performing methodologies of the 2026 Pixel-level Video Understanding in the Wild (PVUW) Challenge, hosted at CVPR 2026, which evaluates state-of-the-art models under highly…

The innovative application of precise geospatial vegetation forecasting holds immense potential across diverse sectors, including agriculture, forestry, humanitarian aid, and carbon accounting. To leverage the vast availability of satellite…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Vitus Benson , Claire Robin , Christian Requena-Mesa , Lazaro Alonso , Nuno Carvalhais , José Cortés , Zhihan Gao , Nora Linscheid , Mélanie Weynants , Markus Reichstein

Natural disasters cause devastating damage to communities and infrastructure every year. Effective disaster response is hampered by the difficulty of accessing affected areas during and after events. Remote sensing has allowed us to monitor…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Shreelekha Revankar , Utkarsh Mall , Cheng Perng Phoo , Kavita Bala , Bharath Hariharan

Autonomous mobile robots need to perceive the environments with their onboard sensors (e.g., LiDARs and RGB cameras) and then make appropriate navigation decisions. In order to navigate human-inhabited public spaces, such a navigation task…

Robotics · Computer Science 2023-09-25 Bhabaranjan Panigrahi , Amir Hossain Raj , Mohammad Nazeri , Xuesu Xiao

Goal-oriented navigation presents a fundamental challenge for autonomous systems, requiring agents to navigate complex environments to reach designated targets. This survey offers a comprehensive analysis of multimodal navigation approaches…

Robotics · Computer Science 2025-04-23 I-Tak Ieong , Hao Tang

Despite the recent advancements in robotics and machine learning (ML), the deployment of autonomous robots in our everyday lives is still an open challenge. This is due to multiple reasons among which are their frequent mistakes, such as…

Recent research in geospatial machine learning has demonstrated that models pretrained with self-supervised learning on Earth observation data can perform well on downstream tasks with limited training data. However, most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Lucia Gordon , Serge Belongie , Christian Igel , Nico Lang

Recent advances in semantic segmentation of multi-modal remote sensing images have significantly improved the accuracy of tree cover mapping, supporting applications in urban planning, forest monitoring, and ecological assessment.…

Image and Video Processing · Electrical Eng. & Systems 2025-12-16 Yuanyuan Gui , Wei Li , Yinjian Wang , Xiang-Gen Xia , Mauro Marty , Christian Ginzler , Zuyuan Wang

Automated analysis of vast Earth observation data via interactive Vision-Language Models (VLMs) can unlock new opportunities for environmental monitoring, disaster response, and {resource management}. Existing generic VLMs do not perform…

This report provides a comprehensive overview of the 4th Pixel-level Video Understanding in the Wild (PVUW) Challenge, held in conjunction with CVPR 2025. It summarizes the challenge outcomes, participating methodologies, and future…