English
Related papers

Related papers: A multi-scale vision transformer-based multimodal …

200 papers

Multimodal aerial data are used to monitor natural systems, and machine learning can significantly accelerate the classification of landscape features within such imagery to benefit ecology and conservation. It remains under-explored,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Lucia Gordon , Nico Lang , Catherine Ressijac , Andrew Davies

Optical and radar satellite time series are synergetic: optical images contain rich spectral information, while C-band radar captures useful geometrical information and is immune to cloud cover. Motivated by the recent success of temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Vivien Sainte Fare Garnot , Loic Landrieu , Nesrine Chehata

Depth estimation in complex real-world scenarios is a challenging task, especially when relying solely on a single modality such as visible light or thermal infrared (THR) imagery. This paper proposes a novel multimodal depth estimation…

Image and Video Processing · Electrical Eng. & Systems 2025-04-30 Zelin Meng , Takanori Fukao

Robust object detection for Unmanned Surface Vehicles (USVs) in complex water environments is essential for reliable navigation and operation. Specifically, water surface object detection faces challenges from blurred edges and diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Huilin Yin , Pengyu Wang , Senmao Li , Jun Yan , Daniel Watzenig

This paper introduces a novel deep learning-based multimodal fusion architecture aimed at enhancing the perception capabilities of autonomous navigation robots in complex environments. By utilizing innovative feature extraction modules,…

Machine Learning · Computer Science 2025-04-29 Delun Lai , Yeyubei Zhang , Yunchong Liu , Chaojie Li , Huadong Mo

Remote sensing spatiotemporal fusion (STF) addresses the fundamental trade-off between temporal and spatial resolution by combining high temporal-low spatial and high spatial-low temporal imagery. This paper presents the first comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Enzhe Sun , Yongchuan Cui , Peng Liu , Jining Yan

Climate change has increased the severity and frequency of weather disasters all around the world. Flood inundation mapping based on earth observation data can help in this context, by providing cheap and accurate maps depicting the area…

Machine Learning · Computer Science 2023-03-02 Kevin Iselborn , Marco Stricker , Takashi Miyamoto , Marlon Nuske , Andreas Dengel

Accurate beam prediction is essential for maintaining reliable links and high spectral efficiency in dynamic low-altitude wireless networks. However, existing approaches often fail to capture the deep correlations across heterogeneous…

Signal Processing · Electrical Eng. & Systems 2025-12-03 Xiaotong Zhao , Yuanhao Cui , Weijie Yuan , Ziye Jia , Heng Liu , Chengwen Xing

Automated segmentation of Martian landslides, particularly in tectonically active regions such as Valles Marineris,is important for planetary geology, hazard assessment, and future robotic exploration. However, detecting landslides from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Shahriar Kabir , Abdullah Muhammed Amimul Ehsan , Istiak Ahmmed Rifti , Md Kaykobad Reza

Multi-modal scene reconstruction integrating RGB and thermal infrared data is essential for robust environmental perception across diverse lighting and weather conditions. However, extending 3D Gaussian Splatting (3DGS) to multi-spectral…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Zhaoqi Su , Shihai Chen , Xinyan Lin , Liqin Huang , Zhipeng Su , Xiaoqiang Lu

Terrain-aware perception holds the potential to improve the robustness and accuracy of autonomous robot navigation in the wilds, thereby facilitating effective off-road traversals. However, the lack of multi-modal perception across various…

Robotics · Computer Science 2024-03-26 Chen Yao , Yangtao Ge , Guowei Shi , Zirui Wang , Ningbo Yang , Zheng Zhu , Hexiang Wei , Yuntian Zhao , Jing Wu , Zhenzhong Jia

Remote Sensing Image-Text Retrieval (RSITR) plays a critical role in geographic information interpretation, disaster monitoring, and urban planning by establishing semantic associations between image and textual descriptions. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Hailong Ning , Siying Wang , Tao Lei , Xiaopeng Cao , Huanmin Dou , Bin Zhao , Asoke K. Nandi , Petia Radeva

The rapid advancement of remote sensing foundation models, particularly vision and multimodal models, has significantly enhanced the capabilities of intelligent geospatial data interpretation. These models combine various data modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Ziyue Huang , Hongxi Yan , Qiqi Zhan , Shuai Yang , Mingming Zhang , Chenkai Zhang , YiMing Lei , Zeming Liu , Qingjie Liu , Yunhong Wang

Major depressive disorder (MDD) is a prevalent mental disorder associated with complex neurobiological changes that cannot be fully captured using a single imaging modality. The use of multimodal magnetic resonance imaging (MRI) provides a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Nojod M. Alotaibi , Areej M. Alhothali

Land Surface Temperature (LST) plays a key role in climate monitoring, urban heat assessment, and land-atmosphere interactions. However, current thermal infrared satellite sensors cannot simultaneously achieve high spatial and temporal…

Machine Learning · Computer Science 2025-12-24 Sofiane Bouaziz , Adel Hafiane , Raphael Canals , Rachid Nedjai

Remote sensing change detection is essential for environmental monitoring, urban planning, and related applications. However, current methods often struggle to capture long-range dependencies while maintaining computational efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Zhenyu Yang , Gensheng Pei , Yazhou Yao , Tianfei Zhou , Lizhong Ding , Fumin Shen

LiDAR and camera are two important sensors for 3D object detection in autonomous driving. Despite the increasing popularity of sensor fusion in this field, the robustness against inferior image conditions, e.g., bad illumination and sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xuyang Bai , Zeyu Hu , Xinge Zhu , Qingqiu Huang , Yilun Chen , Hongbo Fu , Chiew-Lan Tai

With the rapid development of deep learning, a variety of change detection methods based on deep learning have emerged in recent years. However, these methods usually require a large number of training samples to train the network model, so…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Weidong Yan , Pei Yan , Li Cao

This paper presents a novel method of landslide detection by exploiting the Mask R-CNN capability of identifying an object layout by using a pixel-based segmentation, along with transfer learning used to train the proposed model. A data set…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Silvia Liberata Ullo , Amrita Mohan , Alessandro Sebastianelli , Shaik Ejaz Ahamed , Basant Kumar , Ramji Dwivedi , G. R. Sinha

Multispectral pedestrian detection has shown great advantages under poor illumination conditions, since the thermal modality provides complementary information for the color image. However, real multispectral data suffers from the position…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Lu Zhang , Xiangyu Zhu , Xiangyu Chen , Xu Yang , Zhen Lei , Zhiyong Liu