English
Related papers

Related papers: Boosting Multimodal Remote Sensing Image Classific…

200 papers

Hyperspectral image (HSI) and SAR/LiDAR data offer complementary spectral and structural information for land-cover classification. However, their effective fusion remains challenging due to two major limitations: The spectral redundancy in…

Image and Video Processing · Electrical Eng. & Systems 2026-05-01 Chuanzheng Gong , Feng Gao , Junyan Lin , Junyu Dong , Qian Du

Data-hungry HSI classification methods require high-quality labeled HSIs, which are often costly to obtain. This characteristic limits the performance potential of data-driven methods when dealing with limited annotated samples. Bridging…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Xizhe Xue , Haokui Zhang , Haizhao Jing , Lijie Tao , Zongwen Bai , Ying Li

Several approaches have been proposed to solve the spectral unmixing problem in hyperspectral image analysis. Among them the use of sparse regression techniques aims to characterize the abundances in pixels based on a large library of…

Image and Video Processing · Electrical Eng. & Systems 2021-02-12 L. C. Ayres , S. J. M. de Almeida , J. C. M. Bermudez , R. A. Borsoi

While image registration has been studied in remote sensing community for decades, registering multimodal data [e.g., optical, LiDAR, SAR, and map] remains a challenging problem because of significant nonlinear intensity differences between…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Yuanxin Ye , Lorenzo Bruzzone , Jie Shan , Francesca Bovolo , Qing Zhu

Multimodal signals on sensor networks are commonly modeled under the twofold graph assumption (TGA), which represents spatial structure and inter-modality relations as two separate graphs. Existing TGA-based signal restoration methods,…

Signal Processing · Electrical Eng. & Systems 2026-05-27 Haruki Yokota , Hiroshi Higashi , Yuichi Tanaka

Transforming road network data into vector representations using deep learning has proven effective for road network analysis. However, urban road networks' heterogeneous and hierarchical nature poses challenges for accurate representation…

Artificial Intelligence · Computer Science 2025-09-10 Jian Yang , Jiahui Wu , Li Fang , Hongchao Fan , Bianying Zhang , Huijie Zhao , Guangyi Yang , Rui Xin , Xiong You

We introduce a novel method for conditioning diffusion-based image synthesis models with heterogeneous graph data. Existing approaches typically incorporate conditioning variables directly into model architectures, either through…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Rupert Menneer , Christos Margadji , Sebastian W. Pattinson

Many real-world data can be represented as heterogeneous graphs with different types of nodes and connections. Heterogeneous graph neural network model aims to embed nodes or subgraphs into low-dimensional vector space for various…

Artificial Intelligence · Computer Science 2024-12-24 Xinjun Cai , Jiaxing Shang , Fei Hao , Dajiang Liu , Linjiang Zheng

Graph-based models have emerged as a powerful paradigm for modeling multimodal urban data and learning region representations for various downstream tasks. However, existing approaches face two major limitations. (1) They typically employ…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yaya Zhao , Kaiqi Zhao , Zixuan Tang , Zhiyuan Liu , Xiaoling Lu , Yalei Du

Graph Transformers have recently achieved remarkable progress in graph representation learning by capturing long-range dependencies through self-attention. However, their quadratic computational complexity and inability to effectively model…

Machine Learning · Computer Science 2025-12-17 Yifan Lu , Ziyun Zou , Belal Alsinglawi , Islam Al-Qudah , Izzat Alsmadi , Feilong Tang , Pengfei Jiao , Shoaib Jameel , Imran Razzak

This paper addresses the problem of semi-supervised transfer learning with limited cross-modality data in remote sensing. A large amount of multi-modal earth observation images, such as multispectral imagery (MSI) or synthetic aperture…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Danfeng Hong , Naoto Yokoya , Gui-Song Xia , Jocelyn Chanussot , Xiao Xiang Zhu

Hyperspectral salient object detection (HSOD) aims to extract targets or regions with significantly different spectra from hyperspectral images. While existing deep learning-based methods can achieve good detection results, they generally…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Peifu Liu , Tingfa Xu , Guokai Shi , Jingxuan Xu , Huan Chen , Jianan Li

Modeling temporal multimodal data poses significant challenges in classification tasks, particularly in capturing long-range temporal dependencies and intricate cross-modal interactions. Audiovisual data, as a representative example, is…

Machine Learning · Computer Science 2025-08-05 Feng Xu , Hui Wang , Yuting Huang , Danwei Zhang , Zizhu Fan

Unsupervised heterogeneous graph representation learning (UHGRL) has gained increasing attention due to its significance in handling practical graphs without labels. However, heterophily has been largely ignored, despite its ubiquitous…

Machine Learning · Computer Science 2025-02-05 Zhixiang Shen , Zhao Kang

Despite the success of Heterogeneous Graph Neural Networks (HGNNs) in modeling real-world Heterogeneous Information Networks (HINs), challenges such as expressiveness limitations and over-smoothing have prompted researchers to explore Graph…

Machine Learning · Computer Science 2024-07-19 Qiuyu Zhu , Liang Zhang , Qianxiong Xu , Kaijun Liu , Cheng Long , Xiaoyang Wang

RGB-thermal salient object detection (RGB-T SOD) aims to locate the common prominent objects of an aligned visible and thermal infrared image pair and accurately segment all the pixels belonging to those objects. It is promising in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Xiurong Jiang , Lin Zhu , Yifan Hou , Hui Tian

Unsupervised graph representation learning(GRL) aims to distill diverse graph information into task-agnostic embeddings without label supervision. Due to a lack of support from labels, recent representation learning methods usually adopt…

Machine Learning · Computer Science 2023-04-18 Bei Lin , You Li , Ning Gui , Zhuopeng Xu , Zhiwu Yu

Multi-modal skin lesion diagnosis (MSLD) has achieved remarkable success by modern computer-aided diagnosis (CAD) technology based on deep convolutions. However, the information aggregation across modalities in MSLD remains challenging due…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Yilan Zhang , Fengying Xie , Jianqi Chen

The use of Deep Learning techniques for classification in Hyperspectral Imaging (HSI) is rapidly growing and achieving improved performances. Due to the nature of the data captured by sensors that produce HSI images, a common issue is the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Aryan Vats , Manan Suri

Recent years have witnessed the emerging success of graph neural networks (GNNs) for modeling structured data. However, most GNNs are designed for homogeneous graphs, in which all nodes and edges belong to the same types, making them…

Machine Learning · Computer Science 2020-03-04 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Yizhou Sun