English
Related papers

Related papers: Learning a Graph Neural Network with Cross Modalit…

200 papers

Multi-graph learning is crucial for extracting meaningful signals from collections of heterogeneous graphs. However, effectively integrating information across graphs with differing topologies, scales, and semantics, often in the absence of…

Machine Learning · Computer Science 2026-02-02 Zahra Moslemi , Ziyi Liang , Norbert Fortin , Babak Shahbaba

Graph Neural Networks (GNNs) have achieved significant success across various applications. However, their complex structures and inner workings can be challenging for non-AI experts to understand. To address this issue, this study presents…

Human-Computer Interaction · Computer Science 2025-12-18 Yilin Lu , Chongwei Chen , Yuxin Chen , Kexin Huang , Marinka Zitnik , Qianwen Wang

Multiple object tracking (MOT) is a significant task in achieving autonomous driving. Traditional works attempt to complete this task, either based on point clouds (PC) collected by LiDAR, or based on images captured from cameras. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Guangming Wang , Chensheng Peng , Jinpeng Zhang , Hesheng Wang

Graph Neural Networks (GNNs) excel in graph-based learning tasks, but their complex, non-linear operations often render them as opaque "black boxes". This opacity hinders user trust, complicates debugging, bias detection, and adoption in…

Artificial Intelligence · Computer Science 2025-11-18 TC Singh , Sougata Mukherjea

A large number of real-world graphs or networks are inherently heterogeneous, involving a diversity of node types and relation types. Heterogeneous graph embedding is to embed rich structural and semantic information of a heterogeneous…

Social and Information Networks · Computer Science 2020-04-01 Xinyu Fu , Jiani Zhang , Ziqiao Meng , Irwin King

In recent years, Graph Neural Networks (GNNs) have shown superior performance on diverse real-world applications. To improve the model capacity, besides designing aggregation operations, GNN topology design is also very important. In…

Machine Learning · Computer Science 2022-02-02 Lanning Wei , Huan Zhao , Zhiqiang He

This research focuses on the discovery and localization of hidden objects in the wild and serves unmanned systems. Through empirical analysis, infrared and visible image fusion (IVIF) enables hard-to-find objects apparent, whereas…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Di Wang , Jinyuan Liu , Risheng Liu , Xin Fan

Cross-modal information retrieval aims to find heterogeneous data of various modalities from a given query of one modality. The main challenge is to map different modalities into a common semantic space, in which distance between concepts…

Information Retrieval · Computer Science 2018-02-14 Jing Yu , Yuhang Lu , Zengchang Qin , Yanbing Liu , Jianlong Tan , Li Guo , Weifeng Zhang

A key challenge in learning from multimodal biological data is missing modalities, where data from one or more modalities are absent for some patients. Existing approaches either exclude patients with missing modalities, impute missing…

Machine Learning · Computer Science 2026-05-19 Sina Tabakhi , Chen , Chen , Haiping Lu

Multispectral object detection aims to leverage complementary information from visible (RGB) and infrared (IR) modalities to enable robust performance under diverse environmental conditions. Our key insight, derived from wavelet analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Seongmin Hwang , Daeyoung Han , Moongu Jeon

Graph Neural Network (GNN) is a powerful model to learn representations and make predictions on graph data. Existing efforts on GNN have largely defined the graph convolution as a weighted sum of the features of the connected nodes to form…

Machine Learning · Computer Science 2020-06-02 Hongmin Zhu , Fuli Feng , Xiangnan He , Xiang Wang , Yan Li , Kai Zheng , Yongdong Zhang

This paper investigates the graph neural network (GNN)-enabled beamforming design for interference channels. We propose a model termed interference channel GNN (ICGNN) to solve a quality-of-service constrained energy efficiency maximization…

Signal Processing · Electrical Eng. & Systems 2025-02-07 Changpeng He , Yang Lu , Bo Ai , Octavia A. Dobre , Zhiguo Ding , Dusit Niyato

In this paper, we propose a similarity-aware fusion network (SAFNet) to adaptively fuse 2D images and 3D point clouds for 3D semantic segmentation. Existing fusion-based methods achieve remarkable performances by integrating information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Linqing Zhao , Jiwen Lu , Jie Zhou

In this study, we present the Graph Sub-Graph Network (GSN), a novel hybrid image classification model merging the strengths of Convolutional Neural Networks (CNNs) for feature extraction and Graph Neural Networks (GNNs) for structural…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Aryan Singh , Pepijn Van de Ven , Ciarán Eising , Patrick Denny

Driven by the outstanding performance of neural networks in the structured Euclidean domain, recent years have seen a surge of interest in developing neural networks for graphs and data supported on graphs. The graph is leveraged at each…

Machine Learning · Computer Science 2021-07-28 Elvin Isufi , Fernando Gama , Alejandro Ribeiro

Various graph neural networks (GNNs) have been proposed to solve node classification tasks in machine learning for graph data. GNNs use the structural information of graph data by aggregating the features of neighboring nodes. However, they…

Machine Learning · Computer Science 2022-12-29 Yuga Oishi , Ken kaneiwa

Heterogeneous graph neural networks (GNNs) have been successful in handling heterogeneous graphs. In existing heterogeneous GNNs, meta-path plays an essential role. However, recent work pointed out that simple homogeneous graph model…

Machine Learning · Computer Science 2024-12-17 Guanghui Zhu , Zhennan Zhu , Hongyang Chen , Chunfeng Yuan , Yihua Huang

Pooling is a crucial operation in computer vision, yet the unique structure of skeletons hinders the application of existing pooling strategies to skeleton graph modelling. In this paper, we propose an Improved Graph Pooling Network,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Cong Wu , Xiao-Jun Wu , Tianyang Xu , Josef Kittler

Graph neural networks (GNNs) have emerged as a promising solution to deal with unstructured data, outperforming traditional deep learning architectures. However, most of the current GNN models are designed to work with a single graph, which…

Machine Learning · Computer Science 2024-11-11 Victor M. Tenorio , Antonio G. Marques

Existing Graph Neural Networks (GNNs) are limited to process graphs each of whose vertices is represented by a vector or a single value, limited their representing capability to describe complex objects. In this paper, we propose the first…

Machine Learning · Computer Science 2024-07-02 Jiongshu Wang , Jing Yang , Jiankang Deng , Hatice Gunes , Siyang Song