English
Related papers

Related papers: Toward Effective Multimodal Graph Foundation Model…

200 papers

Graph Neural Networks (GNNs) with numerical node features and graph structure as inputs have demonstrated superior performance on various supervised learning tasks with graph data. However the numerical node features utilized by GNNs are…

Machine Learning · Computer Science 2022-06-20 Jiuhai Chen , Jonas Mueller , Vassilis N. Ioannidis , Tom Goldstein , David Wipf

Emotion Recognition in Conversation (ERC) plays a significant part in Human-Computer Interaction (HCI) systems since it can provide empathetic services. Multimodal ERC can mitigate the drawbacks of uni-modal approaches. Recently, Graph…

Computation and Language · Computer Science 2023-11-23 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

Graph convolution network based approaches have been recently used to model region-wise relationships in region-level prediction problems in urban computing. Each relationship represents a kind of spatial dependency, like region-wise…

Machine Learning · Computer Science 2019-05-29 Xu Geng , Xiyu Wu , Lingyu Zhang , Qiang Yang , Yan Liu , Jieping Ye

Digital maps play a crucial role in various applications such as navigation, fleet management, and ride-sharing, necessitating their accuracy and currency, which require timely updates. While the majority of geospatial databases (GDBs)…

Machine Learning · Computer Science 2025-09-08 Farnoosh Hashemi , Laks V. S. Lakshmanan

Graph Neural Networks (GNNs) have significant advantages in handling non-Euclidean data and have been widely applied across various areas, thus receiving increasing attention in recent years. The framework of GNN models mainly includes the…

Machine Learning · Computer Science 2025-02-05 Shengda Zhuo , Jiwang Fang , Hongguang Lin , Yin Tang , Min Chen , Changdong Wang , Shuqiang Huang

Relational databases store much of the world's structured information, and they are essential for driving complex predictive applications. However, deep learning progress on relational data remains limited, as conventional approaches…

Graph Neural Networks (GNNs) have become a central tool for learning on graph-structured data, yet their applicability to real-world systems remains limited by key challenges such as scalability, temporality, directionality, data…

Machine Learning · Computer Science 2025-10-28 Emanuele Rossi

The knowledge-grounded dialogue task aims to generate responses that convey information from given knowledge documents. However, it is a challenge for the current sequence-based model to acquire knowledge from complex documents and…

Computation and Language · Computer Science 2024-05-17 Yizhe Yang , Heyan Huang , Yang Gao , Jiawei Li and

This paper addresses the challenge of decentralized task allocation within heterogeneous multi-agent systems operating under communication constraints. We introduce a novel framework that integrates graph neural networks (GNNs) with a…

Robotics · Computer Science 2025-02-21 Lavanya Ratnabala , Aleksey Fedoseev , Robinroy Peter , Dzmitry Tsetserukou

Graph convolutional neural networks (GCNNs) have been attracting increasing research attention due to its great potential in inference over graph structures. However, insufficient effort has been devoted to the aggregation methods between…

Machine Learning · Computer Science 2019-05-15 Penghui Sun , Jingwei Qu , Xiaoqing Lyu , Haibin Ling , Zhi Tang

Large Foundation Models (LFMs) have demonstrated significant advantages in civil engineering, but they primarily focus on textual and visual data, overlooking the rich semantic, spatial, and topological features in BIM (Building Information…

Machine Learning · Computer Science 2025-09-30 Jin Han , Xin-Zheng Lu , Jia-Rui Lin

Multimodal learning has shown significant performance boost compared to ordinary unimodal models across various domains. However, in real-world scenarios, multimodal signals are susceptible to missing because of sensor failures and adverse…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Nhi Kieu , Kien Nguyen , Arnold Wiliem , Clinton Fookes , Sridha Sridharan

Text-guided medical segmentation enhances segmentation accuracy by utilizing clinical reports as auxiliary information. However, existing methods typically rely on unaligned image and text encoders, which necessitate complex interaction…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Gaoren Lin , Huangxuan Zhao , Yuan Xiong , Lefei Zhang , Bo Du , Wentao Zhu

Representation learning on text-attributed graphs (TAGs), where nodes are represented by textual descriptions, is crucial for textual and relational knowledge systems and recommendation systems. Currently, state-of-the-art embedding methods…

Computation and Language · Computer Science 2024-12-24 Yi Fang , Dongzhe Fan , Sirui Ding , Ninghao Liu , Qiaoyu Tan

Graph-level clustering is a fundamental task of data mining, aiming at dividing unlabeled graphs into distinct groups. However, existing deep methods that are limited by pooling have difficulty extracting diverse and complex graph structure…

Machine Learning · Computer Science 2025-04-03 Renda Han , Guangzhen Yao , Wenxin Zhang , Yu Li , Wen Xin , Huajie Lei , Mengfei Li , Zeyu Zhang , Chengze Du , Yahe Tian

Graph Neural Networks (GNNs) have attracted increasing attention in recent years and have achieved excellent performance in semi-supervised node classification tasks. The success of most GNNs relies on one fundamental assumption, i.e., the…

Machine Learning · Computer Science 2024-12-03 Junchao Lin , Yuan Wan , Jingwen Xu , Xingchen Qi

Foundation models have ushered in a new era for multimodal video understanding by enabling the extraction of rich spatiotemporal and semantic representations. In this work, we introduce a novel graph-based framework that integrates a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Fatemeh Ziaeetabar , Florentin Wörgötter

Graphs can model complicated interactions between entities, which naturally emerge in many important applications. These applications can often be cast into standard graph learning tasks, in which a crucial step is to learn low-dimensional…

Machine Learning · Computer Science 2023-07-04 Xuexin Chen , Ruichu Cai , Yuan Fang , Min Wu , Zijian Li , Zhifeng Hao

Multimodal Attributed Graphs (MMAGs) are an expressive data model for representing the complex interconnections among entities that associate attributes from multiple data modalities (text, images, etc.). Clustering over such data finds…

Machine Learning · Computer Science 2025-11-26 Haoran Zheng , Renchi Yang , Hongtao Wang , Jianliang Xu

Graph neural networks (GNNs) have emerged as a powerful paradigm for embedding-based entity alignment due to their capability of identifying isomorphic subgraphs. However, in real knowledge graphs (KGs), the counterpart entities usually…

Computation and Language · Computer Science 2019-11-21 Zequn Sun , Chengming Wang , Wei Hu , Muhao Chen , Jian Dai , Wei Zhang , Yuzhong Qu