English
Related papers

Related papers: A Modality-Tailored Graph Modeling Framework for U…

200 papers

Pre-training Graph Neural Networks (GNN) via self-supervised contrastive learning has recently drawn lots of attention. However, most existing works focus on node-level contrastive learning, which cannot capture global graph structure. The…

Machine Learning · Computer Science 2021-04-19 Shichang Zhang , Ziniu Hu , Arjun Subramonian , Yizhou Sun

Urban region profiling can benefit urban analytics. Although existing studies have made great efforts to learn urban region representation from multi-source urban data, there are still three limitations: (1) Most related methods focused…

Artificial Intelligence · Computer Science 2022-02-07 Y. Luo , F. Chung , K. Chen

Trajectory representation learning is a fundamental task for applications in fields including smart city, and urban planning, as it facilitates the utilization of trajectory data (e.g., vehicle movements) for various downstream…

Machine Learning · Computer Science 2025-01-03 Stefan Schestakov , Simon Gottschalk

Graph Foundation Models (GFMs) have achieved remarkable success in generalizing across diverse domains. However, they mainly focus on Text-Attributed Graphs (TAGs), leaving Multimodal-Attributed Graphs (MAGs) largely untapped. Developing…

Machine Learning · Computer Science 2026-02-05 Sicheng Liu , Xunkai Li , Daohan Su , Ru Zhang , Hongchao Qin , Ronghua Li , Guoren Wang

Unsupervised multimodal change detection is a practical and challenging topic that can play an important role in time-sensitive emergency applications. To address the challenge that multimodal remote sensing images cannot be directly…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Hongruixuan Chen , Naoto Yokoya , Chen Wu , Bo Du

Real-world heterogeneous graphs are inherently noisy and usually not in the optimal graph structures for downstream tasks, which often adversely affects the performance of GRL models in downstream tasks. Although Graph Structure Learning…

Machine Learning · Computer Science 2026-04-08 He Zhao , Zhiwei Zeng , Yongwei Wang , Chunyan Miao

Generative recommendation (GR) has become a powerful paradigm in recommendation systems that implicitly links modality and semantics to item representation, in contrast to previous methods that relied on non-semantic item identifiers in…

Information Retrieval · Computer Science 2025-04-01 Jing Zhu , Mingxuan Ju , Yozen Liu , Danai Koutra , Neil Shah , Tong Zhao

Multimodal data plays a critical role in web-based recommendation systems, where information from diverse modalities such as vision and text enhances representation learning. However, real-world multimodal datasets often suffer from…

Information Retrieval · Computer Science 2026-05-04 Yuan Li , Jun Hu , Jiaxin Jiang , Bryan Hooi , Bingsheng He

In recent years, the advancement of Graph Neural Networks (GNNs) has significantly propelled progress in Multi-View Clustering (MVC). However, existing methods face the problem of coarse-grained graph fusion. Specifically, current…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jian Zhu , Xin Zou , Jun Sun , Cheng Luo , Lei Liu , Lingfang Zeng , Ning Zhang , Bian Wu , Chang Tang , Lirong Dai

Multivariate Time Series Classification (MTSC) enables the analysis if complex temporal data, and thus serves as a cornerstone in various real-world applications, ranging from healthcare to finance. Since the relationship among variables in…

Machine Learning · Computer Science 2025-01-20 Wennuo Yang , Shiling Wu , Yuzhi Zhou , Cheng Luo , Xilin He , Weicheng Xie , Linlin Shen , Siyang Song

MultiModal Recommendation (MMR) systems have emerged as a promising solution for improving recommendation quality by leveraging rich item-side modality information, prompting a surge of diverse methods. Despite these advances, existing…

Information Retrieval · Computer Science 2025-08-25 Xiaoxiong Zhang , Xin Zhou , Zhiwei Zeng , Yongjie Wang , Dusit Niyato , Zhiqi Shen

Recent urbanization has coincided with the enrichment of geotagged data, such as street view and point-of-interest (POI). Region embedding enhanced by the richer data modalities has enabled researchers and city administrators to understand…

Machine Learning · Computer Science 2021-05-07 Tianyuan Huang , Zhecheng Wang , Hao Sheng , Andrew Y. Ng , Ram Rajagopal

Learning representations of multimodal data that are both informative and robust to missing modalities at test time remains a challenging problem due to the inherent heterogeneity of data obtained from different channels. To address it, we…

Machine Learning · Computer Science 2022-11-21 Petra Poklukar , Miguel Vasco , Hang Yin , Francisco S. Melo , Ana Paiva , Danica Kragic

Graph representation learning has attracted a surge of interest recently, whose target at learning discriminant embedding for each node in the graph. Most of these representation methods focus on supervised learning and heavily depend on…

Machine Learning · Computer Science 2021-07-07 Pengpeng Shao , Tong Liu , Dawei Zhang , Jianhua Tao , Feihu Che , Guohua Yang

Graph Neural Networks (GNNs) show strong expressive power on graph data mining, by aggregating information from neighbors and using the integrated representation in the downstream tasks. The same aggregation methods and parameters for each…

Machine Learning · Computer Science 2022-03-22 Xiaojun Ma , Qin Chen , Yuanyi Ren , Guojie Song , Liang Wang

With the emergence of multimodal electronic health records, the evidence for an outcome may be captured across multiple modalities ranging from clinical to imaging and genomic data. Predicting outcomes effectively requires fusion frameworks…

While Multi-view Graph Neural Networks (MVGNNs) excel at leveraging diverse modalities for learning object representation, existing methods assume identical local topology structures across modalities that overlook real-world discrepancies.…

Machine Learning · Computer Science 2024-06-05 Peiyu Liang , Hongchang Gao , Xubin He

Effectively modeling multimodal spatial omics data is critical for understanding tissue complexity and underlying biological mechanisms. While spatial transcriptomics, proteomics, and epigenomics capture molecular features, they lack…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yongjun Xiao , Dian Meng , Xinlei Huang , Yanran Liu , Shiwei Ruan , Ziyue Qiao , Xubin Zheng

We propose Neural Turtle Graphics (NTG), a novel generative model for spatial graphs, and demonstrate its applications in modeling city road layouts. Specifically, we represent the road layout using a graph where nodes in the graph…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Hang Chu , Daiqing Li , David Acuna , Amlan Kar , Maria Shugrina , Xinkai Wei , Ming-Yu Liu , Antonio Torralba , Sanja Fidler

Transforming road network data into vector representations using deep learning has proven effective for road network analysis. However, urban road networks' heterogeneous and hierarchical nature poses challenges for accurate representation…

Artificial Intelligence · Computer Science 2025-09-10 Jian Yang , Jiahui Wu , Li Fang , Hongchao Fan , Bianying Zhang , Huijie Zhao , Guangyi Yang , Rui Xin , Xiong You