English
Related papers

Related papers: A Modality-Tailored Graph Modeling Framework for U…

200 papers

Urban region representation is crucial for various urban downstream tasks. However, despite the proliferation of methods and their success, acquiring general urban region knowledge and adapting to different tasks remains challenging.…

Artificial Intelligence · Computer Science 2025-07-04 Jiahui Jin , Yifan Song , Dong Kan , Haojia Zhu , Xiangguo Sun , Zhicheng Li , Xigang Sun , Jinghui Zhang

Multi-modal recommender system focuses on utilizing rich modal information ( i.e., images and textual descriptions) of items to improve recommendation performance. The current methods have achieved remarkable success with the powerful…

Information Retrieval · Computer Science 2025-08-20 Shouxing Ma , Yawen Zeng , Shiqing Wu , Guandong Xu

Handling heterogeneous data in tabular datasets poses a significant challenge for deep learning models. While attention-based architectures and self-supervised learning have achieved notable success, their application to tabular data…

Machine Learning · Computer Science 2025-02-27 Anay Majee , Maria Xenochristou , Wei-Peng Chen

While Graph Neural Network (GNN) has shown superiority in learning node representations of homogeneous graphs, leveraging GNN on heterogeneous graphs remains a challenging problem. The dominating reason is that GNN learns node…

Social and Information Networks · Computer Science 2020-09-22 Ziyue Qiao , Pengyang Wang , Yanjie Fu , Yi Du , Pengfei Wang , Yuanchun Zhou

Graph neural networks (GNNs) have emerged as powerful tools for learning protein structures by capturing spatial relationships at the residue level. However, existing GNN-based methods often face challenges in learning multiscale…

Machine Learning · Computer Science 2026-02-03 Shih-Hsin Wang , Yuhao Huang , Taos Transue , Justin Baker , Jonathan Forstater , Thomas Strohmer , Bao Wang

Among various region embedding methods, graph-based region relation learning models stand out, owing to their strong structure representation ability for encoding spatial correlations with graph neural networks. Despite their effectiveness,…

Machine Learning · Computer Science 2023-05-09 Qianru Zhang , Chao Huang , Lianghao Xia , Zheng Wang , Zhonghang Li , Siuming Yiu

Human perception integrates multiple modalities, such as vision, hearing, and language, into a unified understanding of the surrounding reality. While recent multimodal models have achieved significant progress by aligning pairs of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Giordano Cicchetti , Eleonora Grassucci , Luigi Sigillo , Danilo Comminiello

Graph Convolutional Representation (GCR) has achieved impressive performance for graph data representation. However, existing GCR is generally defined on the input fixed graph which may restrict the representation capacity and also be…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Bo Jiang , Ziyan Zhang , Bin Luo

In this study, we focus on the graph representation learning (a.k.a. network embedding) in attributed graphs. Different from existing embedding methods that treat the incorporation of graph structure and semantic as the simple combination…

Social and Information Networks · Computer Science 2023-05-12 Meng Qin

Recently, multimodal graph learning (MGL) has garnered significant attention for integrating diverse modality information and structured context to support various network applications. However, real-world graphs are often isolated due to…

Machine Learning · Computer Science 2026-05-14 Sirui Zhang , Haonan Wang , Xunkai Li , Zekai Chen , Shumeng Li , Hongchao Qin , Rong-Hua Li , Guoren Wang

With the advancement of sensing technology, multivariate time series classification (MTSC) has recently received considerable attention. Existing deep learning-based MTSC techniques, which mostly rely on convolutional or recurrent neural…

Machine Learning · Computer Science 2021-11-09 Ziheng Duan , Haoyan Xu , Yueyang Wang , Yida Huang , Anni Ren , Zhongbin Xu , Yizhou Sun , Wei Wang

Graphs can model complicated interactions between entities, which naturally emerge in many important applications. These applications can often be cast into standard graph learning tasks, in which a crucial step is to learn low-dimensional…

Machine Learning · Computer Science 2023-07-04 Xuexin Chen , Ruichu Cai , Yuan Fang , Min Wu , Zijian Li , Zhifeng Hao

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in representing and understanding diverse modalities. However, they typically focus on modality alignment in a pairwise manner while overlooking structural…

Machine Learning · Computer Science 2025-06-13 Jiajin Liu , Dongzhe Fan , Jiacheng Shen , Chuanhao Ji , Daochen Zha , Qiaoyu Tan

Multimodal self-supervised learning (MSSL) has emerged as a key paradigm for pretraining geospatial foundation models. However, existing geospatial MSSL methods are mainly designed for static pairs of modalities, such as satellite imagery,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Maria Despoina Siampou , Gengchen Mai , Ni Lao , Jinmeng Rao , Neha Arora , Cyrus Shahabi , Shushman Choudhury

Accurate prediction of molecular properties is essential in drug discovery and related fields. However, existing graph neural networks (GNNs) often struggle to simultaneously capture both local and global molecular structures. In this work,…

Machine Learning · Computer Science 2025-08-26 XiaYu Liu , Chao Fan , Yang Liu , Hou-biao Li

With the release of increasing open-source emotion recognition datasets on social media platforms and the rapid development of computing resources, multimodal emotion recognition tasks (MER) have begun to receive widespread research…

Computation and Language · Computer Science 2024-09-04 Yuntao Shou , Tao Meng , Wei Ai , Nan Yin , Keqin Li

The goal of multi-modal learning is to use complimentary information on the relevant task provided by the multiple modalities to achieve reliable and robust performance. Recently, deep learning has led significant improvement in multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2018-11-05 Jaekyum Kim , Junho Koh , Yecheol Kim , Jaehyung Choi , Youngbae Hwang , Jun Won Choi

Multivariate time series forecasting, which analyzes historical time series to predict future trends, can effectively help decision-making. Complex relations among variables in MTS, including static, dynamic, predictable, and latent…

Machine Learning · Computer Science 2021-12-16 Yueyang Wang , Ziheng Duan , Yida Huang , Haoyan Xu , Jie Feng , Anni Ren

Graph generation is a crucial task in many fields, including network science and bioinformatics, as it enables the creation of synthetic graphs that mimic the properties of real-world networks for various applications. Graph Generative…

Machine Learning · Computer Science 2026-01-21 Salvatore Romano , Marco Grassia , Giuseppe Mangioni

Multimodal brain networks characterize complex connectivities among different brain regions from both structural and functional aspects and provide a new means for mental disease analysis. Recently, Graph Neural Networks (GNNs) have become…

Neurons and Cognition · Quantitative Biology 2022-05-25 Yanqiao Zhu , Hejie Cui , Lifang He , Lichao Sun , Carl Yang