English
Related papers

Related papers: Unlocking Multi-Modal Potentials for Link Predicti…

200 papers

Multimodal graphs, where nodes contain heterogeneous features such as images and text, are increasingly common in real-world applications. Effectively learning on such graphs requires both adaptive intra-modal message passing and efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xiaobin Hong , Mingkai Lin , Xiaoli Wang , Chaoqun Wang , Wenzhong Li

Predicting drug-target binding affinity (DTA) is essential for identifying potential therapeutic candidates in drug discovery. However, most existing models rely heavily on static protein structures, often overlooking the dynamic nature of…

Robotics · Computer Science 2025-05-20 Dan Luo , Jinyu Zhou , Le Xu , Sisi Yuan , Xuan Lin

In this study, we introduce a novel framework called Toast for learning general-purpose representations of road networks, along with its advanced counterpart DyToast, designed to enhance the integration of temporal dynamics to boost the…

Machine Learning · Computer Science 2024-03-19 Yile Chen , Xiucheng Li , Gao Cong , Zhifeng Bao , Cheng Long

Temporal graph learning aims to generate high-quality representations for graph-based tasks with dynamic information, which has recently garnered increasing attention. In contrast to static graphs, temporal graphs are typically organized as…

Machine Learning · Computer Science 2024-04-30 Meng Liu , Ke Liang , Yawei Zhao , Wenxuan Tu , Sihang Zhou , Xinbiao Gan , Xinwang Liu , Kunlun He

Heterogeneous Text-Attributed Graphs (HTAGs), where different types of entities are not only associated with texts but also connected by diverse relationships, have gained widespread popularity and application across various domains.…

Machine Learning · Computer Science 2024-12-13 Yunhui Liu , Qizhuo Xie , Jinwei Shi , Jiaxu Shen , Tieke He

Multimodal-attributed graphs (MAGs) are a fundamental data structure for multimodal graph learning (MGL), enabling both graph-centric and modality-centric tasks. However, our empirical analysis reveals inherent topology quality limitations…

Machine Learning · Computer Science 2026-03-31 Yinlin Zhu , Xunkai Li , Di Wu , Wang Luo , Miao Hu , Di Wu

Feature modeling of different modalities is a basic problem in current research of cross-modal information retrieval. Existing models typically project texts and images into one embedding space, in which semantically similar information…

Multimedia · Computer Science 2019-06-13 Jing Yu , Chenghao Yang , Zengchang Qin , Zhuoqian Yang , Yue Hu , Weifeng Zhang

Knowledge Tracing aims to assess student learning states by predicting their performance in answering questions. Different from the existing research which utilizes fixed-length learning sequence to obtain the student states and regards KT…

Machine Learning · Computer Science 2024-07-31 Ke Cheng , Linzhi Peng , Pengyang Wang , Junchen Ye , Leilei Sun , Bowen Du

The links in many real networks are evolving with time. The task of dynamic link prediction is to use past connection histories to infer links of the network at a future time. How to effectively learn the temporal and structural pattern of…

Social and Information Networks · Computer Science 2023-06-27 Chaokai Wu , Yansong Wang , Tao Jia

Multimodal data empowers machine learning models to better understand the world from various perspectives. In this work, we study the combination of \emph{text and graph} modalities, a challenging but understudied combination which is…

Social and Information Networks · Computer Science 2023-07-24 Yuexin Li , Bryan Hooi

Directed Acyclic Graphs (DAGs) are a standard tool in causal modeling, but their suitability for capturing the complexity of large-scale multimodal data is questionable. In practice, real-world multimodal datasets are often collected from…

Machine Learning · Computer Science 2026-03-03 Yuhang Liu , Zhen Zhang , Dong Gong , Erdun Gao , Biwei Huang , Mingming Gong , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

The graph with complex annotations is the most potent data type, whose constantly evolving motivates further exploration of the unsupervised dynamic graph representation. One of the representative paradigms is graph contrastive learning. It…

Machine Learning · Computer Science 2024-12-20 Yiming Xu , Bin Shi , Teng Ma , Bo Dong , Haoyi Zhou , Qinghua Zheng

Recently, methods that represent data as a graph, such as graph neural networks (GNNs) have been successfully used to learn data representations and structures to solve classification and link prediction problems. The applications of such…

Machine Learning · Computer Science 2022-10-04 Usman Mahmood , Zening Fu , Vince Calhoun , Sergey Plis

We present DYMAG, a graph neural network based on a novel form of message aggregation. Standard message-passing neural networks, which often aggregate local neighbors via mean-aggregation, can be regarded as convolving with a simple…

Multimodal emotion recognition in conversations aims to infer utterance-level emotions by jointly modeling textual, acoustic, and visual cues within context. Despite recent progress, key challenges remain, including redundant cross-modal…

Sound · Computer Science 2026-04-17 Chengling Guo , Yuntao Shou , Tao Meng , Wei Ai , Yun Tan , Keqin Li

In real-world scenarios, texts in a graph are often linked by multiple semantic relations (e.g., papers in an academic graph are referenced by other publications, written by the same author, or published in the same venue), where text…

Computation and Language · Computer Science 2024-07-16 Bowen Jin , Wentao Zhang , Yu Zhang , Yu Meng , Han Zhao , Jiawei Han

Temporal link prediction in dynamic graphs is a fundamental problem in many real-world systems. Existing temporal graph neural networks mainly focus on learning representations of historical interactions. Despite their strong performance,…

Machine Learning · Computer Science 2026-02-02 Nguyen Minh Duc , Viet Cuong Ta

Temporal graph neural networks have shown promising results in learning inductive representations by automatically extracting temporal patterns. However, previous works often rely on complex memory modules or inefficient random walk methods…

Machine Learning · Computer Science 2024-01-10 Mohammad Ali Alomrani , Mahdi Biparva , Yingxue Zhang , Mark Coates

Temporal Knowledge Graphs (TKGs), as an extension of static Knowledge Graphs (KGs), incorporate the temporal feature to express the transience of knowledge by describing when facts occur. TKG extrapolation aims to infer possible future…

Artificial Intelligence · Computer Science 2025-05-30 Hao Dong , Ziyue Qiao , Zhiyuan Ning , Qi Hao , Yi Du , Pengyang Wang , Yuanchun Zhou

Dynamic link prediction is important for modeling evolving interactions in complex systems, including social, communication, financial, and transportation networks. Classical temporal graph models capture sequential dependencies, but they…