English
Related papers

Related papers: Multimodal Graph Representation Learning with Dyna…

200 papers

Dynamic graph clustering aims to detect and track time-varying clusters in dynamic graphs, revealing how complex real-world systems evolve over time. However, existing methods are predominantly black-box models. They lack interpretability…

Machine Learning · Computer Science 2026-03-17 Dongyuan Li , Ying Zhang , Yaozu Wu , Renhe Jiang

In this work, we introduce a new algorithm for analyzing a diagram, which contains visual and textual information in an abstract and integrated way. Whereas diagrams contain richer information compared with individual image-based or…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Daesik Kim , Youngjoon Yoo , Jeesoo Kim , Sangkuk Lee , Nojun Kwak

Multimodal representation learning aims to construct a shared embedding space in which heterogeneous modalities are semantically aligned. Despite strong empirical results, InfoNCE-based objectives introduce inherent conflicts that yield…

Machine Learning · Computer Science 2026-02-11 Wenzhe Yin , Pan Zhou , Zehao Xiao , Jie Liu , Shujian Yu , Jan-Jakob Sonke , Efstratios Gavves

Machine learning on graphs is an important and ubiquitous task with applications ranging from drug design to friendship recommendation in social networks. The primary challenge in this domain is finding a way to represent, or encode, graph…

Social and Information Networks · Computer Science 2018-04-11 William L. Hamilton , Rex Ying , Jure Leskovec

Graph neural networks (GNN) have been proven to be mature enough for handling graph-structured data on node-level graph representation learning tasks. However, the graph pooling technique for learning expressive graph-level representation…

Machine Learning · Computer Science 2021-04-14 Ning Liu , Songlei Jian , Dongsheng Li , Yiming Zhang , Zhiquan Lai , Hongzuo Xu

Link prediction is an important learning task for graph-structured data. In this paper, we propose a novel topological approach to characterize interactions between two nodes. Our topological feature, based on the extended persistent…

Machine Learning · Computer Science 2021-06-15 Zuoyu Yan , Tengfei Ma , Liangcai Gao , Zhi Tang , Chao Chen

Graph representation learning seeks to transform complex, high-dimensional graph structures into compact vector spaces that preserve both topology and semantics. Among the various strategies, subgraph-based methods provide an interpretable…

Machine Learning · Computer Science 2025-12-05 Yeamin Kaiser , Muhammed Tasnim Bin Anwar , Bholanath Das

Understanding the dynamic reorganization of brain networks is critical for predicting cognitive decline, neurological progression, and individual variability in clinical outcomes. This work proposes a multimodal graph neural network…

Machine Learning · Computer Science 2026-02-11 Preksha Girish , Rachana Mysore , Kiran K. N. , Hiranmayee R. , Shipra Prashanth , Shrey Kumar

Multimodal graphs are gaining increasing attention due to their rich representational power and wide applicability, yet they introduce substantial challenges arising from severe modality confusion. To address this issue, we propose NSG…

Machine Learning · Computer Science 2026-02-03 Yihan Zhang , Ercan E. Kuruoglu

As the use and diversity of diagrams across many disciplines grows, there is an increasing interest in the diagrams research community concerning how such diversity might be documented and explained. In this article, we argue that one way…

Computation and Language · Computer Science 2022-06-14 Tuomo Hiippala , John A. Bateman

Modern data analysis pipelines are becoming increasingly complex due to the presence of multi-view information sources. While graphs are effective in modeling complex relationships, in many scenarios a single graph is rarely sufficient to…

Machine Learning · Statistics 2019-04-02 Uday Shankar Shanthamallu , Jayaraman J. Thiagarajan , Huan Song , Andreas Spanias

Recent years have witnessed a surge of interest in machine learning on graphs and networks with applications ranging from vehicular network design to IoT traffic management to social network recommendations. Supervised machine learning…

Social and Information Networks · Computer Science 2019-08-23 Manoj Reddy Dareddy , Mahashweta Das , Hao Yang

Biomedical networks (or graphs) are universal descriptors for systems of interacting elements, from molecular interactions and disease co-morbidity to healthcare systems and scientific knowledge. Advances in artificial intelligence,…

Machine Learning · Computer Science 2025-02-07 Michelle M. Li , Kexin Huang , Marinka Zitnik

Graphs are essential representations of many real-world data such as social networks. Recent years have witnessed the increasing efforts made to extend the neural network models to graph-structured data. These methods, which are usually…

Machine Learning · Computer Science 2018-11-07 Yao Ma , Ziyi Guo , Zhaochun Ren , Eric Zhao , Jiliang Tang , Dawei Yin

There are many real-world knowledge based networked systems with multi-type interacting entities that can be regarded as heterogeneous networks including human connections and biological evolutions. One of the main issues in such networks…

Social and Information Networks · Computer Science 2019-11-05 Soheila Molaei , Hadi Zare , Hadi Veisi

Existing deep learning models may encounter great challenges in handling graph structured data. In this paper, we introduce a new deep learning model for graph data specifically, namely the deep loopy neural network. Significantly different…

Machine Learning · Computer Science 2019-09-06 Jiawei Zhang

Knowledge Graphs, such as Wikidata, comprise structural and textual knowledge in order to represent knowledge. For each of the two modalities dedicated approaches for graph embedding and language models learn patterns that allow for…

Computation and Language · Computer Science 2023-08-21 Mojtaba Nayyeri , Zihao Wang , Mst. Mahfuja Akter , Mirza Mohtashim Alam , Md Rashad Al Hasan Rony , Jens Lehmann , Steffen Staab

In recent years, there has been a resurgence in methods that use distributed (neural) representations to represent and reason about semantic knowledge for robotics applications. However, while robots often observe previously unknown…

Robotics · Computer Science 2021-05-11 Angel Daruna , Mehul Gupta , Mohan Sridharan , Sonia Chernova

Representation learning on graphs is a fundamental problem that can be crucial in various tasks. Graph neural networks, the dominant approach for graph representation learning, are limited in their representation power. Therefore, it can be…

Machine Learning · Computer Science 2025-01-17 Zuoyu Yan , Qi Zhao , Ze Ye , Tengfei Ma , Liangcai Gao , Zhi Tang , Yusu Wang , Chao Chen

Multimodal data empowers machine learning models to better understand the world from various perspectives. In this work, we study the combination of \emph{text and graph} modalities, a challenging but understudied combination which is…

Social and Information Networks · Computer Science 2023-07-24 Yuexin Li , Bryan Hooi