English
Related papers

Related papers: Learning on Multimodal Graphs: A Survey

200 papers

Graph learning is a prevalent field that operates on ubiquitous graph data. Effective graph learning methods can extract valuable information from graphs. However, these methods are non-robust and affected by missing attributes in graphs,…

Machine Learning · Computer Science 2025-02-19 Riting Xia , Huibo Liu , Anchen Li , Xueyan Liu , Yan Zhang , Chunxu Zhang , Bo Yang

Graphs are structured data that models complex relations between real-world entities. Heterophilic graphs, where linked nodes are prone to be with different labels or dissimilar features, have recently attracted significant attention and…

Social and Information Networks · Computer Science 2025-03-21 Chenghua Gong , Yao Cheng , Jianxiang Yu , Can Xu , Caihua Shan , Siqiang Luo , Xiang Li

With the advances of data-driven machine learning research, a wide variety of prediction problems have been tackled. It has become critical to explore how machine learning and specifically deep learning methods can be exploited to analyse…

Machine Learning · Computer Science 2021-11-09 David Ahmedt-Aristizabal , Mohammad Ali Armin , Simon Denman , Clinton Fookes , Lars Petersson

Large language models~(LLM) like ChatGPT have become indispensable to artificial general intelligence~(AGI), demonstrating excellent performance in various natural language processing tasks. In the real world, graph data is ubiquitous and…

Artificial Intelligence · Computer Science 2023-07-12 Jiayan Guo , Lun Du , Hengyu Liu , Mengyu Zhou , Xinyi He , Shi Han

Graph Machine Learning (Graph ML) has witnessed substantial advancements in recent years. With their remarkable ability to process graph-structured data, Graph ML techniques have been extensively utilized across diverse applications,…

Machine Learning · Computer Science 2024-05-21 Song Wang , Yushun Dong , Binchi Zhang , Zihan Chen , Xingbo Fu , Yinhan He , Cong Shen , Chuxu Zhang , Nitesh V. Chawla , Jundong Li

With the recent advancement in large language models (LLMs), there is a growing interest in combining LLMs with multimodal learning. Previous surveys of multimodal large language models (MLLMs) mainly focus on multimodal understanding. This…

We present MMKG, a collection of three knowledge graphs that contain both numerical features and (links to) images for all entities as well as entity alignments between pairs of KGs. Therefore, multi-relational link prediction and entity…

Artificial Intelligence · Computer Science 2019-03-14 Ye Liu , Hui Li , Alberto Garcia-Duran , Mathias Niepert , Daniel Onoro-Rubio , David S. Rosenblum

In the last decade or so, we have witnessed deep learning reinvigorating the machine learning field. It has solved many problems in the domains of computer vision, speech recognition, natural language processing, and various other tasks…

Machine Learning · Computer Science 2021-09-09 Lilapati Waikhom , Ripon Patgiri

With the increasing prevalence of cross-domain Text-Attributed Graph (TAG) Data (e.g., citation networks, recommendation systems, social networks, and ai4science), the integration of Graph Neural Networks (GNNs) and Large Language Models…

Machine Learning · Computer Science 2024-12-18 Xunkai Li , Zhengyu Wu , Jiayi Wu , Hanwen Cui , Jishuo Jia , Rong-Hua Li , Guoren Wang

Graph Augmentation Learning (GAL) provides outstanding solutions for graph learning in handling incomplete data, noise data, etc. Numerous GAL methods have been proposed for graph-based applications such as social network analysis and…

Machine Learning · Computer Science 2022-03-18 Shuo Yu , Huafei Huang , Minh N. Dao , Feng Xia

Graph data in real-world scenarios undergo rapid and frequent changes, making it challenging for existing graph models to effectively handle the continuous influx of new data and accommodate data withdrawal requests. The approach to…

Machine Learning · Computer Science 2025-08-26 Jiaxing Miao , Liang Hu , Qi Zhang , Longbing Cao

This paper presents a general graph representation learning framework called DeepGL for learning deep node and edge representations from large (attributed) graphs. In particular, DeepGL begins by deriving a set of base features (e.g.,…

Machine Learning · Statistics 2017-10-17 Ryan A. Rossi , Rong Zhou , Nesreen K. Ahmed

In the contemporary age characterized by information abundance, rapid advancements in artificial intelligence have rendered recommendation systems indispensable. Conventional recommendation methodologies based on collaborative filtering or…

Information Retrieval · Computer Science 2025-09-04 Yu Fang

In recent years, artificial intelligence has played an important role on accelerating the whole process of drug discovery. Various of molecular representation schemes of different modals (e.g. textual sequence or graph) are developed. By…

Machine Learning · Computer Science 2022-11-28 Tianyu Wu , Yang Tang , Qiyu Sun , Luolin Xiong

Multimodal learning, which integrates data from diverse sensory modes, plays a pivotal role in artificial intelligence. However, existing multimodal learning methods often struggle with challenges where some modalities appear more dominant…

Machine Learning · Computer Science 2024-04-02 Xiaohui Zhang , Jaehong Yoon , Mohit Bansal , Huaxiu Yao

Graphs are ubiquitous in encoding relational information of real-world objects in many domains. Graph generation, whose purpose is to generate new graphs from a distribution similar to the observed graphs, has received increasing attention…

Machine Learning · Computer Science 2022-12-08 Yanqiao Zhu , Yuanqi Du , Yinkai Wang , Yichen Xu , Jieyu Zhang , Qiang Liu , Shu Wu

Meta-learning has gained wide popularity as a training framework that is more data-efficient than traditional machine learning methods. However, its generalization ability in complex task distributions, such as multimodal tasks, has not…

Machine Learning · Computer Science 2022-05-10 Yao Ma , Shilin Zhao , Weixiao Wang , Yaoman Li , Irwin King

Multimodal graphs, where nodes contain heterogeneous features such as images and text, are increasingly common in real-world applications. Effectively learning on such graphs requires both adaptive intra-modal message passing and efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xiaobin Hong , Mingkai Lin , Xiaoli Wang , Chaoqun Wang , Wenzhong Li

Designing versatile graph learning approaches is important, considering the diverse graphs and tasks existing in real-world applications. Existing methods have attempted to achieve this target through automated machine learning techniques,…

Machine Learning · Computer Science 2024-09-04 Lanning Wei , Huan Zhao , Xiaohan Zheng , Zhiqiang He , Quanming Yao

Federated graph learning (FGL) enables collaborative training on graph data across multiple clients. As graph data increasingly contain multimodal node attributes such as text and images, multimodal federated graph learning (MM-FGL) has…

Machine Learning · Computer Science 2026-05-13 Zekai Chen , Xun Wu , Xunkai Li , Yihan Sun , Rong-Hua Li , Guoren Wang