English
Related papers

Related papers: Self-Supervised Graph Transformer on Large-Scale M…

200 papers

Graph Neural Networks (GNNs) are powerful and flexible neural networks that use the naturally sparse connectivity information of the data. GNNs represent this connectivity as sparse matrices, which have lower arithmetic intensity and thus…

Machine Learning · Computer Science 2020-09-04 Alok Tripathy , Katherine Yelick , Aydin Buluc

Unsupervised/self-supervised graph neural networks (GNN) are vulnerable to inherent randomness in the input graph data which greatly affects the performance of the model in downstream tasks. In this paper, we alleviate the interference of…

Machine Learning · Computer Science 2023-08-14 Yifei Wang , Yupan Wang , Zeyu Zhang , Song Yang , Kaiqi Zhao , Jiamou Liu

We present graph partition neural networks (GPNN), an extension of graph neural networks (GNNs) able to handle extremely large graphs. GPNNs alternate between locally propagating information between nodes in small subgraphs and globally…

Machine Learning · Computer Science 2018-03-19 Renjie Liao , Marc Brockschmidt , Daniel Tarlow , Alexander L. Gaunt , Raquel Urtasun , Richard Zemel

Graph Neural Networks (GNNs) have become the state-of-the-art method for many applications on graph structured data. GNNs are a model for graph representation learning, which aims at learning to generate low dimensional node embeddings that…

Machine Learning · Computer Science 2022-05-23 Davide Buffelli , Fabio Vandin

Deep learning methods for graphs achieve remarkable performance on many node-level and graph-level prediction tasks. However, despite the proliferation of the methods and their success, prevailing Graph Neural Networks (GNNs) neglect…

Machine Learning · Computer Science 2020-11-10 Emily Alsentzer , Samuel G. Finlayson , Michelle M. Li , Marinka Zitnik

Graphs representation learning has been a very active research area in recent years. The goal of graph representation learning is to generate graph representation vectors that capture the structure and features of large graphs accurately.…

Machine Learning · Computer Science 2022-06-16 Shima Khoshraftar , Aijun An

Hypergraph, an expressive structure with flexibility to model the higher-order correlations among entities, has recently attracted increasing attention from various research domains. Despite the success of Graph Neural Networks (GNNs) for…

Machine Learning · Computer Science 2021-05-04 Jing Huang , Jie Yang

Pre-training Graph Neural Networks (GNN) via self-supervised contrastive learning has recently drawn lots of attention. However, most existing works focus on node-level contrastive learning, which cannot capture global graph structure. The…

Machine Learning · Computer Science 2021-04-19 Shichang Zhang , Ziniu Hu , Arjun Subramonian , Yizhou Sun

Graph pre-training strategies have been attracting a surge of attention in the graph mining community, due to their flexibility in parameterizing graph neural networks (GNNs) without any label information. The key idea lies in encoding…

Machine Learning · Computer Science 2022-08-23 Dawei Zhou , Lecheng Zheng , Dongqi Fu , Jiawei Han , Jingrui He

Graph foundation models represent a transformative paradigm for learning transferable representations across diverse graph domains. Recent methods leverage large language models to unify graph and text modalities into a shared…

Machine Learning · Computer Science 2025-12-23 Heng Zhang , Tianyi Zhang , Yuling Shi , Xiaodong Gu , Yaomin Shen , Haochen You , Zijian Zhang , Yilei Yuan , Jin Huang

Unraveling the complexities of Gene Regulatory Networks (GRNs) is crucial for understanding cellular processes and disease mechanisms. Traditional computational methods often struggle with the dynamic nature of these networks. This study…

Machine Learning · Computer Science 2025-03-04 Hakan T. Otal , Abdulhamit Subasi , Furkan Kurt , M. Abdullah Canbaz , Yasin Uzun

Learning expressive representation is crucial in deep learning. In speech emotion recognition (SER), vacuum regions or noises in the speech interfere with expressive representation learning. However, traditional RNN-based models are…

Sound · Computer Science 2022-08-23 Junghun Kim , Jihie Kim

The optimization of multi-user multi-input multi-output (MU-MIMO) precoders is a widely recognized challenging problem. Existing work has demonstrated the potential of graph neural networks (GNNs) in learning precoding policies. However,…

Signal Processing · Electrical Eng. & Systems 2025-03-11 Lin Zhang , Shengqian Han , Chenyang Yang

Graph Neural Networks (GNNs) are widely used for graph representation learning. Despite its prevalence, GNN suffers from two drawbacks in the graph classification task, the neglect of graph-level relationships, and the generalization issue.…

Machine Learning · Computer Science 2024-06-07 Jiaxing Xu , Jinjie Ni , Yiping Ke

In recent years, Graph Neural Network (GNN) based models have shown promising results in simulating physics of complex systems. However, training dedicated graph network based physics simulators can be costly, as most models are confined to…

Machine Learning · Computer Science 2025-02-12 Siqi Shen , Yu Liu , Daniel Biggs , Omar Hafez , Jiandong Yu , Wentao Zhang , Bin Cui , Jiulong Shan

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

Information Retrieval · Computer Science 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh

Graph convolutional neural networks~(GCNs) have recently demonstrated promising results on graph-based semi-supervised classification, but little work has been done to explore their theoretical properties. Recently, several deep neural…

Machine Learning · Computer Science 2020-02-28 Jilin Hu , Jianbing Shen , Bin Yang , Ling Shao

Transformers serve as the backbone architectures of Foundational Models, where domain-specific tokenizers allow them to adapt to various domains. Graph Transformers (GTs) have recently emerged as leading models in geometric deep learning,…

Neural and Evolutionary Computing · Computer Science 2025-04-03 Limei Wang , Kaveh Hassani , Si Zhang , Dongqi Fu , Baichuan Yuan , Weilin Cong , Zhigang Hua , Hao Wu , Ning Yao , Bo Long

Graph neural networks (GNNs) have been demonstrated to be powerful in modeling graph-structured data. However, training GNNs usually requires abundant task-specific labeled data, which is often arduously expensive to obtain. One effective…

Machine Learning · Computer Science 2020-06-30 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Kai-Wei Chang , Yizhou Sun

There has been a surge of recent interest in learning representations for graph-structured data. Graph representation learning methods have generally fallen into three main categories, based on the availability of labeled data. The first,…

Machine Learning · Computer Science 2022-04-13 Ines Chami , Sami Abu-El-Haija , Bryan Perozzi , Christopher Ré , Kevin Murphy