English
Related papers

Related papers: Learning Laplacian Positional Encodings for Hetero…

200 papers

We introduce an unsupervised graph embedding that trades off local node similarity and connectivity, and global structure. The embedding is based on a generalized graph Laplacian, whose eigenvectors compactly capture both network structure…

Machine Learning · Computer Science 2020-10-01 Shay Deutsch , Stefano Soatto

In this paper, we consider the weighted graph matching problem with partially disclosed correspondences between a number of anchor nodes. Our construction exploits recently introduced node signatures based on graph Laplacians, namely the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Nan Hu , Raif M. Rustamov , Leonidas Guibas

Manifold Learning occupies a vital role in the field of nonlinear dimensionality reduction and its ideas also serve for other relevant methods. Graph-based methods such as Graph Convolutional Networks (GCN) show ideas in common with…

Machine Learning · Computer Science 2020-06-30 Shenglan Liu , Yang Yu

Graph contrastive learning (CL) methods learn node representations in a self-supervised manner by maximizing the similarity between the augmented node representations obtained via a GNN-based encoder. However, CL methods perform poorly on…

Machine Learning · Computer Science 2024-06-12 Wenhan Yang , Baharan Mirzasoleiman

Graph neural networks have been used for a variety of learning tasks, such as link prediction, node classification, and node clustering. Among them, link prediction is a relatively under-studied graph learning task, with current…

Machine Learning · Computer Science 2022-08-29 Xinxing Wu , Qiang Cheng

Graph autoencoders (GAEs) are powerful tools in representation learning for graph embedding. However, the performance of GAEs is very dependent on the quality of the graph structure, i.e., of the adjacency matrix. In other words, GAEs would…

Machine Learning · Computer Science 2021-03-24 Rui Zhang , Yunxing Zhang , Xuelong Li

Graph Neural Networks (GNNs) exhibit excellent performance when graphs have strong homophily property, i.e. connected nodes have the same labels. However, they perform poorly on heterophilic graphs. Several approaches address the issue of…

Machine Learning · Computer Science 2021-07-29 Vijay Lingam , Rahul Ragesh , Arun Iyer , Sundararajan Sellamanickam

Graph neural networks (GNNs) are fundamental tools in graph machine learning. The performance of GNNs relies crucially on the availability of informative node features, which can be limited or absent in real-life datasets and applications.…

Machine Learning · Computer Science 2025-12-08 Ziyao Cui , Edric Tam

We study graph-based Laplacian semi-supervised learning at low labeling rates. Laplacian learning uses harmonic extension on a graph to propagate labels. At very low label rates, Laplacian learning becomes degenerate and the solution is…

Statistics Theory · Mathematics 2020-06-05 Jeff Calder , Dejan Slepčev , Matthew Thorpe

Relative positional encoding is widely used in vanilla and linear transformers to represent positional information. However, existing encoding methods of a vanilla transformer are not always directly applicable to a linear transformer,…

Computation and Language · Computer Science 2023-07-19 Zhen Qin , Weixuan Sun , Kaiyue Lu , Hui Deng , Dongxu Li , Xiaodong Han , Yuchao Dai , Lingpeng Kong , Yiran Zhong

Recently, graph neural networks have been widely used for network embedding because of their prominent performance in pairwise relationship learning. In the real world, a more natural and common situation is the coexistence of pairwise…

Social and Information Networks · Computer Science 2021-01-19 Xiangguo Sun , Hongzhi Yin , Bo Liu , Hongxu Chen , Jiuxin Cao , Yingxia Shao , Nguyen Quoc Viet Hung

Link Prediction (LP) is a crucial problem in graph-structured data. Graph Neural Networks (GNNs) have gained prominence in LP, with Graph AutoEncoders (GAEs) being a notable representation. However, our empirical findings reveal that GAEs'…

Machine Learning · Computer Science 2025-02-11 Yunhui Liu , Huaisong Zhang , Xinyi Gao , Liuye Guo , Zhen Tao , Tieke He

Generative self-supervised learning (SSL), especially masked autoencoders, has become one of the most exciting learning paradigms and has shown great potential in handling graph data. However, real-world graphs are always heterogeneous,…

Machine Learning · Computer Science 2023-02-13 Yijun Tian , Kaiwen Dong , Chunhui Zhang , Chuxu Zhang , Nitesh V. Chawla

Recent work in graph neural networks (GNNs) has led to improvements in molecular activity and property prediction tasks. Unfortunately, GNNs often fail to capture the relative importance of interactions between molecular substructures, in…

Machine Learning · Computer Science 2020-04-03 Emmanuel Noutahi , Dominique Beaini , Julien Horwood , Sébastien Giguère , Prudencio Tossou

Graph Neural Networks (GNNs) are well-suited for learning on homophilous graphs, i.e., graphs in which edges tend to connect nodes of the same type. Yet, achievement of consistent GNN performance on heterophilous graphs remains an open…

Machine Learning · Computer Science 2023-08-30 Andrea Cavallo , Claas Grohnfeldt , Michele Russo , Giulio Lovisotto , Luca Vassio

Recently, graph convolutional network (GCN) has been widely used for semi-supervised classification and deep feature representation on graph-structured data. However, existing GCN generally fails to consider the local invariance constraint…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Bo Jiang , Doudou Lin

Graph clustering is a fundamental task in graph analysis, and recent advances in utilizing graph neural networks (GNNs) have shown impressive results. Despite the success of existing GNN-based graph clustering methods, they often overlook…

Machine Learning · Computer Science 2023-10-31 Ming Gu , Gaoming Yang , Sheng Zhou , Ning Ma , Jiawei Chen , Qiaoyu Tan , Meihan Liu , Jiajun Bu

Graph neural networks (GNNs) have shown advantages in graph-based analysis tasks. However, most existing methods have the homogeneity assumption and show poor performance on heterophilic graphs, where the linked nodes have dissimilar…

Machine Learning · Computer Science 2024-04-16 Tianhao Peng , Wenjun Wu , Haitao Yuan , Zhifeng Bao , Zhao Pengrui , Xin Yu , Xuetao Lin , Yu Liang , Yanjun Pu

Fully connected Graph Transformers (GT) have rapidly become prominent in the static graph community as an alternative to Message-Passing models, which suffer from a lack of expressivity, oversquashing, and under-reaching. However, in a…

Machine Learning · Computer Science 2024-11-18 Yannis Karmim , Marc Lafon , Raphael Fournier S'niehotta , Nicolas Thome

Signed graphs are equipped with both positive and negative edge weights, encoding pairwise correlations as well as anti-correlations in data. A balanced signed graph has no cycles of odd number of negative edges. Laplacian of a balanced…

Machine Learning · Computer Science 2024-09-13 Haruki Yokota , Hiroshi Higashi , Yuichi Tanaka , Gene Cheung