English
Related papers

Related papers: Asymmetric Learning for Spectral Graph Neural Netw…

200 papers

Graph Neural Networks (GNNs) exploit signals from node features and the input graph topology to improve node classification task performance. However, these models tend to perform poorly on heterophilic graphs, where connected nodes have…

Machine Learning · Computer Science 2021-12-08 Vijay Lingam , Chanakya Ekbote , Manan Sharma , Rahul Ragesh , Arun Iyer , Sundararajan Sellamanickam

Optimization over trained machine learning models has applications including: verification, minimizing neural acquisition functions, and integrating a trained surrogate into a larger decision-making problem. This paper formulates and solves…

Optimization and Control · Mathematics 2023-10-13 Shiqiang Zhang , Juan S. Campos , Christian Feldmann , David Walz , Frederik Sandfort , Miriam Mathea , Calvin Tsay , Ruth Misener

To improve the performance of Graph Neural Networks (GNNs), Graph Structure Learning (GSL) has been extensively applied to reconstruct or refine original graph structures, effectively addressing issues like heterophily, over-squashing, and…

Machine Learning · Computer Science 2024-11-13 Yilun Zheng , Zhuofan Zhang , Ziming Wang , Xiang Li , Sitao Luan , Xiaojiang Peng , Lihui Chen

Recently, graph convolutional networks (GCNs) have shown great potential for the task of graph matching. It can integrate graph node feature embedding, node-wise affinity learning and matching optimization together in a unified end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Bo Jiang , Pengfei Sun , Jin Tang , Bin Luo

This paper aims at revisiting Graph Convolutional Neural Networks by bridging the gap between spectral and spatial design of graph convolutions. We theoretically demonstrate some equivalence of the graph convolution process regardless it is…

Machine Learning · Computer Science 2020-03-27 Muhammet Balcilar , Guillaume Renton , Pierre Heroux , Benoit Gauzere , Sebastien Adam , Paul Honeine

While Graph Neural Networks (GNNs) excel on graph-structured data, their performance is fundamentally limited by the quality of the observed graph, which often contains noise, missing links, or structural properties misaligned with GNNs'…

Machine Learning · Computer Science 2026-01-14 Hao Deng , Bo Liu

In representation learning on the graph-structured data, under heterophily (or low homophily), many popular GNNs may fail to capture long-range dependencies, which leads to their performance degradation. To solve the above-mentioned issue,…

Machine Learning · Computer Science 2021-06-29 Mengying Jiang , Guizhong Liu , Yuanchao Su , Xinliang Wu

In this study, we present the Graph Sub-Graph Network (GSN), a novel hybrid image classification model merging the strengths of Convolutional Neural Networks (CNNs) for feature extraction and Graph Neural Networks (GNNs) for structural…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Aryan Singh , Pepijn Van de Ven , Ciarán Eising , Patrick Denny

This paper presents HGEN that pioneers ensemble learning for heterogeneous graphs. We argue that the heterogeneity in node types, nodal features, and local neighborhood topology poses significant challenges for ensemble learning,…

Machine Learning · Computer Science 2026-02-05 Jiajun Shen , Yufei Jin , Yi He , Xingquan Zhu

Graph is a highly generic and diverse representation, suitable for almost any data processing problem. Spectral graph theory has been shown to provide powerful algorithms, backed by solid linear algebra theory. It thus can be extremely…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Or Streicher , Ido Cohen , Guy Gilboa

The recent surge in contrast-based graph self-supervised learning has prominently featured an intensified exploration of spectral cues. Spectral augmentation, which involves modifying a graph's spectral properties such as eigenvalues or…

Machine Learning · Computer Science 2024-12-05 Xiangru Jian , Xinjian Zhao , Wei Pang , Chaolong Ying , Yimu Wang , Yaoyao Xu , Tianshu Yu

Graph neural networks (GNNs) model nonlinear representations in graph data with applications in distributed agent coordination, control, and planning among others. Current GNN architectures assume ideal scenarios and ignore link…

Signal Processing · Electrical Eng. & Systems 2021-09-01 Zhan Gao , Elvin Isufi , Alejandro Ribeiro

Message passing on hypergraphs has been a standard framework for learning higher-order correlations between hypernodes. Recently-proposed hypergraph neural networks (HGNNs) can be categorized into spatial and spectral methods based on their…

Machine Learning · Computer Science 2024-05-28 Siddhant Saxena , Shounak Ghatak , Raghu Kolla , Debashis Mukherjee , Tanmoy Chakraborty

Graph heterophily, where connected nodes have different labels, has attracted significant interest recently. Most existing works adopt a simplified approach - using low-pass filters for homophilic graphs and high-pass filters for…

Machine Learning · Computer Science 2025-10-14 Shuaicheng Zhang , Haohui Wang , Junhong Lin , Xiaojie Guo , Yada Zhu , Si Zhang , Dongqi Fu , Dawei Zhou

The performance limit of Graph Convolutional Networks (GCNs) and the fact that we cannot stack more of them to increase the performance, which we usually do for other deep learning paradigms, are pervasively thought to be caused by the…

Machine Learning · Computer Science 2023-11-07 Sitao Luan , Mingde Zhao , Xiao-Wen Chang , Doina Precup

Graph Convolutional Neural Networks (GCNNs) extend classical CNNs to graph data domain, such as brain networks, social networks and 3D point clouds. It is critical to identify an appropriate graph for the subsequent graph convolution.…

Machine Learning · Computer Science 2019-09-12 Jiaxiang Tang , Wei Hu , Xiang Gao , Zongming Guo

Homophily principle, i.e., nodes with the same labels are more likely to be connected, has been believed to be the main reason for the performance superiority of Graph Neural Networks (GNNs) over Neural Networks on node classification…

Social and Information Networks · Computer Science 2024-01-03 Sitao Luan , Chenqing Hua , Minkai Xu , Qincheng Lu , Jiaqi Zhu , Xiao-Wen Chang , Jie Fu , Jure Leskovec , Doina Precup

Self-supervised heterogeneous graph learning (SHGL) has shown promising potential in diverse scenarios. However, while existing SHGL methods share a similar essential with clustering approaches, they encounter two significant limitations:…

Artificial Intelligence · Computer Science 2024-12-03 Yujie Mo , Zhihe Lu , Runpeng Yu , Xiaofeng Zhu , Xinchao Wang

Heterogeneous Graph Neural Networks (HGNNs) are a class of deep learning models designed specifically for heterogeneous graphs, which are graphs that contain different types of nodes and edges. This paper investigates the application of…

Machine Learning · Computer Science 2024-05-13 Zhen Hao Wong , Hansi Yang , Xiaoyi Fu , Quanming Yao

Graph Neural Networks (GNNs) have emerged as the de facto standard for modeling graph data, with attention mechanisms and transformers significantly enhancing their performance on graph-based tasks. Despite these advancements, the…

Machine Learning · Computer Science 2025-04-07 Nikhil Shivakumar Nayak