English
Related papers

Related papers: Asymmetric Learning for Spectral Graph Neural Netw…

200 papers

Graph neural networks (GNN) suffer from severe inefficiency. It is mainly caused by the exponential growth of node dependency with the increase of layers. It extremely limits the application of stochastic optimization algorithms so that the…

Machine Learning · Computer Science 2024-04-23 Hongyuan Zhang , Yanan Zhu , Xuelong Li

By recursively summing node features over entire neighborhoods, spatial graph convolution operators have been heralded as key to the success of Graph Neural Networks (GNNs). Yet, despite the multiplication of GNN methods across tasks and…

Machine Learning · Computer Science 2022-07-14 Sowon Jeong , Claire Donnat

Graph neural networks (GNNs) are powerful models that have been successful in various graph representation learning tasks. Whereas gradient boosted decision trees (GBDT) often outperform other machine learning methods when faced with…

Machine Learning · Computer Science 2021-04-01 Sergei Ivanov , Liudmila Prokhorenkova

Graph coloring, a classical and critical NP-hard problem, is the problem of assigning connected nodes as different colors as possible. However, we observe that state-of-the-art GNNs are less successful in the graph coloring problem. We…

Machine Learning · Computer Science 2022-08-22 Wei Li , Ruxuan Li , Yuzhe Ma , Siu On Chan , David Pan , Bei Yu

Heterogeneous graph neural networks (HGNNs) have been blossoming in recent years, but the unique data processing and evaluation setups used by each work obstruct a full understanding of their advancements. In this work, we present a…

Machine Learning · Computer Science 2022-01-03 Qingsong Lv , Ming Ding , Qiang Liu , Yuxiang Chen , Wenzheng Feng , Siming He , Chang Zhou , Jianguo Jiang , Yuxiao Dong , Jie Tang

Heterogeneous graph neural networks (HGNNs) were proposed for representation learning on structural data with multiple types of nodes and edges. To deal with the performance degradation issue when HGNNs become deep, researchers combine…

Machine Learning · Computer Science 2023-11-27 Xinyu Fu , Irwin King

Heterogeneous Graph Neural Networks (HGNNs) leverage diverse semantic relationships in Heterogeneous Graphs (HetGs) and have demonstrated remarkable learning performance in various applications. However, current distributed GNN training…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-21 Yuchen Zhong , Junwei Su , Chuan Wu , Minjie Wang

Graph neural networks have shown significant success in the field of graph representation learning. Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Nevertheless, one layer of…

Machine Learning · Computer Science 2020-07-21 Meng Liu , Hongyang Gao , Shuiwang Ji

Recent progress in Graph Neural Networks (GNNs) for modeling atomic simulations has the potential to revolutionize catalyst discovery, which is a key step in making progress towards the energy breakthroughs needed to combat climate change.…

Machine Learning · Computer Science 2022-04-12 Anuroop Sriram , Abhishek Das , Brandon M. Wood , Siddharth Goyal , C. Lawrence Zitnick

Machine learning frameworks such as graph neural networks typically rely on a given, fixed graph to exploit relational inductive biases and thus effectively learn from network data. However, when said graphs are (partially) unobserved,…

Machine Learning · Computer Science 2022-05-20 Max Wasserman , Saurabh Sihag , Gonzalo Mateos , Alejandro Ribeiro

Graph Convolutional Networks (GCNs) are powerful for processing graph-structured data and have achieved state-of-the-art performance in several tasks such as node classification, link prediction, and graph classification. However, it is…

Machine Learning · Computer Science 2021-10-19 Langzhang Liang , Cuiyun Gao , Shiyi Chen , Shishi Duan , Yu pan , Junjin Zheng , Lei Wang , Zenglin Xu

Spectral Graph Neural Networks (GNNs) have achieved tremendous success in graph machine learning, with polynomial filters applied for graph convolutions, where all nodes share the identical filter weights to mine their local contexts.…

Machine Learning · Computer Science 2024-05-24 Jingwei Guo , Kaizhu Huang , Xinping Yi , Rui Zhang

Graph neural networks (GNNs) are a popular class of parametric model for learning over graph-structured data. Recent work has argued that GNNs primarily use the graph for feature smoothing, and have shown competitive results on benchmark…

Machine Learning · Computer Science 2020-11-20 Lingfan Yu , Jiajun Shen , Jinyang Li , Adam Lerer

In this work, we propose to employ information-geometric tools to optimize a graph neural network architecture such as the graph convolutional networks. More specifically, we develop optimization algorithms for the graph-based…

Machine Learning · Computer Science 2020-08-25 Mohammad Rasool Izadi , Yihao Fang , Robert Stevenson , Lizhen Lin

Geometric deep learning is an emerging technique in Artificial Intelligence (AI) driven cheminformatics, however the unique implications of different Graph Neural Network (GNN) architectures are poorly explored, for this space. This study…

Real-world graph data environments intrinsically exist noise (e.g., link and structure errors) that inevitably disturb the effectiveness of graph representation and downstream learning tasks. For homogeneous graphs, the latest works use…

Machine Learning · Computer Science 2024-12-25 Xiong Zhang , Cheng Xie , Haoran Duan , Beibei Yu

We analyze the performance of graph neural network (GNN) architectures from the perspective of random graph theory. Our approach promises to complement existing lenses on GNN analysis, such as combinatorial expressive power and worst-case…

Machine Learning · Computer Science 2023-10-12 Drake Brown , Trevor Garrity , Kaden Parker , Jason Oliphant , Stone Carson , Cole Hanson , Zachary Boyd

Recently, techniques for applying convolutional neural networks to graph-structured data have emerged. Graph convolutional neural networks (GCNNs) have been used to address node and graph classification and matrix completion. Although the…

Machine Learning · Statistics 2018-11-28 Yingxue Zhang , Soumyasundar Pal , Mark Coates , Deniz Üstebay

In real-world applications, spectral Graph Neural Networks (GNNs) are powerful tools for processing diverse types of graphs. However, a single GNN often struggles to handle different graph types-such as homogeneous and heterogeneous…

Machine Learning · Computer Science 2024-12-19 Shibing Mo , Kai Wu , Qixuan Gao , Xiangyi Teng , Jing Liu

Can we combine heterogenous graph structure with text to learn high-quality semantic and behavioural representations? Graph neural networks (GNN)s encode numerical node attributes and graph structure to achieve impressive performance in a…

Machine Learning · Computer Science 2022-06-23 Vassilis N. Ioannidis , Xiang Song , Da Zheng , Houyu Zhang , Jun Ma , Yi Xu , Belinda Zeng , Trishul Chilimbi , George Karypis