English
Related papers

Related papers: Reducing Oversmoothing through Informed Weight Ini…

200 papers

Graph neural networks (GNNs) have become a workhorse approach for learning from data defined over irregular domains, typically by implicitly assuming that the data structure is represented by a homophilic graph. However, recent works have…

Machine Learning · Computer Science 2024-09-16 Samuel Rey , Madeline Navarro , Victor M. Tenorio , Santiago Segarra , Antonio G. Marques

Graph Neural Networks (GNNs) are powerful deep learning models to generate node embeddings on graphs. When applying deep GNNs on large graphs, it is still challenging to perform training in an efficient and scalable way. We propose a novel…

Machine Learning · Computer Science 2020-10-08 Hanqing Zeng , Hongkuan Zhou , Ajitesh Srivastava , Rajgopal Kannan , Viktor Prasanna

Cross-graph node classification, utilizing the abundant labeled nodes from one graph to help classify unlabeled nodes in another graph, can be viewed as a domain generalization problem of graph neural networks (GNNs) due to the structure…

Machine Learning · Computer Science 2025-02-26 Guanzi Chen , Jiying Zhang , Yang Li

Training deep neural networks (DNNs) in the presence of noisy labels is an important and challenging task. Probabilistic modeling, which consists of a classifier and a transition matrix, depicts the transformation from true labels to noisy…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Xianbin Lv , Dongxian Wu , Shu-Tao Xia

In recent years, Graph Convolutional Networks (GCNs) have gained popularity for their exceptional ability to process graph-structured data. Existing GCN-based approaches typically employ a shallow model architecture due to the…

Machine Learning · Computer Science 2025-04-22 Jielong Lu , Zhihao Wu , Zhiling Cai , Yueyang Pi , Shiping Wang

Graph convolutional networks (GCNs) have been proved to be very practical to handle various graph-related tasks. It has attracted considerable research interest to study deep GCNs, due to their potential superior performance compared with…

Machine Learning · Computer Science 2023-02-13 Lei Zhang , Xiaodong Yan , Jianshan He , Ruopeng Li , Wei Chu

Scalability of Graph Neural Networks (GNNs) remains a significant challenge. To tackle this, methods like coarsening, condensation, and computation trees are used to train on a smaller graph, resulting in faster computation. Nonetheless,…

Machine Learning · Computer Science 2026-04-13 Shubhajit Roy , Hrriday Ruparel , Kishan Ved , Anirban Dasgupta

Overparameterized Neural Networks (NN) display state-of-the-art performance. However, there is a growing need for smaller, energy-efficient, neural networks tobe able to use machine learning applications on devices with limited…

Machine Learning · Statistics 2021-05-21 Soufiane Hayou , Jean-Francois Ton , Arnaud Doucet , Yee Whye Teh

Graph Neural Networks (GNNs) are a framework for graph representation learning, where a model learns to generate low dimensional node embeddings that encapsulate structural and feature-related information. GNNs are usually trained in an…

Machine Learning · Computer Science 2020-12-15 Davide Buffelli , Fabio Vandin

Graph Neural Networks (GNNs) have achieved remarkable performance in a wide range of graph-related learning tasks. However, explaining their predictions remains a challenging problem, especially due to the mismatch between the graphs used…

Machine Learning · Computer Science 2025-08-05 Zhuomin Chen , Jingchao Ni , Hojat Allah Salehi , Xu Zheng , Dongsheng Luo

Graph Neural Networks (GNNs) with numerical node features and graph structure as inputs have demonstrated superior performance on various supervised learning tasks with graph data. However the numerical node features utilized by GNNs are…

Machine Learning · Computer Science 2022-06-20 Jiuhai Chen , Jonas Mueller , Vassilis N. Ioannidis , Tom Goldstein , David Wipf

Neural networks require careful weight initialization to prevent signals from exploding or vanishing. Existing initialization schemes solve this problem in specific cases by assuming that the network has a certain activation function or…

Machine Learning · Computer Science 2022-12-01 Garrett Bingham , Risto Miikkulainen

Subgraph isomorphism counting is an important problem on graphs, as many graph-based tasks exploit recurring subgraph patterns. Classical methods usually boil down to a backtracking framework that needs to navigate a huge search space with…

Machine Learning · Computer Science 2024-01-25 Xingtong Yu , Zemin Liu , Yuan Fang , Xinming Zhang

In recent years, graph neural networks (GNNs) have achieved state-of-the-art performance for node classification. However, most existing GNNs would suffer from the graph imbalance problem. In many real-world scenarios, node classes are…

Machine Learning · Computer Science 2022-06-14 Tianxiang Zhao , Xiang Zhang , Suhang Wang

Graph Neural Networks (GNNs) are prominent in handling sparse and unstructured data efficiently and effectively. Specifically, GNNs were shown to be highly effective for node classification tasks, where labelled information is available for…

Machine Learning · Computer Science 2022-12-01 Moshe Eliasof , Eldad Haber , Eran Treister

Information over-squashing is a phenomenon of inefficient information propagation between distant nodes on networks. It is an important problem that is known to significantly impact the training of graph neural networks (GNNs), as the…

Machine Learning · Statistics 2022-07-19 Jakub Bober , Anthea Monod , Emil Saucan , Kevin N. Webster

Graph Neural Networks (GNNs) require a large number of labeled graph samples to obtain good performance on the graph classification task. The performance of GNNs degrades significantly as the number of labeled graph samples decreases. To…

Machine Learning · Computer Science 2023-09-20 Abdullah Alchihabi , Yuhong Guo

Graph Neural Networks (GNNs) have become the state-of-the-art method for many applications on graph structured data. GNNs are a model for graph representation learning, which aims at learning to generate low dimensional node embeddings that…

Machine Learning · Computer Science 2022-05-23 Davide Buffelli , Fabio Vandin

Graph Neural Networks (GNNs) have demonstrated remarkable success in learning from graph-structured data. However, the influence of the input graph's topology on GNN behavior remains poorly understood. In this work, we explore whether GNNs…

Machine Learning · Statistics 2025-02-26 Amine Mohamed Aboussalah , Abdessalam Ed-dib

With the proliferation of Graph Neural Network (GNN) methods stemming from contrastive learning, unsupervised node representation learning for graph data is rapidly gaining traction across various fields, from biology to molecular dynamics,…

Machine Learning · Computer Science 2024-08-01 Jihee You , So Won Jeong , Claire Donnat