English
Related papers

Related papers: Generalised f-Mean Aggregation for Graph Neural Ne…

200 papers

Neural Architecture Search (NAS) methods have shown to output networks that largely outperform human-designed networks. However, conventional NAS methods have mostly tackled the single dataset scenario, incuring in a large computational…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Sofia Casarin , Oswald Lanz , Sergio Escalera

Graph Convolutional Networks (GCNs) have shown very powerful for graph data representation and learning tasks. Existing GCNs usually conduct feature aggregation on a fixed neighborhood graph in which each node computes its representation by…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Bo Jiang , Beibei Wang , Jin Tang , Bin Luo

Generalization of neural networks is crucial for deploying them safely in the real world. Common training strategies to improve generalization involve the use of data augmentations, ensembling and model averaging. In this work, we first…

Machine Learning · Computer Science 2023-06-13 Samyak Jain , Sravanti Addepalli , Pawan Sahu , Priyam Dey , R. Venkatesh Babu

Graph Neural Networks (GNNs) have shown great promise in tasks like node and graph classification, but they often struggle to generalize, particularly to unseen or out-of-distribution (OOD) data. These challenges are exacerbated when…

Graph neural networks, which generalize deep neural network models to graph structured data, have attracted increasing attention in recent years. They usually learn node representations by transforming, propagating and aggregating node…

Machine Learning · Computer Science 2019-05-21 Yao Ma , Suhang Wang , Charu C. Aggarwal , Jiliang Tang

Graph Neural Networks (GNNs) are proposed without considering the agnostic distribution shifts between training and testing graphs, inducing the degeneration of the generalization ability of GNNs on Out-Of-Distribution (OOD) settings. The…

Machine Learning · Computer Science 2024-03-12 Shaohua Fan , Xiao Wang , Chuan Shi , Peng Cui , Bai Wang

Graph neural networks (GNNs) have proven their efficacy in a variety of real-world applications, but their underlying mechanisms remain a mystery. To address this challenge and enable reliable decision-making, many GNN explainers have been…

Machine Learning · Computer Science 2023-10-12 Yiqiao Li , Jianlong Zhou , Yifei Dong , Niusha Shafiabady , Fang Chen

Graph neural networks (GNNs), as the de-facto model class for representation learning on graphs, are built upon the multi-layer perceptrons (MLP) architecture with additional message passing layers to allow features to flow across nodes.…

Machine Learning · Computer Science 2023-08-07 Chenxiao Yang , Qitian Wu , Jiahua Wang , Junchi Yan

While Graph Neural Network (GNN) has shown superiority in learning node representations of homogeneous graphs, leveraging GNN on heterogeneous graphs remains a challenging problem. The dominating reason is that GNN learns node…

Social and Information Networks · Computer Science 2020-09-22 Ziyue Qiao , Pengyang Wang , Yanjie Fu , Yi Du , Pengfei Wang , Yuanchun Zhou

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over the years. Existing literature mainly focus on selecting a subgraph, through combinatorial optimization, to provide faithful…

Machine Learning · Computer Science 2023-03-07 Wenqian Li , Yinchuan Li , Zhigang Li , Jianye Hao , Yan Pang

This paper studies four Graph Neural Network architectures (GNNs) for a graph classification task on a synthetic dataset created using classic generative models of Network Science. Since the synthetic networks do not contain (node or edge)…

Social and Information Networks · Computer Science 2024-01-12 Walid Guettala , László Gulyás

Graph Neural Networks (GNNs) have been widely used in various domains, and GNNs with sophisticated computational graph lead to higher latency and larger memory consumption. Optimizing the GNN computational graph suffers from: (1) Redundant…

Machine Learning · Computer Science 2021-10-20 Hengrui Zhang , Zhongming Yu , Guohao Dai , Guyue Huang , Yufei Ding , Yuan Xie , Yu Wang

Current graph neural networks (GNNs) lack generalizability with respect to scales (graph sizes, graph diameters, edge weights, etc..) when solving many graph analysis problems. Taking the perspective of synthesizing graph theory programs,…

Machine Learning · Computer Science 2020-10-27 Hao Tang , Zhiao Huang , Jiayuan Gu , Bao-Liang Lu , Hao Su

Forecasting electricity demand is increasingly challenging as energy systems become more decentralized and intertwined with renewable sources. Graph Neural Networks (GNNs) have recently emerged as a powerful paradigm to model spatial…

Machine Learning · Computer Science 2025-11-04 Eloi Campagne , Yvenn Amara-Ouali , Yannig Goude , Itai Zehavi , Argyris Kalogeratos

Graph neural networks (GNNs) face significant challenges with class imbalance, leading to biased inference results. To address this issue in heterogeneous graphs, we propose a novel framework that combines Graph Neural Network (GNN) and…

Machine Learning · Computer Science 2024-11-26 Hung-Chun Hsu , Bo-Jun Wu , Ming-Yi Hong , Che Lin , Chih-Yu Wang

Graph-based and sequential methods are two popular recommendation paradigms, each excelling in its domain but lacking the ability to leverage signals from the other. To address this, we propose a novel method that integrates both approaches…

Information Retrieval · Computer Science 2025-01-30 Yuwei Cao , Liangwei Yang , Zhiwei Liu , Yuqing Liu , Chen Wang , Yueqing Liang , Hao Peng , Philip S. Yu

Graph Neural Networks (GNN) are currently the most popular approach for learning and prediction on graph-structured data and are deployed in various fields, from social network analysis to drug discovery. However, there is limited…

Methodology · Statistics 2026-05-26 Nil Ayday , Mahalakshmi Sabanayagam , Debarghya Ghoshdastidar

Scalability of graph neural networks remains one of the major challenges in graph machine learning. Since the representation of a node is computed by recursively aggregating and transforming representation vectors of its neighboring nodes…

Machine Learning · Computer Science 2021-06-10 Zengfeng Huang , Shengzhong Zhang , Chong Xi , Tang Liu , Min Zhou

A theoretical performance analysis of the graph neural network (GNN) is presented. For classification tasks, the neural network approach has the advantage in terms of flexibility that it can be employed in a data-driven manner, whereas…

Machine Learning · Computer Science 2020-01-29 Tatsuro Kawamoto , Masashi Tsubaki , Tomoyuki Obuchi

Graph Neural Networks (GNNs) are non-Euclidean deep learning models for graph-structured data. Despite their successful and diverse applications, oversmoothing prohibits deep architectures due to node features converging to a single fixed…

Machine Learning · Computer Science 2024-12-06 Arseny Skryagin , Felix Divo , Mohammad Amin Ali , Devendra Singh Dhami , Kristian Kersting