English
Related papers

Related papers: Towards Understanding and Avoiding Limitations of …

200 papers

Message-passing graph neural networks (MPGNNs) dominate modern graph learning. Typical efforts enhance MPGNN's expressive power by enriching the adjacency-based aggregation. In contrast, we introduce an efficient aggregation over walk…

Machine Learning · Computer Science 2025-09-29 Marek Černý

Ground-based cloud image segmentation is a critical research domain for photovoltaic power forecasting. Current deep learning approaches primarily focus on encoder-decoder architectural refinements. However, existing methodologies exhibit…

Machine Learning · Computer Science 2026-02-17 Penghui Niu , Jiashuai She , Taotao Cai , Yajuan Zhang , Ping Zhang , Junhua Gu , Jianxin Li

Graph Neural Networks (GNNs) are a promising deep learning approach for circumventing many real-world problems on graph-structured data. However, these models usually have at least one of four fundamental limitations: over-smoothing,…

Machine Learning · Computer Science 2022-10-03 Xun Liu , Alex Hay-Man Ng , Fangyuan Lei , Yikuan Zhang , Zhengmin Li

The goal of this work is to address two limitations in autoencoder-based models: latent space interpretability and compatibility with unstructured meshes. This is accomplished here with the development of a novel graph neural network (GNN)…

Machine Learning · Computer Science 2023-02-20 Shivam Barwey , Varun Shankar , Venkatasubramanian Viswanathan , Romit Maulik

Graph Convolutional Networks (GCNs) have achieved impressive empirical advancement across a wide variety of semi-supervised node classification tasks. Despite their great success, training GCNs on large graphs suffers from computational and…

Machine Learning · Computer Science 2021-11-02 Weilin Cong , Morteza Ramezani , Mehrdad Mahdavi

Despite the growing popularity of graph attention mechanisms, their theoretical understanding remains limited. This paper aims to explore the conditions under which these mechanisms are effective in node classification tasks through the…

Machine Learning · Computer Science 2025-05-14 Zhongtian Ma , Qiaosheng Zhang , Bocheng Zhou , Yexin Zhang , Shuyue Hu , Zhen Wang

Graph neural networks (GNNs), as the de-facto model class for representation learning on graphs, are built upon the multi-layer perceptrons (MLP) architecture with additional message passing layers to allow features to flow across nodes.…

Machine Learning · Computer Science 2023-08-07 Chenxiao Yang , Qitian Wu , Jiahua Wang , Junchi Yan

This paper proposes a novel module called middle spectrum grouped convolution (MSGC) for efficient deep convolutional neural networks (DCNNs) with the mechanism of grouped convolution. It explores the broad "middle spectrum" area between…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Zhuo Su , Jiehua Zhang , Tianpeng Liu , Zhen Liu , Shuanghui Zhang , Matti Pietikäinen , Li Liu

Message Passing Neural Networks (MPNNs) are a widely used class of Graph Neural Networks (GNNs). The limited representational power of MPNNs inspires the study of provably powerful GNN architectures. However, knowing one model is more…

Machine Learning · Computer Science 2023-05-10 Yinan Huang , Xingang Peng , Jianzhu Ma , Muhan Zhang

Existing multigraph convolution methods either ignore the cross-view interaction among multiple graphs, or induce extremely high computational cost due to standard cross-view polynomial operators. To alleviate this problem, this paper…

Machine Learning · Computer Science 2024-03-11 Danyang Wu , Xinjie Shen , Jitao Lu , Jin Xu , Feiping Nie

Graph Convolution Networks (GCN) are widely used in learning graph representations due to their effectiveness and efficiency. However, they suffer from the notorious over-smoothing problem, in which the learned representations of densely…

Machine Learning · Computer Science 2020-04-10 Xin Xin , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

Using message-passing graph neural networks (MPNNs) for node and link prediction is crucial in various scientific and industrial domains, which has led to the development of diverse MPNN architectures. Besides working well in practical…

Machine Learning · Computer Science 2025-10-31 Antonis Vasileiou , Timo Stoll , Christopher Morris

We present many-body Message Passing Neural Network (MPNN) framework that models higher-order node interactions ($\ge 2$ nodes). We model higher-order terms as tree-shaped motifs, comprising a central node with its neighborhood, and apply…

Machine Learning · Computer Science 2024-07-17 Jiatong Han

This paper proposes a novel message passing neural (MPN) architecture Conv-MPN, which reconstructs an outdoor building as a planar graph from a single RGB image. Conv-MPN is specifically designed for cases where nodes of a graph have…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Fuyang Zhang , Nelson Nauata , Yasutaka Furukawa

The paper presents a solution to the problem of universal representation of graphs exemplifying communication network topologies with the help of neural networks. The proposed approach is based on message-passing neural networks (MPNN). The…

Networking and Internet Architecture · Computer Science 2019-04-15 Krzysztof Rusek , Piotr Chołda

Graph neural networks (GNNs) have been widely used to predict properties and heuristics of mixed-integer linear programs (MILPs) and hence accelerate MILP solvers. This paper investigates the capacity of GNNs to represent strong branching…

Machine Learning · Computer Science 2025-01-09 Ziang Chen , Jialin Liu , Xiaohan Chen , Xinshang Wang , Wotao Yin

Graph Neural Networks (GNNs) leverage the graph structure to transmit information between nodes, typically through the message-passing mechanism. While these models have found a wide variety of applications, they are known to suffer from…

Machine Learning · Computer Science 2025-10-23 Hugh Blayney , Álvaro Arroyo , Xiaowen Dong , Michael M. Bronstein

Graph neural networks (GNNs) have gained significant attention in recent years for their ability to process data that may be represented as graphs. This has prompted several studies to explore their representational capability based on the…

Machine Learning · Computer Science 2025-10-15 Brian Godwin Lim , Galvin Brice Sy Lim , Renzo Roel Tan , Kazushi Ikeda

Recent years have witnessed great success in handling graph-related tasks with Graph Neural Networks (GNNs). However, most existing GNNs are based on message passing to perform feature aggregation and transformation, where the structural…

Machine Learning · Computer Science 2024-09-10 Lirong Wu , Haitao Lin , Guojiang Zhao , Cheng Tan , Stan Z. Li

Message-passing graph neural networks (MPNNs) and structural features (SFs) are cornerstones for the link prediction task. However, as a common and intuitive mode of understanding, the potential of visual perception has been overlooked in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Yanbin Wei , Xuehao Wang , Zhan Zhuang , Yang Chen , Shuhao Chen , Yulong Zhang , Yu Zhang , James Kwok