中文
相关论文

相关论文: Graph Neural Networks Need Cluster-Normalize-Activ…

200 篇论文

Simulating complex dynamics like fluids with traditional simulators is computationally challenging. Deep learning models have been proposed as an efficient alternative, extending or replacing parts of traditional simulators. We investigate…

机器学习 · 计算机科学 2022-03-16 Jonathan Klimesch , Philipp Holl , Nils Thuerey

Curvature notions on graphs provide a theoretical description of graph topology, highlighting bottlenecks and denser connected regions. Artifacts of the message passing paradigm in Graph Neural Networks, such as oversmoothing and…

机器学习 · 计算机科学 2026-02-25 Floriano Tori , Lorenzo Bini , Marco Sorbi , Stéphane Marchand-Maillet , Vincent Ginis

Graph Neural Networks (GNNs) are well-suited for learning on homophilous graphs, i.e., graphs in which edges tend to connect nodes of the same type. Yet, achievement of consistent GNN performance on heterophilous graphs remains an open…

机器学习 · 计算机科学 2023-08-30 Andrea Cavallo , Claas Grohnfeldt , Michele Russo , Giulio Lovisotto , Luca Vassio

In recent years, significant efforts have been made to refine the design of Graph Neural Network (GNN) layers, aiming to overcome diverse challenges, such as limited expressive power and oversmoothing. Despite their widespread adoption, the…

机器学习 · 计算机科学 2024-11-04 Moshe Eliasof , Beatrice Bevilacqua , Carola-Bibiane Schönlieb , Haggai Maron

Deep learning, particularly convolutional neural networks (CNNs), have yielded rapid, significant improvements in computer vision and related domains. But conventional deep learning architectures perform poorly when data have an underlying…

信号处理 · 电气工程与系统科学 2020-12-02 Mark Cheung , John Shi , Oren Wright , Lavender Y. Jiang , Xujin Liu , José M. F. Moura

Graph Neural Networks (GNNs) have emerged as a powerful and flexible framework for representation learning on irregular data. As they generalize the operations of classical CNNs on grids to arbitrary topologies, GNNs also bring much of the…

机器学习 · 计算机科学 2021-03-31 Mehdi Bahri , Gaétan Bahl , Stefanos Zafeiriou

The recent introduction of Graph Neural Networks (GNNs) and their growing popularity in the past few years has enabled the application of deep learning algorithms to non-Euclidean, graph-structured data. GNNs have achieved state-of-the-art…

机器学习 · 计算机科学 2020-10-27 Tuomas P. Oikarinen , Daniel C. Hannah , Sohrob Kazerounian

Graph Neural Networks have emerged as a useful tool to learn on the data by applying additional constraints based on the graph structure. These graphs are often created with assumed intrinsic relations between the entities. In recent years,…

机器学习 · 统计学 2021-05-18 Sunil Kumar Maurya , Xin Liu , Tsuyoshi Murata

The last few years have seen an increasing wave of attacks with serious economic and privacy damages, which evinces the need for accurate Network Intrusion Detection Systems (NIDS). Recent works propose the use of Machine Learning (ML)…

密码学与安全 · 计算机科学 2021-08-02 David Pujol-Perich , José Suárez-Varela , Albert Cabellos-Aparicio , Pere Barlet-Ros

Graph convolutional neural networks (GCNs) generalize tradition convolutional neural networks (CNNs) from low-dimensional regular graphs (e.g., image) to high dimensional irregular graphs (e.g., text documents on word embeddings). Due to…

机器学习 · 计算机科学 2021-03-30 Mehrnaz Najafi , Philip S. Yu

Graph neural networks (GNNs) are powerful graph-based machine-learning models that are popular in various domains, e.g., social media, transportation, and drug discovery. However, owing to complex data representations, GNNs do not easily…

机器学习 · 计算机科学 2024-05-14 Pantea Habibi , Peyman Baghershahi , Sourav Medya , Debaleena Chattopadhyay

Graph neural networks (GNN) extends deep learning to graph-structure dataset. Similar to Convolutional Neural Networks (CNN) using on image prediction, convolutional and pooling layers are the foundation to success for GNN on graph…

机器学习 · 计算机科学 2023-02-28 Lingjie Kong , Yun Liao

Graph Convolutional Networks (GCNs) have shown significant improvements in semi-supervised learning on graph-structured data. Concurrently, unsupervised learning of graph embeddings has benefited from the information contained in random…

机器学习 · 计算机科学 2018-02-27 Sami Abu-El-Haija , Amol Kapoor , Bryan Perozzi , Joonseok Lee

Graph Neural Networks (GNNs) with numerical node features and graph structure as inputs have demonstrated superior performance on various supervised learning tasks with graph data. However the numerical node features utilized by GNNs are…

机器学习 · 计算机科学 2022-06-20 Jiuhai Chen , Jonas Mueller , Vassilis N. Ioannidis , Tom Goldstein , David Wipf

Normalization is known to help the optimization of deep neural networks. Curiously, different architectures require specialized normalization methods. In this paper, we study what normalization is effective for Graph Neural Networks (GNNs).…

机器学习 · 计算机科学 2021-06-14 Tianle Cai , Shengjie Luo , Keyulu Xu , Di He , Tie-Yan Liu , Liwei Wang

Graph neural networks (GNN) represent an emerging line of deep learning models that operate on graph structures. It is becoming more and more popular due to its high accuracy achieved in many graph-related tasks. However, GNN is not as well…

硬件体系结构 · 计算机科学 2021-12-28 Zhihui Zhang , Jingwen Leng , Lingxiao Ma , Youshan Miao , Chao Li , Minyi Guo

The application of deep learning to symbolic domains remains an active research endeavour. Graph neural networks (GNN), consisting of trained neural modules which can be arranged in different topologies at run time, are sound alternatives…

社会与信息网络 · 计算机科学 2019-12-02 Pedro H. C. Avelar , Henrique Lemos , Marcelo O. R. Prates , Luis Lamb

Learning useful node and graph representations with graph neural networks (GNNs) is a challenging task. It is known that deep GNNs suffer from over-smoothing where, as the number of layers increases, node representations become nearly…

机器学习 · 计算机科学 2022-02-28 Pantelis Elinas , Edwin V. Bonilla

Graph neural networks (GNNs) have emerged as a powerful framework for a wide range of node-level graph learning tasks. However, their performance typically depends on random or minimally informed initial feature representations, where poor…

机器学习 · 计算机科学 2026-02-24 Shiyu Chen , Cencheng Shen , Youngser Park , Carey E. Priebe

Graph Convolutional Networks (GCNs) achieve great success in non-Euclidean structure data processing recently. In existing studies, deeper layers are used in CCNs to extract deeper features of Euclidean structure data. However, for…

机器学习 · 计算机科学 2022-03-14 Junhua Ma , Jiajun Li , Xueming Li , Xu Li