English
Related papers

Related papers: Unveiling Mode Connectivity in Graph Neural Networ…

200 papers

Noninvasive medical neuroimaging has yielded many discoveries about the brain connectivity. Several substantial techniques mapping morphological, structural and functional brain connectivities were developed to create a comprehensive road…

Machine Learning · Computer Science 2022-09-30 Alaa Bessadok , Mohamed Ali Mahjoub , Islem Rekik

Geometric graphs are a special kind of graph with geometric features, which are vital to model many scientific problems. Unlike generic graphs, geometric graphs often exhibit physical symmetries of translations, rotations, and reflections,…

Mechanics-related problems often present unique challenges in achieving accurate geometric and physical representations, particularly for non-uniform structures. Graph neural networks (GNNs) have emerged as a promising tool to tackle these…

Machine Learning · Computer Science 2024-07-17 Yingxue Zhao , Haoran Li , Haosu Zhou , Hamid Reza Attar , Tobias Pfaff , Nan Li

We analyze the performance of graph neural network (GNN) architectures from the perspective of random graph theory. Our approach promises to complement existing lenses on GNN analysis, such as combinatorial expressive power and worst-case…

Machine Learning · Computer Science 2023-10-12 Drake Brown , Trevor Garrity , Kaden Parker , Jason Oliphant , Stone Carson , Cole Hanson , Zachary Boyd

Graph Neural Networks (GNNs) have emerged as a powerful tool to learn from graph-structured data. A paramount example of such data is the brain, which operates as a network, from the micro-scale of neurons, to the macro-scale of regions.…

Machine Learning · Computer Science 2022-11-17 Ahmed ElGazzar , Rajat Thomas , Guido van Wingen

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Graph Neural Networks (GNNs) became useful for learning on non-Euclidean data. However, their best performance depends on choosing the right model architecture and the training objective, also called the loss function. Researchers have…

Machine Learning · Computer Science 2025-06-18 Khushnood Abbas , Ruizhe Hou , Zhou Wengang , Dong Shi , Niu Ling , Satyaki Nan , Alireza Abbasi

Graph neural networks (GNNs) have shown great prowess in learning representations suitable for numerous graph-based machine learning tasks. When applied to semi-supervised node classification, GNNs are widely believed to work well due to…

Machine Learning · Computer Science 2023-07-24 Yao Ma , Xiaorui Liu , Neil Shah , Jiliang Tang

Graph neural networks (GNNs) have demonstrated their effectiveness in various tasks supported by their generalization capabilities. However, the current analysis of GNN generalization relies on the assumption that training and testing data…

Machine Learning · Computer Science 2024-09-11 Zhiyang Wang , Juan Cervino , Alejandro Ribeiro

Graph Neural Networks (GNNs) have become the de-facto standard tool for modeling relational data. However, while many real-world graphs are directed, the majority of today's GNN models discard this information altogether by simply making…

Graph Neural Networks (GNNs) are information processing architectures for signals supported on graphs. They are presented here as generalizations of convolutional neural networks (CNNs) in which individual layers contain banks of graph…

Machine Learning · Computer Science 2021-02-01 Luana Ruiz , Fernando Gama , Alejandro Ribeiro

Graph neural networks (GNN) represent an emerging line of deep learning models that operate on graph structures. It is becoming more and more popular due to its high accuracy achieved in many graph-related tasks. However, GNN is not as well…

Hardware Architecture · Computer Science 2021-12-28 Zhihui Zhang , Jingwen Leng , Lingxiao Ma , Youshan Miao , Chao Li , Minyi Guo

Graph structure learning is a well-established problem that aims at optimizing graph structures adaptive to specific graph datasets to help message passing neural networks (i.e., GNNs) to yield effective and robust node embeddings. However,…

Machine Learning · Computer Science 2023-06-21 Wentao Zhao , Qitian Wu , Chenxiao Yang , Junchi Yan

Understanding the geometry of neural network loss landscapes is a central question in deep learning, with implications for generalization and optimization. A striking phenomenon is linear mode connectivity (LMC), where independently trained…

Machine Learning · Computer Science 2025-11-14 Alexander Theus , Alessandro Cabodi , Sotiris Anagnostidis , Antonio Orvieto , Sidak Pal Singh , Valentina Boeva

Graph Neural Networks (GNNs) have proven to be useful for many different practical applications. However, many existing GNN models have implicitly assumed homophily among the nodes connected in the graph, and therefore have largely…

Machine Learning · Computer Science 2021-06-16 Jiong Zhu , Ryan A. Rossi , Anup Rao , Tung Mai , Nedim Lipka , Nesreen K. Ahmed , Danai Koutra

Seeking effective neural networks is a critical and practical field in deep learning. Besides designing the depth, type of convolution, normalization, and nonlinearities, the topological connectivity of neural networks is also important.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Kun Yuan , Quanquan Li , Jing Shao , Junjie Yan

Graph neural networks (GNNs) have been regarded as the basic model to facilitate deep learning (DL) to revolutionize resource allocation in wireless networks. GNN-based models are shown to be able to learn the structural information about…

Signal Processing · Electrical Eng. & Systems 2024-09-06 Yang Lu , Yuhang Li , Ruichen Zhang , Wei Chen , Bo Ai , Dusit Niyato

Graph Neural Networks (GNNs) are key tools for graph representation learning, demonstrating strong results across diverse prediction tasks. In this paper, we present Convexified Message-Passing Graph Neural Networks (CGNNs), a novel and…

Machine Learning · Computer Science 2026-01-27 Saar Cohen , Noa Agmon , Uri Shaham

Graph Drawing techniques have been developed in the last few years with the purpose of producing aesthetically pleasing node-link layouts. Recently, the employment of differentiable loss functions has paved the road to the massive usage of…

Machine Learning · Computer Science 2022-07-04 Matteo Tiezzi , Gabriele Ciravegna , Marco Gori

Deep neural networks (DNNs) achieve state-of-the-art performance on many tasks, but this often requires increasingly larger model sizes, which in turn leads to more complex internal representations. Explainability techniques (XAI) have made…

Machine Learning · Computer Science 2026-01-30 Tom Pelletreau-Duris , Ruud van Bakel , Michael Cochez