English
Related papers

Related papers: Alternately Optimized Graph Neural Networks

200 papers

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

Machine Learning · Computer Science 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

The recent work ``Combinatorial Optimization with Physics-Inspired Graph Neural Networks'' [Nat Mach Intell 4 (2022) 367] introduces a physics-inspired unsupervised Graph Neural Network (GNN) to solve combinatorial optimization problems on…

Machine Learning · Computer Science 2023-01-04 Maria Chiara Angelini , Federico Ricci-Tersenghi

Many combinatorial optimization problems can be phrased in the language of constraint satisfaction problems. We introduce a graph neural network architecture for solving such optimization problems. The architecture is generic; it works for…

Artificial Intelligence · Computer Science 2020-02-12 Jan Toenshoff , Martin Ritzert , Hinrikus Wolf , Martin Grohe

Graph Neural Networks (GNNs) have demonstrated effectiveness in various graph-based tasks. However, their inefficiency in training and inference presents challenges for scaling up to real-world and large-scale graph applications. To address…

Machine Learning · Computer Science 2024-05-08 Lu Ma , Zeang Sheng , Xunkai Li , Xinyi Gao , Zhezheng Hao , Ling Yang , Wentao Zhang , Bin Cui

Graph Drawing techniques have been developed in the last few years with the purpose of producing aesthetically pleasing node-link layouts. Recently, the employment of differentiable loss functions has paved the road to the massive usage of…

Machine Learning · Computer Science 2022-07-04 Matteo Tiezzi , Gabriele Ciravegna , Marco Gori

Graph-based semi-supervised node classification has been shown to become a state-of-the-art approach in many applications with high research value and significance. Most existing methods are only based on the original intrinsic or…

Machine Learning · Computer Science 2023-06-08 Jianpeng Liao , Jun Yan , Qian Tao

Graph Neural Networks (GNNs) have become the leading paradigm for learning on (static) graph-structured data. However, many real-world systems are dynamic in nature, since the graph and node/edge attributes change over time. In recent…

Graph neural networks (GNNs) have emerged as a promising solution to deal with unstructured data, outperforming traditional deep learning architectures. However, most of the current GNN models are designed to work with a single graph, which…

Machine Learning · Computer Science 2024-11-11 Victor M. Tenorio , Antonio G. Marques

Graph Neural Networks (GNNs) have been extensively used for mining graph-structured data with impressive performance. However, because these traditional GNNs do not distinguish among various downstream tasks, embeddings embedded by them are…

Machine Learning · Computer Science 2024-09-20 Jianpeng Chen , Yujing Wang , Ming Zeng , Zongyi Xiang , Bitan Hou , Yunhai Tong , Ole J. Mengshoel , Yazhou Ren

Graph neural networks (GNNs) have struggled to outperform traditional optimization methods on combinatorial problems, limiting their practical impact. We address this gap by introducing a novel chaining procedure for the graph alignment…

Machine Learning · Computer Science 2025-10-06 Marc Lelarge

In mathematical optimization, second-order Newton's methods generally converge faster than first-order methods, but they require the inverse of the Hessian, hence are computationally expensive. However, we discover that on sparse graphs,…

Machine Learning · Computer Science 2022-05-30 Nima Dehmamy , Csaba Both , Jianzhi Long , Rose Yu

Graph Neural Networks (GNNs) have made tremendous progress in the graph classification task. However, a performance gap between the training set and the test set has often been noticed. To bridge such gap, in this work we introduce the…

Machine Learning · Computer Science 2022-10-18 Yiqi Wang , Chaozhuo Li , Wei Jin , Rui Li , Jianan Zhao , Jiliang Tang , Xing Xie

Graph Neural Networks (GNNs) have made significant advances on several fundamental inference tasks. As a result, there is a surge of interest in using these models for making potentially important decisions in high-regret applications.…

Machine Learning · Computer Science 2020-02-26 Kaidi Xu , Sijia Liu , Pin-Yu Chen , Mengshu Sun , Caiwen Ding , Bhavya Kailkhura , Xue Lin

Graph neural networks (GNNs) have emerged as a powerful tool for graph classification and representation learning. However, GNNs tend to suffer from over-smoothing problems and are vulnerable to graph perturbations. To address these…

Machine Learning · Computer Science 2021-11-01 Yuzhou Chen , Baris Coskunuzer , Yulia R. Gel

Graph neural networks have pushed state-of-the-arts in graph classifications recently. Typically, these methods are studied within the context of supervised end-to-end training, which necessities copious task-specific labels. However, in…

Machine Learning · Computer Science 2023-06-01 Xiao Luo , Yusheng Zhao , Yifang Qin , Wei Ju , Ming Zhang

Graph neural networks (GNNs) are a class of deep models that operate on data with arbitrary topology represented as graphs. We introduce an efficient memory layer for GNNs that can jointly learn node representations and coarsen the graph.…

Machine Learning · Computer Science 2020-06-11 Amir Hosein Khasahmadi , Kaveh Hassani , Parsa Moradi , Leo Lee , Quaid Morris

Semi-supervised learning (SSL) over graph-structured data emerges in many network science applications. To efficiently manage learning over graphs, variants of graph neural networks (GNNs) have been developed recently. By succinctly…

Machine Learning · Computer Science 2021-10-22 Alireza Sadeghi , Meng Ma , Bingcong Li , Georgios B. Giannakis

Graph embedding is an important approach for graph analysis tasks such as node classification and link prediction. The goal of graph embedding is to find a low dimensional representation of graph nodes that preserves the graph information.…

Machine Learning · Computer Science 2019-08-27 Mahsa Ghorbani , Mahdieh Soleymani Baghshah , Hamid R. Rabiee

Linearized Graph Neural Networks (GNNs) have attracted great attention in recent years for graph representation learning. Compared with nonlinear Graph Neural Network (GNN) models, linearized GNNs are much more time-efficient and can…

Machine Learning · Computer Science 2023-02-02 Yulin Zhu , Xing Ai , Qimai Li , Xiao-Ming Wu , Kai Zhou

Graph neural networks have been widely used for learning representations of nodes for many downstream tasks on graph data. Existing models were designed for the nodes on a single graph, which would not be able to utilize information across…

Machine Learning · Computer Science 2021-06-04 Meng Jiang