English
Related papers

Related papers: Optimizing over trained GNNs via symmetry breaking

200 papers

In recent years, graph neural networks (GNNs) have become increasingly popular for solving NP-hard combinatorial optimization (CO) problems, such as maximum cut and maximum independent set. The core idea behind these methods is to represent…

Machine Learning · Computer Science 2024-06-11 Yang Liu , Peng Zhang , Yang Gao , Chuan Zhou , Zhao Li , Hongyang Chen

Graph neural networks (GNN) have achieved state-of-the-art performance on various industrial tasks. However, the poor efficiency of GNN inference and frequent Out-Of-Memory (OOM) problem limit the successful application of GNN on edge…

Machine Learning · Computer Science 2021-04-13 Ao Zhou , Jianlei Yang , Yeqi Gao , Tong Qiao , Yingjie Qi , Xiaoyi Wang , Yunli Chen , Pengcheng Dai , Weisheng Zhao , Chunming Hu

Graph Neural Networks (GNNs) are prominent in handling sparse and unstructured data efficiently and effectively. Specifically, GNNs were shown to be highly effective for node classification tasks, where labelled information is available for…

Machine Learning · Computer Science 2022-12-01 Moshe Eliasof , Eldad Haber , Eran Treister

Model merging has gained prominence in machine learning as a method to integrate multiple trained models into a single model without accessing the original training data. While existing approaches have demonstrated success in domains such…

Machine Learning · Computer Science 2025-03-28 Vipul Garg , Ishita Thakre , Sayan Ranu

Modern machine learning techniques are successfully being adapted to data modeled as graphs. However, many real-world graphs are typically very large and do not fit in memory, often making the problem of training machine learning models on…

Machine Learning · Computer Science 2020-12-10 Alexandra Angerd , Keshav Balasubramanian , Murali Annavaram

A subgraph is constructed by using a subset of vertices and edges of a given graph. There exist many graph properties that are hereditary for subgraphs. Hence, researchers from different communities have paid a great deal of attention in…

Combinatorics · Mathematics 2023-06-06 Kai Siong Yow , Ningyi Liao , Siqiang Luo , Reynold Cheng , Chenhao Ma , Xiaolin Han

Graph Neural Networks (GNNs) have made significant advances on several fundamental inference tasks. As a result, there is a surge of interest in using these models for making potentially important decisions in high-regret applications.…

Machine Learning · Computer Science 2020-02-26 Kaidi Xu , Sijia Liu , Pin-Yu Chen , Mengshu Sun , Caiwen Ding , Bhavya Kailkhura , Xue Lin

In this work, we propose to employ information-geometric tools to optimize a graph neural network architecture such as the graph convolutional networks. More specifically, we develop optimization algorithms for the graph-based…

Machine Learning · Computer Science 2020-08-25 Mohammad Rasool Izadi , Yihao Fang , Robert Stevenson , Lizhen Lin

Graph Neural Networks (GNNs) are widely applied to graph learning problems such as node classification. When scaling up the underlying graphs of GNNs to a larger size, we are forced to either train on the complete graph and keep the full…

Machine Learning · Computer Science 2024-06-25 Mucong Ding , Tahseen Rabbani , Bang An , Evan Z Wang , Furong Huang

Graph neural networks (GNNs) are a type of neural network capable of learning on graph-structured data. However, training GNNs on large-scale graphs is challenging due to iterative aggregations of high-dimensional features from neighboring…

Machine Learning · Computer Science 2024-09-18 Nikolai Merkel , Pierre Toussing , Ruben Mayer , Hans-Arno Jacobsen

A long-standing goal in deep learning has been to characterize the learning behavior of black-box models in a more interpretable manner. For graph neural networks (GNNs), considerable advances have been made in formalizing what functions…

Machine Learning · Computer Science 2024-06-19 Chenxiao Yang , Qitian Wu , David Wipf , Ruoyu Sun , Junchi Yan

Graph Neural Networks (GNNs) are key tools for graph representation learning, demonstrating strong results across diverse prediction tasks. In this paper, we present Convexified Message-Passing Graph Neural Networks (CGNNs), a novel and…

Machine Learning · Computer Science 2026-01-27 Saar Cohen , Noa Agmon , Uri Shaham

Graph Neural Networks (GNN) rely on graph convolutions to learn features from network data. GNNs are stable to different types of perturbations of the underlying graph, a property that they inherit from graph filters. In this paper we…

Machine Learning · Computer Science 2022-02-11 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

Combinatorial optimization is a well-established area in operations research and computer science. Until recently, its methods have focused on solving problem instances in isolation, ignoring that they often stem from related data…

Machine Learning · Computer Science 2023-09-06 Quentin Cappart , Didier Chételat , Elias Khalil , Andrea Lodi , Christopher Morris , Petar Veličković

Stochastic graph neural networks (SGNNs) are information processing architectures that learn representations from data over random graphs. SGNNs are trained with respect to the expected performance, which comes with no guarantee about…

Signal Processing · Electrical Eng. & Systems 2023-03-22 Zhan Gao , Elvin Isufi

The graph isomorphism (GI) problem, which asks whether two graphs are structurally identical, occupies a unique position in computational complexity -- it is neither known to be solvable in polynomial time, nor proven to be NP-complete. We…

Optimization and Control · Mathematics 2026-05-21 Wenjie Xiao , Mathieu Besançon , Patrick Gelß , Deborah Hendrych , Stefan Klus , Sebastian Pokutta

Graph neural networks (GNNs) have attracted much attention due to their ability to leverage the intrinsic geometries of the underlying data. Although many different types of GNN models have been developed, with many benchmarking procedures…

Semi-supervised node classification on graphs is an important research problem, with many real-world applications in information retrieval such as content classification on a social network and query intent classification on an e-commerce…

Machine Learning · Computer Science 2022-03-29 Zhihao Wen , Yuan Fang , Zemin Liu

Graph Neural Networks (GNN) exhibit superior performance in graph representation learning, but their inference cost can be high, due to an aggregation operation that can require a memory fetch for a very large number of nodes. This…

Machine Learning · Computer Science 2025-03-18 Yaochen Hu , Mai Zeng , Ge Zhang , Pavel Rumiantsev , Liheng Ma , Yingxue Zhang , Mark Coates

In graph modification problems, one is given a graph G and the goal is to apply a minimum number of modification operations (such as edge deletions) to G such that the resulting graph fulfills a certain property. For example, the Cluster…

Data Structures and Algorithms · Computer Science 2016-06-13 Christian Komusiewicz , André Nichterlein , Rolf Niedermeier