English
Related papers

Related papers: Gumbel-softmax-based Optimization: A Simple Genera…

200 papers

Optimization over trained machine learning models has applications including: verification, minimizing neural acquisition functions, and integrating a trained surrogate into a larger decision-making problem. This paper formulates and solves…

Optimization and Control · Mathematics 2023-10-13 Shiqiang Zhang , Juan S. Campos , Christian Feldmann , David Walz , Frederik Sandfort , Miriam Mathea , Calvin Tsay , Ruth Misener

In recent years, Graph Neural Networks (GNNs) have achieved remarkable success in many graph mining tasks. However, scaling them to large graphs is challenging due to the high computational and storage costs of repeated feature propagation…

Machine Learning · Computer Science 2025-04-11 Yuxuan Liang , Wentao Zhang , Zeang Sheng , Ling Yang , Quanqing Xu , Jiawei Jiang , Yunhai Tong , Bin Cui

Partial graph matching extends traditional graph matching by allowing some nodes to remain unmatched, enabling applications in more complex scenarios. However, this flexibility introduces additional complexity, as both the subset of nodes…

Machine Learning · Computer Science 2026-02-26 Gathika Ratnayaka , James Nichols , Qing Wang

In recent years, graph neural networks (GNNs) have been widely applied in tackling combinatorial optimization problems. However, existing methods still suffer from limited accuracy when addressing that on complex graphs and exhibit poor…

Machine Learning · Computer Science 2025-11-13 Yuyao Long

This note explores the applicability of unsupervised machine learning techniques towards hard optimization problems on random inputs. In particular we consider Graph Neural Networks (GNNs) -- a class of neural networks designed to learn…

Optimization and Control · Mathematics 2019-08-19 Weichi Yao , Afonso S. Bandeira , Soledad Villar

Graph neural networks (GNNs) have emerged as a powerful tool for solving combinatorial optimization problems (COPs), exhibiting state-of-the-art performance in both graph-structured and non-graph-structured domains. However, existing…

Artificial Intelligence · Computer Science 2024-06-21 Yaochu Jin , Xueming Yan , Shiqing Liu , Xiangyu Wang

We present GraphMix, a regularization method for Graph Neural Network based semi-supervised object classification, whereby we propose to train a fully-connected network jointly with the graph neural network via parameter sharing and…

Machine Learning · Computer Science 2020-10-12 Vikas Verma , Meng Qu , Kenji Kawaguchi , Alex Lamb , Yoshua Bengio , Juho Kannala , Jian Tang

Many statistical problems involve optimization over a discrete parameter space having an unknown dimension. In such settings, gradient-based methods often fail due to the non-differentiability of the objective function or a non-convex or…

Applications · Statistics 2026-03-19 Mo Li , QiQi Lu , Robert Lund , Xueheng Shi

Graph Neural Networks (GNNs) have achieved impressive performance in collaborative filtering. However, GNNs tend to yield inferior performance when the distributions of training and test data are not aligned well. Also, training GNNs…

Machine Learning · Computer Science 2023-07-19 Huiyuan Chen , Chin-Chia Michael Yeh , Yujie Fan , Yan Zheng , Junpeng Wang , Vivian Lai , Mahashweta Das , Hao Yang

In this paper, we consider smooth convex optimization problems with simple constraints and inexactness in the oracle information such as value, partial or directional derivatives of the objective function. We introduce a unifying framework,…

Optimization and Control · Mathematics 2020-12-17 Pavel Dvurechensky , Alexander Gasnikov , Alexander Tiurin , Vladimir Zholobov

Graph Neural Networks (GNNs) have emerged as a notorious alternative to address learning problems dealing with non-Euclidean datasets. However, although most works assume that the graph is perfectly known, the observed topology is prone to…

Machine Learning · Computer Science 2023-12-12 Victor M. Tenorio , Samuel Rey , Antonio G. Marques

Large scale graph optimization problems arise in many fields. This paper presents an extensible, high performance framework (named OpenGraphGym-MG) that uses deep reinforcement learning and graph embedding to solve large graph optimization…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-25 Weijian Zheng , Dali Wang , Fengguang Song

The graph matching optimization problem is an essential component for many tasks in computer vision, such as bringing two deformable objects in correspondence. Naturally, a wide range of applicable algorithms have been proposed in the last…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Stefan Haller , Lorenz Feineis , Lisa Hutschenreiter , Florian Bernard , Carsten Rother , Dagmar Kainmüller , Paul Swoboda , Bogdan Savchynskyy

Stochastic optimization algorithms update models with cheap per-iteration costs sequentially, which makes them amenable for large-scale data analysis. Such algorithms have been widely studied for structured sparse models where the sparsity…

Machine Learning · Computer Science 2019-05-10 Baojian Zhou , Feng Chen , Yiming Ying

Many combinatorial optimization problems can be phrased in the language of constraint satisfaction problems. We introduce a graph neural network architecture for solving such optimization problems. The architecture is generic; it works for…

Artificial Intelligence · Computer Science 2020-02-12 Jan Toenshoff , Martin Ritzert , Hinrikus Wolf , Martin Grohe

Graph homophily has been considered an essential property for message-passing neural networks (MPNN) in node classification. Recent findings suggest that performance is more closely tied to the consistency of neighborhood class…

Machine Learning · Computer Science 2025-08-26 Marcel Hoffmann , Lukas Galke , Ansgar Scherp

In this article we provide a comprehensive review of the different evolutionary algorithm techniques used to address multimodal optimization problems, classifying them according to the nature of their approach. On the one hand there are…

Neural and Evolutionary Computing · Computer Science 2015-08-24 Noe Casas

Graph partitioning is the problem of dividing the nodes of a graph into balanced partitions while minimizing the edge cut across the partitions. Due to its combinatorial nature, many approximate solutions have been developed, including…

Machine Learning · Computer Science 2019-03-05 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

Generative Adversarial Networks (GAN) have limitations when the goal is to generate sequences of discrete elements. The reason for this is that samples from a distribution on discrete objects such as the multinomial are not differentiable…

Machine Learning · Statistics 2016-11-16 Matt J. Kusner , José Miguel Hernández-Lobato

Recent advances in machine learning (ML) have shown promise in aiding and accelerating classical combinatorial optimization algorithms. ML-based speed ups that aim to learn in an end to end manner (i.e., directly output the solution) tend…

Machine Learning · Computer Science 2023-10-24 Zohair Shafi , Benjamin A. Miller , Ayan Chatterjee , Tina Eliassi-Rad , Rajmonda S. Caceres