English
Related papers

Related papers: Gumbel-softmax-based Optimization: A Simple Genera…

200 papers

This paper formulates a multitask optimization problem where agents in the network have individual objectives to meet, or individual parameter vectors to estimate, subject to a smoothness condition over the graph. The smoothness condition…

Multiagent Systems · Computer Science 2019-11-18 Roula Nassif , Stefan Vlaski , Cedric Richard , Ali H. Sayed

This paper proposes a new framework for distributed optimization, called distributed aggregative optimization, which allows local objective functions to be dependent not only on their own decision variables, but also on the average of…

Optimization and Control · Mathematics 2020-05-28 Xiuxian Li , Lihua Xie , Yiguang Hong

Deep learning has consistently defied state-of-the-art techniques in many fields over the last decade. However, we are just beginning to understand the capabilities of neural learning in symbolic domains. Deep learning architectures that…

Machine Learning · Computer Science 2020-03-10 Henrique Lemos , Marcelo Prates , Pedro Avelar , Luis Lamb

In this paper, we explore the graph partitioning problem, a pivotal combina-torial optimization challenge with extensive applications in various fields such as science, technology, and business. Recognized as an NP-hard prob-lem, graph…

Machine Learning · Computer Science 2023-12-13 Vivek Chaudhary

Data-driven approaches have been proven effective in solving combinatorial optimization problems over graphs such as the traveling salesman problems and the vehicle routing problem. The rationale behind such methods is that the input…

Artificial Intelligence · Computer Science 2023-08-08 Mina Samizadeh , Guangmo Tong

The network embedding problem that maps nodes in a graph to vectors in Euclidean space can be very useful for addressing several important tasks on a graph. Recently, graph neural networks (GNNs) have been proposed for solving such a…

Machine Learning · Computer Science 2020-09-23 Ping-En Lu , Cheng-Shang Chang

Gradient-free optimizers allow for tackling problems regardless of the smoothness or differentiability of their objective function, but they require many more iterations to converge when compared to gradient-based algorithms. This has made…

Machine Learning · Computer Science 2024-09-24 Gawel Kus , Miguel A. Bessa

In recent years, graph neural networks (GNNs) have gained increasing attention, as they possess the excellent capability of processing graph-related problems. In practice, hyperparameter optimisation (HPO) is critical for GNNs to achieve…

Machine Learning · Computer Science 2021-04-29 Yingfang Yuan , Wenjun Wang , Wei Pang

Graph signal processing (GSP) is a key tool for satisfying the growing demand for information processing over networks. However, the success of GSP in downstream learning and inference tasks is heavily dependent on the prior identification…

Signal Processing · Electrical Eng. & Systems 2021-03-29 Seyed Saman Saboksayr , Gonzalo Mateos , Mujdat Cetin

In this paper, we address a class of specially structured problems that include speed planning, for mobile robots and robotic manipulators, and dynamic programming. We develop two new numerical procedures, that apply to the general case and…

Optimization and Control · Mathematics 2019-10-21 Luca Consolini , Mattia Laurini , Marco Locatelli

Distributed Optimization is an increasingly important subject area with the rise of multi-agent control and optimization. We consider a decentralized stochastic optimization problem where the agents on a graph aim to asynchronously optimize…

Optimization and Control · Mathematics 2021-10-22 Vyacheslav Kungurtsev , Mahdi Morafah , Tara Javidi , Gesualdo Scutari

Acquiring labels are often costly, whereas unlabeled data are usually easy to obtain in modern machine learning applications. Semi-supervised learning provides a principled machine learning framework to address such situations, and has been…

Machine Learning · Computer Science 2017-04-07 Trung Le , Khanh Nguyen , Van Nguyen , Vu Nguyen , Dinh Phung

The aim of this work is to develop a fully-distributed algorithmic framework for training graph convolutional networks (GCNs). The proposed method is able to exploit the meaningful relational structure of the input data, which are collected…

Machine Learning · Computer Science 2022-12-21 Simone Scardapane , Indro Spinelli , Paolo Di Lorenzo

Optimization is crucial for MEC networks to function efficiently and reliably, most of which are NP-hard and lack efficient approximation algorithms. This leads to a paucity of optimal solution, constraining the effectiveness of…

Networking and Internet Architecture · Computer Science 2025-05-06 Ruihuai Liang , Bo Yang , Pengyu Chen , Xuelin Cao , Zhiwen Yu , Mérouane Debbah , Dusit Niyato , H. Vincent Poor , Chau Yuen

The hardness of combinatorial optimization (CO) problems hinders collecting solutions for supervised learning. However, learning neural networks for CO problems is notoriously difficult in lack of the labeled data as the training is easily…

Machine Learning · Computer Science 2022-07-26 Haoran Sun , Etash K. Guha , Hanjun Dai

Graph transformer networks (GTN) are a variant of graph convolutional networks (GCN) that are targeted to heterogeneous graphs in which nodes and edges have associated type information that can be exploited to improve inference accuracy.…

Artificial Intelligence · Computer Science 2021-06-17 Loc Hoang , Udit Agarwal , Gurbinder Gill , Roshan Dathathri , Abhik Seal , Brian Martin , Keshav Pingali

This paper describes a novel algorithmic framework to minimize a finite-sum of functions available over a network of nodes. The proposed framework, that we call~\GTVR, is stochastic and decentralized, and thus is particularly suitable for…

Optimization and Control · Mathematics 2020-12-02 Ran Xin , Usman A. Khan , Soummya Kar

Black-box global optimization aims at minimizing an objective function whose analytical form is not known. To do so, many state-of-the-art methods rely on sampling-based strategies, where sampling distributions are built in an iterative…

Optimization and Control · Mathematics 2024-09-30 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

In this work we design graph neural network architectures that capture optimal approximation algorithms for a large class of combinatorial optimization problems, using powerful algorithmic tools from semidefinite programming (SDP).…

Machine Learning · Computer Science 2024-10-08 Morris Yau , Nikolaos Karalias , Eric Lu , Jessica Xu , Stefanie Jegelka

This work proposes an algorithmic framework to learn time-varying graphs from online data. The generality offered by the framework renders it model-independent, i.e., it can be theoretically analyzed in its abstract formulation and then…

Machine Learning · Computer Science 2022-05-25 Alberto Natali , Elvin Isufi , Mario Coutino , Geert Leus