English
Related papers

Related papers: Distributed Bayesian: a continuous Distributed Con…

200 papers

We propose practical extensions to Bayesian optimization for solving dynamic problems. We model dynamic objective functions using spatiotemporal Gaussian process priors which capture all the instances of the functions over time. Our…

Machine Learning · Statistics 2018-03-12 Favour M. Nyikosa , Michael A. Osborne , Stephen J. Roberts

In this paper, we propose a distributed algorithm, called Directed-Distributed Gradient Descent (D-DGD), to solve multi-agent optimization problems over directed graphs. Existing algorithms mostly deal with similar problems under the…

Optimization and Control · Mathematics 2016-02-02 Chenguang Xi , Qiong Wu , Usman A. Khan

Motivated by emerging applications in wireless sensor networks and large-scale data processing, we consider distributed optimization over directed networks where the agents communicate their information locally to their neighbors to…

Optimization and Control · Mathematics 2021-03-22 Farzad Yousefian

This paper proposes a novel distributed optimization framework that addresses time-varying optimization problems without requiring explicit derivative information of the objective functions. Traditional distributed methods often rely on…

Optimization and Control · Mathematics 2025-09-29 Xuebin Li , Xuefei Yang , Emilia Fridman , Mamadou Diagne , Jiebao Sun

Dynamic constrained optimization problems (DCOPs) have gained researchers attention in recent years because a vast majority of real world problems change over time. There are studies about the effect of constrained handling techniques in…

Neural and Evolutionary Computing · Computer Science 2018-02-19 Maria-Yaneli Ameca-Alducin , Maryam Hasani-Shoreh , Wilson Blaikie , Frank Neumann , Efren Mezura-Montes

This article deals with the problem of distributed machine learning, in which agents update their models based on their local datasets, and aggregate the updated models collaboratively and in a fully decentralized manner. In this paper, we…

Machine Learning · Computer Science 2021-02-23 Tamara Alshammari , Sumudu Samarakoon , Anis Elgabli , Mehdi Bennis

Sequential Model-based Bayesian Optimization has been successful-ly applied to several application domains, characterized by complex search spaces, such as Automated Machine Learning and Neural Architecture Search. This paper focuses on…

Systems and Control · Electrical Eng. & Systems 2020-03-10 Antonio Candelieri , Bruno Galuzzi , Ilaria Giordani , Francesco Archetti

Many practical applications require solving an optimization over large and high-dimensional data sets, which makes these problems hard to solve and prohibitively time consuming. In this paper, we propose a parallel distributed algorithm…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-12-03 Elad Gilboa , Phani Chavali , Peng Yang , Arye Nehorai

In this paper, we study distributed big-data nonconvex optimization in multi-agent networks. We consider the (constrained) minimization of the sum of a smooth (possibly) nonconvex function, i.e., the agents' sum-utility, plus a convex…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-03 Ivano Notarnicola , Ying Sun , Gesualdo Scutari , Giuseppe Notarstefano

This paper focuses on distributed learning-based control of decentralized multi-agent systems where the agents' dynamics are modeled by Gaussian Processes (GPs). Two fundamental problems are considered: the optimal design of experiment for…

Systems and Control · Electrical Eng. & Systems 2021-04-06 Viet-Anh Le , Truong X. Nghiem

Most real optimization problems are defined over a mixed search space where the variables are both discrete and continuous. In engineering applications, the objective function is typically calculated with a numerically costly black-box…

Optimization and Control · Mathematics 2022-05-04 Jhouben Cuesta-Ramirez , Rodolphe Le Riche , Olivier Roustant , Guillaume Perrin , Cedric Durantin , Alain Gliere

We propose a novel method for expediting both symmetric and asymmetric Distributed Constraint Optimization Problem (DCOP) solvers. The core idea is based on initializing DCOP solvers with greedy fast non-iterative DCOP solvers. This is…

Multiagent Systems · Computer Science 2020-09-07 Cornelis Jan van Leeuwen , Przemyzław Pawełczak

Inspired by recent advances in distributed algorithms for approximating Wasserstein barycenters, we propose a novel distributed algorithm for this problem. The main novelty is that we consider time-varying computational networks, which are…

Optimization and Control · Mathematics 2023-07-26 Olga Yufereva , Michael Persiianov , Pavel Dvurechensky , Alexander Gasnikov , Dmitry Kovalev

We establish disintegrated PAC-Bayesian generalisation bounds for models trained with gradient descent methods or continuous gradient flows. Contrary to standard practice in the PAC-Bayesian setting, our result applies to optimisation…

Machine Learning · Statistics 2025-02-12 Eugenio Clerico , Tyler Farghly , George Deligiannidis , Benjamin Guedj , Arnaud Doucet

We study decentralized asynchronous multiagent optimization over networks, modeled as static (possibly directed) graphs. The optimization problem consists of minimizing a (possibly nonconvex) smooth function--the sum of the agents' local…

Optimization and Control · Mathematics 2020-02-03 Ye Tian , Ying Sun , Gesualdo Scutari

Quadratic programming (QP) forms a crucial foundation in optimization, encompassing a broad spectrum of domains and serving as the basis for more advanced algorithms. Consequently, as the scale and complexity of modern applications continue…

Optimization and Control · Mathematics 2025-01-28 Augustinos D. Saravanos , Hunter Kuperman , Alex Oshin , Arshiya Taj Abdul , Vincent Pacelli , Evangelos A. Theodorou

Optimal portfolio allocation is often formulated as a constrained risk problem, where one aims to minimize a risk measure subject to some performance constraints. This paper presents new Bayesian Optimization algorithms for such constrained…

Portfolio Management · Quantitative Finance 2025-03-25 Robert Millar , Jinglai Li

A novel multiscale consensus-based optimization (CBO) algorithm for solving bi- and tri-level optimization problems is introduced. Existing CBO techniques are generalized by the proposed method through the employment of multiple interacting…

Optimization and Control · Mathematics 2025-06-23 Michael Herty , Yuyang Huang , Dante Kalise , Hicham Kouhkouh

Compared to other techniques, particle swarm optimization is more frequently utilized because of its ease of use and low variability. However, it is complicated to find the best possible solution in the search space in large-scale…

Neural and Evolutionary Computing · Computer Science 2024-03-19 Hamed Zibaei , Mohammad Saadi Mesgari

This paper addresses the considerations that comes along with adopting decentralized communication for multi-agent localization applications in discrete state spaces. In this framework, we extend the original formulation of the Bayes…

Multiagent Systems · Computer Science 2023-01-24 Dom Huh , Prasant Mohapatra