English
Related papers

Related papers: DAMS: Distributed Adaptive Metaheuristic Selection

200 papers

This paper investigates the distributed power allocation problem for coordinated multipoint (CoMP) transmissions in distributed antenna systems (DAS). Traditional duality based optimization techniques cannot be directly applied to this…

Information Theory · Computer Science 2013-04-26 Xiujun Zhang , Yin Sun , Xiang Chen , Shidong Zhou , Jing Wang , Ness B. Shroff

The Distributed Adaptive Signal Fusion (DASF) framework is a meta-algorithm for computing data-driven spatial filters in a distributed sensing platform with limited bandwidth and computational resources, such as a wireless sensor network.…

Signal Processing · Electrical Eng. & Systems 2024-05-07 Charles Hovine , Alexander Bertrand

We analyze the convergence of gradient-based optimization algorithms that base their updates on delayed stochastic gradient information. The main application of our results is to the development of gradient-based distributed optimization…

Optimization and Control · Mathematics 2011-05-02 Alekh Agarwal , John C. Duchi

We study COMP-AMS, a distributed optimization framework based on gradient averaging and adaptive AMSGrad algorithm. Gradient compression with error feedback is applied to reduce the communication cost in the gradient transmission process.…

Machine Learning · Statistics 2022-05-12 Xiaoyun Li , Belhal Karimi , Ping Li

Distributed multi-party learning provides an effective approach for training a joint model with scattered data under legal and practical constraints. However, due to the quagmire of a skewed distribution of data labels across participants…

Machine Learning · Computer Science 2021-11-01 Maoguo Gong , Yuan Gao , Yue Wu , A. K. Qin

In modern large-scale systems with sensor networks and IoT devices it is essential to collaboratively solve complex problems while utilizing network resources efficiently. In our paper we present three distributed optimization algorithms…

Systems and Control · Electrical Eng. & Systems 2025-04-24 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

We consider a setting in which $N$ agents aim to speedup a common Stochastic Approximation (SA) problem by acting in parallel and communicating with a central server. We assume that the up-link transmissions to the server are subject to…

Artificial Intelligence · Computer Science 2024-08-05 Nicolò Dal Fabbro , Arman Adibi , H. Vincent Poor , Sanjeev R. Kulkarni , Aritra Mitra , George J. Pappas

Computing the optimal solution to a spatial filtering problems in a Wireless Sensor Network can incur large bandwidth and computational requirements if an approach relying on data centralization is used. The so-called distributed adaptive…

Signal Processing · Electrical Eng. & Systems 2023-03-01 Charles Hovine , Alexander Bertrand

This paper studies the application of the blended dynamics approach towards distributed optimization problem where the global cost function is given by a sum of local cost functions. The benefits include (i) individual cost function need…

Optimization and Control · Mathematics 2021-02-26 Seungjoon Lee , Hyungbo Shim

Stochastic gradient descent-based algorithms are widely used for training deep neural networks but often suffer from slow convergence. To address the challenge, we leverage the framework of the alternating direction method of multipliers…

Machine Learning · Computer Science 2025-02-03 Ouya Wang , Shenglong Zhou , Geoffrey Ye Li

In this paper, we propose two novel decentralized optimization frameworks for multi-agent nonlinear optimal control problems in robotics. The aim of this work is to suggest architectures that inherit the computational efficiency and…

Systems and Control · Electrical Eng. & Systems 2022-08-09 Augustinos D. Saravanos , Yuichiro Aoyama , Hongchang Zhu , Evangelos A. Theodorou

This paper presents a novel distributed robust optimization scheme for steering distributions of multi-agent systems under stochastic and deterministic uncertainty. Robust optimization is a subfield of optimization which aims to discover an…

Robotics · Computer Science 2025-01-31 Arshiya Taj Abdul , Augustinos D. Saravanos , Evangelos A. Theodorou

This paper presents a distributed optimization scheme over a network of agents in the presence of cost uncertainties and over switching communication topologies. Inspired by recent advances in distributed convex optimization, we propose a…

Optimization and Control · Mathematics 2016-11-15 Saghar Hosseini , Airlie Chapman , Mehran Mesbahi

Multi-agent distributed consensus optimization problems arise in many signal processing applications. Recently, the alternating direction method of multipliers (ADMM) has been used for solving this family of problems. ADMM based distributed…

Systems and Control · Computer Science 2015-06-18 Tsung-Hui Chang , Mingyi Hong , Xiangfeng Wang

Modern artificial intelligence relies on networks of agents that collect data, process information, and exchange it with neighbors to collaboratively solve optimization and learning problems. This article introduces a novel distributed…

Optimization and Control · Mathematics 2026-01-15 Diego Deplano , Nicola Bastianello , Mauro Franceschelli , Karl H. Johansson

In this work and its accompanying Part II [1], we develop an accelerated algorithmic framework, DAMA (Decentralized Accelerated Minimax Approach), for nonconvex Polyak-Lojasiewicz minimax optimization over decentralized multi-agent…

Optimization and Control · Mathematics 2025-12-17 Haoyuan Cai , Sulaiman A. Alghunaim , Ali H. Sayed

This paper investigates the problems large-scale distributed composite convex optimization, with motivations from a broad range of applications, including multi-agent systems, federated learning, smart grids, wireless sensor networks,…

Optimization and Control · Mathematics 2025-12-16 Maoran Wang , Xingju Cai , Yongxin Chen

This paper presents a distributed resource selection mechanism for diverse cloud-edge environments, enabling dynamic and context-aware allocation of resources to meet the demands of complex distributed applications. By distributing the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-10 Quentin Renau , Amjad Ullah , Emma Hart

Large Language Models (LLMs) have advanced the field of Combinatorial Optimization through automated heuristic generation. Instead of relying on manual design, this LLM-Driven Heuristic Design (LHD) process leverages LLMs to iteratively…

Machine Learning · Computer Science 2026-04-17 Rongzheng Wang , Yihong Huang , Muquan Li , Jiakai Li , Di Liang , Bob Simons , Pei Ke , Shuang Liang , Ke Qin

This paper studies a class of distributed optimization problems with coupled equality constraints in networked systems. Many existing distributed algorithms rely on solving local subproblems via the $\operatorname{argmin}$ operator in each…

Optimization and Control · Mathematics 2025-11-26 Chenyang Qiu , Zongli Lin